2024-04-20T21:00:18.119 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-20T21:00:18.119 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --name rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665373 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --verbose -- /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665373/orig.config.yaml 2024-04-20T21:00:18.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-20T21:00:18.252 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665373 branch: wip-rishabh-testing-20240416.193735 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: null first_in_suite: false job_id: '7665373' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240416.193735 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: a8c84f5997950fd7d008204839253291d52e6eda ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a8c84f5997950fd7d008204839253291d52e6eda selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240416.193735 sha1: a8c84f5997950fd7d008204839253291d52e6eda owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7954 sha1: a8c84f5997950fd7d008204839253291d52e6eda sleep_before_teardown: 0 subset: 364/512 suite: fs suite_branch: wip-rishabh-testing-20240416.193735 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8c84f5997950fd7d008204839253291d52e6eda syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEhUkEvue3v9oerQXcwSs3xW5MKtXD47xNG2+pYE7EfMoVbArBA3sqwFXq5Q00+YFigMcvmIU7AlPM9tJxiixEc= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO1Egv43Nsuc1fqpg2HR8WN8dljTq/deQ/IqL9RvWhVvAXm8EXiupX41dWcnnaYkjBYzDSPcZ7kYNX3xDvOOSDk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-20_20:50:37 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-20T21:00:18.252 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa; will attempt to use it 2024-04-20T21:00:18.253 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks 2024-04-20T21:00:18.253 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-20T21:00:18.255 INFO:teuthology.task.internal:Checking packages... 2024-04-20T21:00:18.277 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a8c84f5997950fd7d008204839253291d52e6eda' 2024-04-20T21:00:18.277 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-20T21:00:18.277 INFO:teuthology.packaging:ref: None 2024-04-20T21:00:18.277 INFO:teuthology.packaging:tag: None 2024-04-20T21:00:18.277 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240416.193735 2024-04-20T21:00:18.277 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:00:18.277 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240416.193735 2024-04-20T21:00:18.600 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3133.ga8c84f59 2024-04-20T21:00:18.601 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-20T21:00:18.608 INFO:teuthology.task.internal:no buildpackages task found 2024-04-20T21:00:18.609 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-20T21:00:18.649 INFO:teuthology.task.internal:Saving configuration 2024-04-20T21:00:18.664 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-20T21:00:18.687 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-20T21:00:18.713 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665373', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 20:51:36.273755', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEhUkEvue3v9oerQXcwSs3xW5MKtXD47xNG2+pYE7EfMoVbArBA3sqwFXq5Q00+YFigMcvmIU7AlPM9tJxiixEc='} 2024-04-20T21:00:18.734 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665373', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 20:51:36.276000', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO1Egv43Nsuc1fqpg2HR8WN8dljTq/deQ/IqL9RvWhVvAXm8EXiupX41dWcnnaYkjBYzDSPcZ7kYNX3xDvOOSDk='} 2024-04-20T21:00:18.734 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-20T21:00:18.741 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-20T21:00:18.741 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-20T21:00:18.741 INFO:teuthology.run_tasks:Running task console_log... 2024-04-20T21:00:18.835 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0d940f4160>, signals=[15]) 2024-04-20T21:00:18.835 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-20T21:00:18.841 INFO:teuthology.task.internal:Opening connections... 2024-04-20T21:00:18.842 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-04-20T21:00:18.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:00:18.936 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-04-20T21:00:18.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:00:19.026 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-20T21:00:19.033 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-04-20T21:00:19.051 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-04-20T21:00:19.051 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-04-20T21:00:19.108 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-04-20T21:00:19.108 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-04-20T21:00:19.108 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-04-20T21:00:19.108 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-04-20T21:00:19.108 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-04-20T21:00:19.108 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-04-20T21:00:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-20T21:00:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-04-20T21:00:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-04-20T21:00:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-20T21:00:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-04-20T21:00:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-20T21:00:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-20T21:00:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-20T21:00:19.110 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-04-20T21:00:19.130 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-04-20T21:00:19.148 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-04-20T21:00:19.148 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-04-20T21:00:19.206 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-20T21:00:19.207 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-20T21:00:19.207 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-20T21:00:19.207 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-20T21:00:19.230 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-20T21:00:19.239 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-20T21:00:19.259 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-20T21:00:19.259 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-04-20T21:00:19.261 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-04-20T21:00:19.277 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-20T21:00:19.292 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-20T21:00:19.292 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-04-20T21:00:19.318 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-04-20T21:00:19.348 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-20T21:00:19.402 INFO:teuthology.run_tasks:Running task kernel... 2024-04-20T21:00:19.416 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-20T21:00:19.417 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-20T21:00:19.417 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-20T21:00:19.417 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-20T21:00:19.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:00:19.433 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:00:19.433 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-20T21:00:19.434 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-04-20T21:00:19.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:00:19.435 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:00:19.435 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-20T21:00:19.435 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-04-20T21:00:19.490 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-437.el9.x86_64 2024-04-20T21:00:19.490 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:00:19.491 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-20T21:00:19.491 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:00:19.494 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-437.el9.x86_64 2024-04-20T21:00:19.494 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:00:19.494 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-20T21:00:19.495 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:00:19.643 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum upgrade -y linux-firmware 2024-04-20T21:00:19.800 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum upgrade -y linux-firmware 2024-04-20T21:00:22.762 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.0 MB 00:01 2024-04-20T21:00:31.465 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 820 kB/s | 8.0 MB 00:10 2024-04-20T21:00:35.824 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 5.9 MB/s | 19 MB 00:03 2024-04-20T21:00:40.360 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 6.2 MB 00:00 2024-04-20T21:00:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-20T21:00:44.712 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-20T21:00:45.798 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 887 kB/s | 19 MB 00:21 2024-04-20T21:00:49.826 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-20T21:00:51.894 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-20T21:00:51.895 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-20T21:00:51.895 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-20T21:00:52.010 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-20T21:00:52.011 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:00:52.232 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-20T21:00:52.232 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-20T21:00:52.235 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi137.front.sepia.ceph.com to complete... 2024-04-20T21:00:53.315 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.2 MB 00:03 2024-04-20T21:00:56.082 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-04-20T21:00:58.194 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:01 2024-04-20T21:01:03.225 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-20T21:01:05.246 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-04-20T21:01:05.247 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-04-20T21:01:05.247 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-04-20T21:01:05.352 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-20T21:01:05.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:01:05.491 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-20T21:01:05.492 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-20T21:01:05.494 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi071.front.sepia.ceph.com to complete... 2024-04-20T21:07:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20 21:07:18 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-20T21:07:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:FINISHED --2024-04-20 21:07:18-- 2024-04-20T21:07:18.352 INFO:teuthology.orchestra.run.smithi071.stderr:Total wall clock time: 6m 13s 2024-04-20T21:07:18.352 INFO:teuthology.orchestra.run.smithi071.stderr:Downloaded: 1 files, 341M in 6m 12s (937 KB/s) 2024-04-20T21:07:18.355 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-20T21:07:18.355 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-20T21:07:20.493 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying... ######################################## 2024-04-20T21:07:20.720 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing... ######################################## 2024-04-20T21:07:20.843 INFO:teuthology.orchestra.run.smithi071.stdout:Updating / installing... 2024-04-20T21:07:28.789 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-20T21:08:06.233 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-20T21:08:06.233 DEBUG:teuthology.orchestra.run.smithi071:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-20T21:08:06.312 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-20T21:08:06.313 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-20T21:08:06.313 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-20T21:08:06.313 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-20T21:08:06.313 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-20T21:08:06.313 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-20T21:08:06.313 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-20T21:08:06.313 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-20T21:08:06.313 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-20T21:08:06.313 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-20T21:08:06.314 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-20T21:08:06.315 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-20T21:08:06.316 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-20T21:08:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-20T21:08:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-20T21:08:06.319 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-20T21:08:06.320 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-20T21:08:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-20T21:08:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-20T21:08:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-20T21:08:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-20T21:08:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-20T21:08:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-20T21:08:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-20T21:08:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-20T21:08:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-20T21:08:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-20T21:08:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-20T21:08:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-20T21:08:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-20T21:08:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-20T21:08:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-20T21:08:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-20T21:08:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-20T21:08:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-20T21:08:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-20T21:08:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-20T21:08:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-20T21:08:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-20T21:08:06.323 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-20T21:08:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-20T21:08:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-20T21:08:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-20T21:08:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-20T21:08:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-20T21:08:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-20T21:08:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-20T21:08:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-20T21:08:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-20T21:08:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-20T21:08:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-20T21:08:06.325 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-20T21:08:06.326 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-20T21:08:06.327 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-20T21:08:06.328 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-20T21:08:06.328 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-20T21:08:06.328 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-20T21:08:06.328 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-20T21:08:06.328 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-20T21:08:06.328 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-20T21:08:06.328 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-20T21:08:06.328 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-20T21:08:06.328 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-20T21:08:06.328 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-20T21:08:06.328 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-20T21:08:06.329 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-20T21:08:06.330 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-20T21:08:06.331 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-20T21:08:06.331 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-20T21:08:06.331 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-20T21:08:06.331 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-20T21:08:06.331 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-20T21:08:06.331 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-20T21:08:06.331 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-20T21:08:06.331 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-20T21:08:06.332 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-20T21:08:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-20T21:08:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-20T21:08:06.335 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-20T21:08:06.336 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-20T21:08:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-20T21:08:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-20T21:08:06.339 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-20T21:08:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-20T21:08:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-20T21:08:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-20T21:08:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-20T21:08:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-20T21:08:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-20T21:08:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-20T21:08:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-20T21:08:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-20T21:08:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-20T21:08:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-20T21:08:06.341 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-20T21:08:06.341 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-20T21:08:06.341 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-20T21:08:06.341 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-20T21:08:06.341 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-20T21:08:06.341 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-20T21:08:06.341 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-20T21:08:06.341 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-20T21:08:06.341 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-20T21:08:06.341 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-20T21:08:06.342 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-20T21:08:06.343 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-20T21:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-20T21:08:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-20T21:08:06.346 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-20T21:08:06.347 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-20T21:08:06.348 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-20T21:08:06.348 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-20T21:08:06.348 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-20T21:08:06.348 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-20T21:08:06.348 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-20T21:08:06.348 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-20T21:08:06.348 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-20T21:08:06.348 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-20T21:08:06.348 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-20T21:08:06.348 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-20T21:08:06.349 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-20T21:08:06.350 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-20T21:08:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-20T21:08:06.352 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-20T21:08:06.353 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-20T21:08:06.354 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-20T21:08:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-20T21:08:06.356 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-20T21:08:06.356 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-20T21:08:06.356 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-20T21:08:06.356 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-20T21:08:06.356 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-20T21:08:06.356 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-20T21:08:06.356 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-20T21:08:06.356 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-20T21:08:06.356 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-20T21:08:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-20T21:08:06.358 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-20T21:08:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-20T21:08:06.360 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-20T21:08:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-20T21:08:06.362 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-20T21:08:06.363 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-20T21:08:06.363 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-20T21:08:06.363 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-20T21:08:06.365 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-20T21:08:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-20T21:08:06.367 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-20T21:08:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-20T21:08:06.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-20T21:08:06.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-20T21:08:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-20T21:08:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-20T21:08:06.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-20T21:08:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-20T21:08:06.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-20T21:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-20T21:08:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-20T21:08:06.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-20T21:08:06.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-20T21:08:06.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-20T21:08:06.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-20T21:08:06.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-20T21:08:06.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-20T21:08:06.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-20T21:08:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-20T21:08:06.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-20T21:08:06.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-20T21:08:06.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-20T21:08:06.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-20T21:08:06.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-20T21:08:06.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-20T21:08:06.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-20T21:08:06.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-20T21:08:06.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-20T21:08:06.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-20T21:08:06.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-20T21:08:06.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-20T21:08:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-20T21:08:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-20T21:08:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-20T21:08:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-20T21:08:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-20T21:08:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-20T21:08:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-20T21:08:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-20T21:08:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-20T21:08:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-20T21:08:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-20T21:08:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-20T21:08:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-20T21:08:06.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-20T21:08:06.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-20T21:08:06.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-20T21:08:06.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-20T21:08:06.396 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-20T21:08:06.396 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-20T21:08:06.396 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-20T21:08:06.396 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-20T21:08:06.396 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-20T21:08:06.396 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-20T21:08:06.396 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-20T21:08:06.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-20T21:08:06.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-20T21:08:06.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-20T21:08:06.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-20T21:08:06.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-20T21:08:06.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-20T21:08:06.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-20T21:08:06.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-20T21:08:06.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-20T21:08:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-20T21:08:06.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-20T21:08:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-20T21:08:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-20T21:08:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-20T21:08:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-20T21:08:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-20T21:08:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-20T21:08:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-20T21:08:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-20T21:08:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-20T21:08:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-20T21:08:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-20T21:08:06.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-20T21:08:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-20T21:08:06.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-20T21:08:06.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-20T21:08:06.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-20T21:08:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-20T21:08:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-20T21:08:06.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-20T21:08:06.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-20T21:08:06.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-20T21:08:06.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-20T21:08:06.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-20T21:08:06.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-20T21:08:06.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-20T21:08:06.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-20T21:08:06.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-20T21:08:06.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-20T21:08:06.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-20T21:08:06.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-20T21:08:06.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-20T21:08:06.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-20T21:08:06.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-20T21:08:06.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-20T21:08:06.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-20T21:08:06.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-20T21:08:06.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-20T21:08:06.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-20T21:08:06.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-20T21:08:06.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-20T21:08:06.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-20T21:08:06.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-20T21:08:06.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-20T21:08:06.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-20T21:08:06.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-20T21:08:06.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-20T21:08:06.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-20T21:08:06.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-20T21:08:06.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-20T21:08:06.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-20T21:08:06.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-20T21:08:06.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-20T21:08:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-20T21:08:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-20T21:08:06.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-20T21:08:06.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-20T21:08:06.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-20T21:08:06.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-20T21:08:06.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-20T21:08:06.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-20T21:08:06.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-20T21:08:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-20T21:08:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-20T21:08:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-20T21:08:06.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-20T21:08:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-20T21:08:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-20T21:08:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-20T21:08:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-20T21:08:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-20T21:08:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-20T21:08:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-20T21:08:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-20T21:08:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-20T21:08:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-20T21:08:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-20T21:08:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-20T21:08:06.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-20T21:08:06.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-20T21:08:06.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-20T21:08:06.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-20T21:08:06.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-20T21:08:06.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-20T21:08:06.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-20T21:08:06.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-20T21:08:06.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-20T21:08:06.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-20T21:08:06.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-20T21:08:06.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-20T21:08:06.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-20T21:08:06.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-20T21:08:06.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-20T21:08:06.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-20T21:08:06.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-20T21:08:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-20T21:08:06.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-20T21:08:06.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-20T21:08:06.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-20T21:08:06.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-20T21:08:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-20T21:08:06.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-20T21:08:06.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-20T21:08:06.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-20T21:08:06.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-20T21:08:06.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-20T21:08:06.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-20T21:08:06.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-20T21:08:06.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-20T21:08:06.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-20T21:08:06.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-20T21:08:06.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-20T21:08:06.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-20T21:08:06.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-20T21:08:06.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-20T21:08:06.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-20T21:08:06.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-20T21:08:06.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-20T21:08:06.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-20T21:08:06.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-20T21:08:06.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-20T21:08:06.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-20T21:08:06.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-20T21:08:06.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-20T21:08:06.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-20T21:08:06.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-20T21:08:06.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-20T21:08:06.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-20T21:08:06.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-20T21:08:06.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-20T21:08:06.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-20T21:08:06.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-20T21:08:06.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-20T21:08:06.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-20T21:08:06.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-20T21:08:06.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-20T21:08:06.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-20T21:08:06.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-20T21:08:06.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-20T21:08:06.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-20T21:08:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-20T21:08:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-20T21:08:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-20T21:08:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-20T21:08:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-20T21:08:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-20T21:08:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-20T21:08:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-20T21:08:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-20T21:08:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-20T21:08:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-20T21:08:06.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-20T21:08:06.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-20T21:08:06.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-20T21:08:06.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-20T21:08:06.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-20T21:08:06.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-20T21:08:06.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-20T21:08:06.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-20T21:08:06.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-20T21:08:06.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-20T21:08:06.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-20T21:08:06.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-20T21:08:06.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-20T21:08:06.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-20T21:08:06.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-20T21:08:06.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-20T21:08:06.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-20T21:08:06.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-20T21:08:06.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-20T21:08:06.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-20T21:08:06.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-20T21:08:06.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-20T21:08:06.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-20T21:08:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-20T21:08:06.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-20T21:08:06.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-20T21:08:06.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-20T21:08:06.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-20T21:08:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-20T21:08:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-20T21:08:06.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-20T21:08:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-20T21:08:06.466 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-20T21:08:06.466 DEBUG:teuthology.orchestra.run.smithi071:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-20T21:08:06.488 INFO:teuthology.orchestra.run.smithi071.stdout:postinstall scriptlet (using /bin/sh): 2024-04-20T21:08:06.488 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout:for file in vmlinuz System.map config; do 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout: fi 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout:done 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-20T21:08:06.489 INFO:teuthology.orchestra.run.smithi071.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-20T21:08:06.490 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2024-04-20T21:08:06.490 INFO:teuthology.orchestra.run.smithi071.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-20T21:08:06.490 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-20T21:08:06.490 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-20T21:08:06.490 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2024-04-20T21:08:06.491 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2024-04-20T21:08:06.562 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2024-04-20T21:08:06.562 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2024-04-20T21:08:06.562 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.06 2024-04-20T21:08:06.562 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 68.el9 2024-04-20T21:08:06.562 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2024-04-20T21:08:06.562 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-20T21:08:06.562 INFO:teuthology.orchestra.run.smithi071.stdout:Group : Unspecified 2024-04-20T21:08:06.562 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 8264254 2024-04-20T21:08:06.562 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : builder@centos.org 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-20T21:08:06.563 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-20T21:08:06.564 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-20T21:08:06.564 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2024-04-20T21:08:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:08:06.564 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2024-04-20T21:08:06.565 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-20T21:08:06.565 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 6.9.0-rc3-g806ec36b2112 2024-04-20T21:08:06.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-20T21:08:07.117 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-04-20T21:08:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-20T21:08:08.517 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-04-20T21:08:08.519 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-04-20T21:08:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.mr0OsRehEE 2024-04-20T21:08:08.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mr0OsRehEE 2024-04-20T21:08:08.599 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.mr0OsRehEE 2024-04-20T21:08:08.739 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.mr0OsRehEE is 6KB 2024-04-20T21:08:08.786 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.mr0OsRehEE 2024-04-20T21:08:08.800 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2024-04-20T21:08:08.867 INFO:teuthology.orchestra.run.smithi071.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-20T21:08:08.868 INFO:teuthology.orchestra.run.smithi071.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-20T21:08:08.868 INFO:teuthology.orchestra.run.smithi071.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-20T21:08:08.868 INFO:teuthology.orchestra.run.smithi071.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-20T21:08:08.869 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-20T21:08:09.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2024-04-20T21:08:39.028 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-20T21:08:39.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-20T21:08:39.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:09:16.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20 21:09:16 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-20T21:09:16.201 INFO:teuthology.orchestra.run.smithi137.stderr:FINISHED --2024-04-20 21:09:16-- 2024-04-20T21:09:16.201 INFO:teuthology.orchestra.run.smithi137.stderr:Total wall clock time: 8m 24s 2024-04-20T21:09:16.201 INFO:teuthology.orchestra.run.smithi137.stderr:Downloaded: 1 files, 341M in 8m 23s (693 KB/s) 2024-04-20T21:09:16.205 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-20T21:09:16.205 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-20T21:09:18.304 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying... ######################################## 2024-04-20T21:09:18.428 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing... ######################################## 2024-04-20T21:09:18.548 INFO:teuthology.orchestra.run.smithi137.stdout:Updating / installing... 2024-04-20T21:09:26.543 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-20T21:09:39.031 DEBUG:teuthology.orchestra.remote:timed out 2024-04-20T21:09:48.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-20T21:09:48.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:09:49.425 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-04-20T21:09:50.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-20T21:09:50.069 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-20T21:09:50.069 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-04-20T21:09:50.122 INFO:teuthology.orchestra.run.smithi071.stdout:6.9.0-rc3-g806ec36b2112 2024-04-20T21:09:50.122 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-20T21:09:50.122 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-20T21:09:50.123 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-20T21:09:51.124 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-20T21:09:51.124 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-20T21:09:51.237 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2024-04-20T21:09:51.292 DEBUG:teuthology.parallel:result is None 2024-04-20T21:10:03.642 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-20T21:10:03.643 DEBUG:teuthology.orchestra.run.smithi137:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-20T21:10:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-20T21:10:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-20T21:10:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-20T21:10:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-20T21:10:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-20T21:10:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-20T21:10:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-20T21:10:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-20T21:10:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-20T21:10:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-20T21:10:03.721 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-20T21:10:03.722 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-20T21:10:03.723 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-20T21:10:03.724 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-20T21:10:03.725 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-20T21:10:03.726 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-20T21:10:03.727 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-20T21:10:03.728 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-20T21:10:03.729 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-20T21:10:03.730 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-20T21:10:03.731 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-20T21:10:03.732 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-20T21:10:03.733 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-20T21:10:03.734 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-20T21:10:03.735 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-20T21:10:03.736 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-20T21:10:03.737 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-20T21:10:03.738 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-20T21:10:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-20T21:10:03.740 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-20T21:10:03.741 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-20T21:10:03.742 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-20T21:10:03.743 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-20T21:10:03.744 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-20T21:10:03.745 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-20T21:10:03.746 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-20T21:10:03.747 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-20T21:10:03.748 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-20T21:10:03.749 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-20T21:10:03.750 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-20T21:10:03.751 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-20T21:10:03.752 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-20T21:10:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-20T21:10:03.754 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-20T21:10:03.755 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-20T21:10:03.756 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-20T21:10:03.757 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-20T21:10:03.758 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-20T21:10:03.759 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-20T21:10:03.760 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-20T21:10:03.761 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-20T21:10:03.762 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-20T21:10:03.763 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-20T21:10:03.764 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-20T21:10:03.765 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-20T21:10:03.766 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-20T21:10:03.767 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-20T21:10:03.768 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-20T21:10:03.769 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-20T21:10:03.770 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-20T21:10:03.771 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-20T21:10:03.772 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-20T21:10:03.773 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-20T21:10:03.774 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-20T21:10:03.775 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-20T21:10:03.776 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-20T21:10:03.777 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-20T21:10:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-20T21:10:03.779 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-20T21:10:03.780 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-20T21:10:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-20T21:10:03.782 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-20T21:10:03.783 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-20T21:10:03.784 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-20T21:10:03.785 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-20T21:10:03.786 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-20T21:10:03.787 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-20T21:10:03.788 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-20T21:10:03.789 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-20T21:10:03.790 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-20T21:10:03.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-20T21:10:03.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-20T21:10:03.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-20T21:10:03.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-20T21:10:03.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-20T21:10:03.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-20T21:10:03.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-20T21:10:03.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-20T21:10:03.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-20T21:10:03.791 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-20T21:10:03.792 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-20T21:10:03.793 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-20T21:10:03.794 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-20T21:10:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-20T21:10:03.796 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-20T21:10:03.797 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-20T21:10:03.798 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-20T21:10:03.799 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-20T21:10:03.800 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-20T21:10:03.801 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-20T21:10:03.802 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-20T21:10:03.803 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-20T21:10:03.804 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-20T21:10:03.805 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-20T21:10:03.806 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-20T21:10:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-20T21:10:03.808 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-20T21:10:03.809 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-20T21:10:03.810 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-20T21:10:03.811 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-20T21:10:03.812 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-20T21:10:03.813 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-20T21:10:03.814 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-20T21:10:03.815 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-20T21:10:03.816 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-20T21:10:03.817 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-20T21:10:03.818 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-20T21:10:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-20T21:10:03.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-20T21:10:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-20T21:10:03.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-20T21:10:03.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-20T21:10:03.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-20T21:10:03.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-20T21:10:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-20T21:10:03.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-20T21:10:03.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-20T21:10:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-20T21:10:03.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-20T21:10:03.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-20T21:10:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-20T21:10:03.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-20T21:10:03.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-20T21:10:03.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-20T21:10:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-20T21:10:03.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-20T21:10:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-20T21:10:03.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-20T21:10:03.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-20T21:10:03.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-20T21:10:03.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-20T21:10:03.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-20T21:10:03.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-20T21:10:03.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-20T21:10:03.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-20T21:10:03.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-20T21:10:03.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-20T21:10:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-20T21:10:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-20T21:10:03.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-20T21:10:03.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-20T21:10:03.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-20T21:10:03.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-20T21:10:03.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-20T21:10:03.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-20T21:10:03.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-20T21:10:03.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-20T21:10:03.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-20T21:10:03.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-20T21:10:03.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-20T21:10:03.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-20T21:10:03.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-20T21:10:03.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-20T21:10:03.858 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-20T21:10:03.858 DEBUG:teuthology.orchestra.run.smithi137:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-20T21:10:03.882 INFO:teuthology.orchestra.run.smithi137.stdout:postinstall scriptlet (using /bin/sh): 2024-04-20T21:10:03.883 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-20T21:10:03.883 INFO:teuthology.orchestra.run.smithi137.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-20T21:10:03.883 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-20T21:10:03.883 INFO:teuthology.orchestra.run.smithi137.stdout:for file in vmlinuz System.map config; do 2024-04-20T21:10:03.883 INFO:teuthology.orchestra.run.smithi137.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-20T21:10:03.883 INFO:teuthology.orchestra.run.smithi137.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:10:03.883 INFO:teuthology.orchestra.run.smithi137.stdout: fi 2024-04-20T21:10:03.883 INFO:teuthology.orchestra.run.smithi137.stdout:done 2024-04-20T21:10:03.883 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-20T21:10:03.883 INFO:teuthology.orchestra.run.smithi137.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-20T21:10:03.884 INFO:teuthology.orchestra.run.smithi137.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:10:03.884 INFO:teuthology.orchestra.run.smithi137.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:10:03.884 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-20T21:10:03.884 INFO:teuthology.orchestra.run.smithi137.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-20T21:10:03.884 INFO:teuthology.orchestra.run.smithi137.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-20T21:10:03.884 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-20T21:10:03.884 INFO:teuthology.orchestra.run.smithi137.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-20T21:10:03.884 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-20T21:10:03.884 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-20T21:10:03.884 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-20T21:10:03.885 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -qi grub2-tools 2024-04-20T21:10:03.968 INFO:teuthology.orchestra.run.smithi137.stdout:Name : grub2-tools 2024-04-20T21:10:03.968 INFO:teuthology.orchestra.run.smithi137.stdout:Epoch : 1 2024-04-20T21:10:03.968 INFO:teuthology.orchestra.run.smithi137.stdout:Version : 2.06 2024-04-20T21:10:03.968 INFO:teuthology.orchestra.run.smithi137.stdout:Release : 68.el9 2024-04-20T21:10:03.968 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: x86_64 2024-04-20T21:10:03.968 INFO:teuthology.orchestra.run.smithi137.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-20T21:10:03.968 INFO:teuthology.orchestra.run.smithi137.stdout:Group : Unspecified 2024-04-20T21:10:03.968 INFO:teuthology.orchestra.run.smithi137.stdout:Size : 8264254 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:License : GPLv3+ 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:Packager : builder@centos.org 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:Vendor : CentOS 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:Summary : Support tools for GRUB. 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:Description : 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-20T21:10:03.969 INFO:teuthology.orchestra.run.smithi137.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-20T21:10:03.970 INFO:teuthology.orchestra.run.smithi137.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-20T21:10:03.970 INFO:teuthology.orchestra.run.smithi137.stdout:hardware devices. 2024-04-20T21:10:03.970 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:10:03.970 INFO:teuthology.orchestra.run.smithi137.stdout:This subpackage provides tools for support of all platforms. 2024-04-20T21:10:03.971 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-20T21:10:03.971 INFO:teuthology.task.kernel:Updating grub on smithi137 to boot 6.9.0-rc3-g806ec36b2112 2024-04-20T21:10:03.971 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-20T21:10:04.514 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-04-20T21:10:05.990 INFO:teuthology.orchestra.run.smithi137.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-20T21:10:06.010 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-04-20T21:10:06.012 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-04-20T21:10:06.029 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.VGOqUtTU7F 2024-04-20T21:10:06.029 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VGOqUtTU7F 2024-04-20T21:10:06.096 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.VGOqUtTU7F 2024-04-20T21:10:06.233 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.VGOqUtTU7F is 6KB 2024-04-20T21:10:06.253 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.VGOqUtTU7F 2024-04-20T21:10:06.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo /bin/ls /boot/loader/entries || true 2024-04-20T21:10:06.329 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-20T21:10:06.329 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-20T21:10:06.329 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-20T21:10:06.329 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-20T21:10:06.330 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-20T21:10:06.492 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-04-20T21:10:36.496 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-20T21:10:36.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-20T21:10:36.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:10:55.006 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-20T21:11:04.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-20T21:11:04.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:11:07.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-20T21:11:19.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-20T21:11:19.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:11:53.355 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-20T21:11:53.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-20T21:11:53.910 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-20T21:11:53.910 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-04-20T21:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout:6.9.0-rc3-g806ec36b2112 2024-04-20T21:11:53.949 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-20T21:11:53.949 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-20T21:11:53.949 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-20T21:11:54.950 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-20T21:11:54.950 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-20T21:11:55.087 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2024-04-20T21:11:55.155 DEBUG:teuthology.parallel:result is None 2024-04-20T21:11:55.155 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-20T21:11:55.163 INFO:teuthology.task.internal:Creating test directory... 2024-04-20T21:11:55.163 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-20T21:11:55.173 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-20T21:11:55.228 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-20T21:11:55.236 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-20T21:11:55.246 INFO:teuthology.task.internal:Creating archive directory... 2024-04-20T21:11:55.246 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-20T21:11:55.251 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-20T21:11:55.325 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-20T21:11:55.332 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-20T21:11:55.332 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-20T21:11:55.339 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-20T21:11:55.425 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T21:11:55.430 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T21:11:55.449 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T21:11:55.462 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T21:11:55.466 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-20T21:11:55.473 INFO:teuthology.task.internal:Configuring sudo... 2024-04-20T21:11:55.474 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-20T21:11:55.479 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-20T21:11:55.563 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-20T21:11:55.572 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-20T21:11:55.572 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-20T21:11:55.577 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-20T21:11:55.627 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T21:11:55.707 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T21:11:55.830 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T21:11:55.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T21:11:56.000 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:11:56.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-20T21:11:56.086 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T21:11:56.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T21:11:56.256 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T21:11:56.336 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T21:11:56.405 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:11:56.405 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-20T21:11:56.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-04-20T21:11:56.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-04-20T21:11:56.601 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T21:11:56.635 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T21:11:57.121 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-20T21:11:57.129 INFO:teuthology.task.internal:Starting timer... 2024-04-20T21:11:57.129 INFO:teuthology.run_tasks:Running task pcp... 2024-04-20T21:11:57.139 INFO:teuthology.run_tasks:Running task selinux... 2024-04-20T21:11:57.156 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-20T21:11:57.156 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-04-20T21:11:57.297 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-04-20T21:11:57.302 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-04-20T21:11:57.433 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-04-20T21:11:57.438 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-20T21:11:57.439 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-04-20T21:11:57.493 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-04-20T21:11:57.494 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-04-20T21:11:57.547 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-04-20T21:11:57.547 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi137.front.sepia.ceph.com': 'permissive'} 2024-04-20T21:11:57.547 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T21:11:57.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:11:57.620 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T21:11:57.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:11:57.690 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-20T21:11:57.690 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-04-20T21:11:57.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-04-20T21:11:57.848 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-20T21:11:57.858 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-20T21:11:57.874 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-20T21:11:57.878 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi137.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-20T21:14:19.910 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com')] 2024-04-20T21:14:19.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-20T21:14:19.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:14:20.019 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-04-20T21:14:20.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-20T21:14:20.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-20T21:14:20.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:14:20.285 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-20T21:14:20.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-20T21:14:20.438 INFO:teuthology.run_tasks:Running task clock... 2024-04-20T21:14:20.448 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-20T21:14:20.448 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-20T21:14:20.448 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T21:14:20.458 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-20T21:14:20.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T21:14:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-20T21:14:20.546 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-20T21:14:20.587 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-20T21:14:20.587 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-20T21:14:20.661 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-04-20T21:14:20.663 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-04-20T21:14:20.693 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-04-20T21:14:20.697 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-04-20T21:14:20.736 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-20T21:14:20.737 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-20T21:14:20.777 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-20T21:14:20.778 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-20T21:14:20.909 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-04-20T21:14:20.914 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T21:14:20.914 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-04-20T21:14:20.914 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:14:20.914 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:14:20.914 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:14:20.914 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:14:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-04-20T21:14:20.931 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T21:14:20.931 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-04-20T21:14:20.931 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:14:20.931 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:14:20.931 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:14:20.931 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:14:20.932 INFO:teuthology.run_tasks:Running task install... 2024-04-20T21:14:20.941 DEBUG:teuthology.task.install:project ceph 2024-04-20T21:14:20.941 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}} 2024-04-20T21:14:20.941 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'} 2024-04-20T21:14:20.942 INFO:teuthology.task.install:Using flavor: default 2024-04-20T21:14:20.947 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-20T21:14:20.947 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-20T21:14:20.948 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'tag': None, 'wait_for_package': False} 2024-04-20T21:14:20.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:14:20.950 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'tag': None, 'wait_for_package': False} 2024-04-20T21:14:20.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:14:21.103 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/ 2024-04-20T21:14:21.103 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3133.ga8c84f59 2024-04-20T21:14:21.107 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/ 2024-04-20T21:14:21.107 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3133.ga8c84f59 2024-04-20T21:14:21.459 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-20T21:14:21.459 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:14:21.459 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-20T21:14:21.462 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-20T21:14:21.462 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:14:21.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-20T21:14:21.551 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-20T21:14:21.552 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c84f5997950fd7d008204839253291d52e6eda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-20T21:14:21.555 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-20T21:14:21.556 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c84f5997950fd7d008204839253291d52e6eda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-20T21:14:21.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-20T21:14:21.680 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-20T21:14:21.783 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-20T21:14:21.791 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-20T21:14:21.860 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-04-20T21:14:21.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-04-20T21:14:21.870 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-04-20T21:14:21.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-04-20T21:14:22.192 INFO:teuthology.orchestra.run.smithi137.stdout:48 files removed 2024-04-20T21:14:22.196 INFO:teuthology.orchestra.run.smithi071.stdout:48 files removed 2024-04-20T21:14:22.231 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-20T21:14:22.235 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-20T21:14:23.648 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 85 kB/s | 84 kB 00:00 2024-04-20T21:14:23.686 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 82 kB/s | 84 kB 00:01 2024-04-20T21:14:24.640 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 13 kB/s | 12 kB 00:00 2024-04-20T21:14:24.769 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 12 kB/s | 12 kB 00:00 2024-04-20T21:14:25.540 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 2.3 kB/s | 1.9 kB 00:00 2024-04-20T21:14:25.695 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 2.3 kB/s | 1.9 kB 00:00 2024-04-20T21:14:26.843 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 7.6 MB/s | 8.0 MB 00:01 2024-04-20T21:14:27.796 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.0 MB 00:02 2024-04-20T21:14:29.274 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-20T21:14:29.789 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-20T21:14:35.191 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.2 MB 00:01 2024-04-20T21:14:36.982 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 16 kB 00:00 2024-04-20T21:14:38.434 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-20T21:14:41.393 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 769 kB/s | 6.2 MB 00:08 2024-04-20T21:14:43.338 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 16 kB 00:00 2024-04-20T21:14:44.303 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-20T21:14:44.859 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-20T21:14:46.863 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T21:14:46.865 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T21:14:46.887 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-20T21:14:46.889 INFO:teuthology.orchestra.run.smithi071.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-20T21:14:46.890 INFO:teuthology.orchestra.run.smithi071.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-20T21:14:46.892 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-20T21:14:46.894 INFO:teuthology.orchestra.run.smithi071.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-20T21:14:46.898 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-20T21:14:46.899 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-20T21:14:46.970 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-04-20T21:14:46.991 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-04-20T21:14:46.991 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-04-20T21:14:46.991 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 6.6 k 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 893 k 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 145 k 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 1.5 M 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 142 k 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 3.5 M 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 7.4 M 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 49 k 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 11 M 2024-04-20T21:14:46.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 49 M 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 273 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 763 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 225 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 27 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 18 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 32 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 748 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 126 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-20T21:14:46.993 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 162 k 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 321 k 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 299 k 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 99 k 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 85 k 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 170 k 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-04-20T21:14:46.994 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.4 M 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 21 M 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 34 k 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 2.4 M 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 249 k 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 4.7 M 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 17 M 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 16 k 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 25 k 2024-04-20T21:14:46.995 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 163 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-20T21:14:46.996 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 501 k 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-20T21:14:46.997 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 45 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 135 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-20T21:14:46.998 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-20T21:14:46.999 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-20T21:14:47.000 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-20T21:14:47.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-20T21:14:47.002 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-04-20T21:14:47.003 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-20T21:14:47.003 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:14:47.003 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-04-20T21:14:47.003 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-04-20T21:14:47.003 INFO:teuthology.orchestra.run.smithi071.stdout:Install 148 Packages 2024-04-20T21:14:47.003 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 2 Packages 2024-04-20T21:14:47.003 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:14:47.003 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 218 M 2024-04-20T21:14:47.004 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-04-20T21:14:48.188 INFO:teuthology.orchestra.run.smithi071.stdout:(1/150): ceph-19.0.0-3133.ga8c84f59.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-04-20T21:14:49.230 INFO:teuthology.orchestra.run.smithi071.stdout:(2/150): ceph-fuse-19.0.0-3133.ga8c84f59.el9.x8 858 kB/s | 893 kB 00:01 2024-04-20T21:14:49.496 INFO:teuthology.orchestra.run.smithi071.stdout:(3/150): ceph-immutable-object-cache-19.0.0-313 545 kB/s | 145 kB 00:00 2024-04-20T21:14:50.623 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-04-20T21:14:52.228 INFO:teuthology.orchestra.run.smithi071.stdout:(4/150): ceph-mds-19.0.0-3133.ga8c84f59.el9.x86 885 kB/s | 2.4 MB 00:02 2024-04-20T21:14:52.388 INFO:teuthology.orchestra.run.smithi071.stdout:(5/150): ceph-base-19.0.0-3133.ga8c84f59.el9.x8 1.2 MB/s | 5.4 MB 00:04 2024-04-20T21:14:53.075 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T21:14:53.076 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T21:14:53.096 INFO:teuthology.orchestra.run.smithi137.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-20T21:14:53.097 INFO:teuthology.orchestra.run.smithi137.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-20T21:14:53.099 INFO:teuthology.orchestra.run.smithi137.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-20T21:14:53.100 INFO:teuthology.orchestra.run.smithi137.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-20T21:14:53.102 INFO:teuthology.orchestra.run.smithi137.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-20T21:14:53.106 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-20T21:14:53.107 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-20T21:14:53.176 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-20T21:14:53.196 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-20T21:14:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-04-20T21:14:53.196 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-20T21:14:53.196 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-20T21:14:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-20T21:14:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 6.6 k 2024-04-20T21:14:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T21:14:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 893 k 2024-04-20T21:14:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 145 k 2024-04-20T21:14:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 1.5 M 2024-04-20T21:14:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 142 k 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 3.5 M 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 7.4 M 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 49 k 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 11 M 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 49 M 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 273 k 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 763 k 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 225 k 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 27 k 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 18 k 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 32 k 2024-04-20T21:14:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 748 k 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 126 k 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 162 k 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 321 k 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 299 k 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 99 k 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 85 k 2024-04-20T21:14:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T21:14:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 170 k 2024-04-20T21:14:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-20T21:14:53.199 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-04-20T21:14:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.4 M 2024-04-20T21:14:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T21:14:53.199 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-04-20T21:14:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-20T21:14:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-20T21:14:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-20T21:14:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 21 M 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 34 k 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 2.4 M 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 249 k 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 4.7 M 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 17 M 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 16 k 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 25 k 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-20T21:14:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 163 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 501 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-20T21:14:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 45 k 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 135 k 2024-04-20T21:14:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-20T21:14:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-20T21:14:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-20T21:14:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-20T21:14:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-20T21:14:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-20T21:14:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-20T21:14:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-20T21:14:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-20T21:14:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-20T21:14:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-20T21:14:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-20T21:14:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-20T21:14:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-20T21:14:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-20T21:14:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-20T21:14:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-20T21:14:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout:Installing weak dependencies: 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout:Install 148 Packages 2024-04-20T21:14:53.208 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 2 Packages 2024-04-20T21:14:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:14:53.209 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 218 M 2024-04-20T21:14:53.209 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-20T21:14:53.605 INFO:teuthology.orchestra.run.smithi071.stdout:(6/150): ceph-mgr-19.0.0-3133.ga8c84f59.el9.x86 1.1 MB/s | 1.5 MB 00:01 2024-04-20T21:14:54.458 INFO:teuthology.orchestra.run.smithi137.stdout:(1/150): ceph-19.0.0-3133.ga8c84f59.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-04-20T21:14:55.842 INFO:teuthology.orchestra.run.smithi137.stdout:(2/150): ceph-fuse-19.0.0-3133.ga8c84f59.el9.x8 646 kB/s | 893 kB 00:01 2024-04-20T21:14:56.017 INFO:teuthology.orchestra.run.smithi137.stdout:(3/150): ceph-immutable-object-cache-19.0.0-313 832 kB/s | 145 kB 00:00 2024-04-20T21:14:56.296 INFO:teuthology.orchestra.run.smithi071.stdout:(7/150): ceph-mon-19.0.0-3133.ga8c84f59.el9.x86 1.2 MB/s | 4.7 MB 00:03 2024-04-20T21:14:57.600 INFO:teuthology.orchestra.run.smithi137.stdout:(4/150): ceph-mds-19.0.0-3133.ga8c84f59.el9.x86 1.5 MB/s | 2.4 MB 00:01 2024-04-20T21:14:58.559 INFO:teuthology.orchestra.run.smithi137.stdout:(5/150): ceph-mgr-19.0.0-3133.ga8c84f59.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-04-20T21:15:01.134 INFO:teuthology.orchestra.run.smithi137.stdout:(6/150): ceph-mon-19.0.0-3133.ga8c84f59.el9.x86 1.8 MB/s | 4.7 MB 00:02 2024-04-20T21:15:05.858 INFO:teuthology.orchestra.run.smithi137.stdout:(7/150): ceph-base-19.0.0-3133.ga8c84f59.el9.x8 464 kB/s | 5.4 MB 00:11 2024-04-20T21:15:07.183 INFO:teuthology.orchestra.run.smithi137.stdout:(8/150): ceph-common-19.0.0-3133.ga8c84f59.el9. 1.6 MB/s | 21 MB 00:13 2024-04-20T21:15:07.309 INFO:teuthology.orchestra.run.smithi137.stdout:(9/150): ceph-selinux-19.0.0-3133.ga8c84f59.el9 203 kB/s | 25 kB 00:00 2024-04-20T21:15:07.853 INFO:teuthology.orchestra.run.smithi071.stdout:(8/150): ceph-radosgw-19.0.0-3133.ga8c84f59.el9 939 kB/s | 11 MB 00:11 2024-04-20T21:15:08.104 INFO:teuthology.orchestra.run.smithi071.stdout:(9/150): ceph-common-19.0.0-3133.ga8c84f59.el9. 1.0 MB/s | 21 MB 00:20 2024-04-20T21:15:08.130 INFO:teuthology.orchestra.run.smithi071.stdout:(10/150): ceph-selinux-19.0.0-3133.ga8c84f59.el 92 kB/s | 25 kB 00:00 2024-04-20T21:15:08.571 INFO:teuthology.orchestra.run.smithi071.stdout:(11/150): cephfs-mirror-19.0.0-3133.ga8c84f59.e 509 kB/s | 225 kB 00:00 2024-04-20T21:15:08.688 INFO:teuthology.orchestra.run.smithi071.stdout:(12/150): cephfs-shell-19.0.0-3133.ga8c84f59.el 233 kB/s | 27 kB 00:00 2024-04-20T21:15:08.796 INFO:teuthology.orchestra.run.smithi071.stdout:(13/150): libcephfs-devel-19.0.0-3133.ga8c84f59 294 kB/s | 32 kB 00:00 2024-04-20T21:15:09.946 INFO:teuthology.orchestra.run.smithi071.stdout:(14/150): libcephfs2-19.0.0-3133.ga8c84f59.el9. 651 kB/s | 748 kB 00:01 2024-04-20T21:15:10.230 INFO:teuthology.orchestra.run.smithi071.stdout:(15/150): libcephsqlite-19.0.0-3133.ga8c84f59.e 578 kB/s | 163 kB 00:00 2024-04-20T21:15:10.455 INFO:teuthology.orchestra.run.smithi071.stdout:(16/150): librados-devel-19.0.0-3133.ga8c84f59. 564 kB/s | 126 kB 00:00 2024-04-20T21:15:11.097 INFO:teuthology.orchestra.run.smithi071.stdout:(17/150): ceph-osd-19.0.0-3133.ga8c84f59.el9.x8 985 kB/s | 17 MB 00:17 2024-04-20T21:15:11.297 INFO:teuthology.orchestra.run.smithi071.stdout:(18/150): libradosstriper1-19.0.0-3133.ga8c84f5 595 kB/s | 501 kB 00:00 2024-04-20T21:15:11.423 INFO:teuthology.orchestra.run.smithi071.stdout:(19/150): python3-ceph-argparse-19.0.0-3133.ga8 362 kB/s | 45 kB 00:00 2024-04-20T21:15:11.841 INFO:teuthology.orchestra.run.smithi071.stdout:(20/150): python3-ceph-common-19.0.0-3133.ga8c8 323 kB/s | 135 kB 00:00 2024-04-20T21:15:12.232 INFO:teuthology.orchestra.run.smithi071.stdout:(21/150): python3-cephfs-19.0.0-3133.ga8c84f59. 416 kB/s | 162 kB 00:00 2024-04-20T21:15:12.807 INFO:teuthology.orchestra.run.smithi071.stdout:(22/150): python3-rados-19.0.0-3133.ga8c84f59.e 559 kB/s | 321 kB 00:00 2024-04-20T21:15:13.290 INFO:teuthology.orchestra.run.smithi071.stdout:(23/150): python3-rbd-19.0.0-3133.ga8c84f59.el9 619 kB/s | 299 kB 00:00 2024-04-20T21:15:13.599 INFO:teuthology.orchestra.run.smithi071.stdout:(24/150): python3-rgw-19.0.0-3133.ga8c84f59.el9 324 kB/s | 99 kB 00:00 2024-04-20T21:15:13.891 INFO:teuthology.orchestra.run.smithi071.stdout:(25/150): rbd-fuse-19.0.0-3133.ga8c84f59.el9.x8 293 kB/s | 85 kB 00:00 2024-04-20T21:15:14.958 INFO:teuthology.orchestra.run.smithi137.stdout:(10/150): ceph-osd-19.0.0-3133.ga8c84f59.el9.x8 1.2 MB/s | 17 MB 00:13 2024-04-20T21:15:15.341 INFO:teuthology.orchestra.run.smithi137.stdout:(11/150): cephfs-mirror-19.0.0-3133.ga8c84f59.e 588 kB/s | 225 kB 00:00 2024-04-20T21:15:15.458 INFO:teuthology.orchestra.run.smithi137.stdout:(12/150): cephfs-shell-19.0.0-3133.ga8c84f59.el 233 kB/s | 27 kB 00:00 2024-04-20T21:15:15.600 INFO:teuthology.orchestra.run.smithi137.stdout:(13/150): libcephfs-devel-19.0.0-3133.ga8c84f59 225 kB/s | 32 kB 00:00 2024-04-20T21:15:16.517 INFO:teuthology.orchestra.run.smithi137.stdout:(14/150): libcephfs2-19.0.0-3133.ga8c84f59.el9. 817 kB/s | 748 kB 00:00 2024-04-20T21:15:16.759 INFO:teuthology.orchestra.run.smithi137.stdout:(15/150): libcephsqlite-19.0.0-3133.ga8c84f59.e 678 kB/s | 163 kB 00:00 2024-04-20T21:15:16.943 INFO:teuthology.orchestra.run.smithi137.stdout:(16/150): librados-devel-19.0.0-3133.ga8c84f59. 691 kB/s | 126 kB 00:00 2024-04-20T21:15:17.083 INFO:teuthology.orchestra.run.smithi071.stdout:(26/150): librgw2-19.0.0-3133.ga8c84f59.el9.x86 919 kB/s | 5.4 MB 00:05 2024-04-20T21:15:17.333 INFO:teuthology.orchestra.run.smithi071.stdout:(27/150): rbd-nbd-19.0.0-3133.ga8c84f59.el9.x86 684 kB/s | 170 kB 00:00 2024-04-20T21:15:17.433 INFO:teuthology.orchestra.run.smithi071.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3133.g 344 kB/s | 34 kB 00:00 2024-04-20T21:15:17.668 INFO:teuthology.orchestra.run.smithi137.stdout:(17/150): libradosstriper1-19.0.0-3133.ga8c84f5 691 kB/s | 501 kB 00:00 2024-04-20T21:15:17.692 INFO:teuthology.orchestra.run.smithi071.stdout:(29/150): ceph-mgr-cephadm-19.0.0-3133.ga8c84f5 552 kB/s | 142 kB 00:00 2024-04-20T21:15:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:(30/150): rbd-mirror-19.0.0-3133.ga8c84f59.el9. 420 kB/s | 3.1 MB 00:07 2024-04-20T21:15:21.517 INFO:teuthology.orchestra.run.smithi071.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3133.ga8c84 948 kB/s | 3.5 MB 00:03 2024-04-20T21:15:21.942 INFO:teuthology.orchestra.run.smithi071.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3133.ga8 587 kB/s | 249 kB 00:00 2024-04-20T21:15:22.060 INFO:teuthology.orchestra.run.smithi071.stdout:(33/150): ceph-mgr-rook-19.0.0-3133.ga8c84f59.e 424 kB/s | 49 kB 00:00 2024-04-20T21:15:22.168 INFO:teuthology.orchestra.run.smithi071.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3133.ga 153 kB/s | 16 kB 00:00 2024-04-20T21:15:22.634 INFO:teuthology.orchestra.run.smithi071.stdout:(35/150): ceph-volume-19.0.0-3133.ga8c84f59.el9 586 kB/s | 273 kB 00:00 2024-04-20T21:15:23.801 INFO:teuthology.orchestra.run.smithi071.stdout:(36/150): cephadm-19.0.0-3133.ga8c84f59.el9.noa 654 kB/s | 763 kB 00:01 2024-04-20T21:15:23.910 INFO:teuthology.orchestra.run.smithi071.stdout:(37/150): cephfs-top-19.0.0-3133.ga8c84f59.el9. 170 kB/s | 18 kB 00:00 2024-04-20T21:15:24.027 INFO:teuthology.orchestra.run.smithi071.stdout:(38/150): fuse-2.9.9-15.el9.x86_64.rpm 694 kB/s | 80 kB 00:00 2024-04-20T21:15:24.126 INFO:teuthology.orchestra.run.smithi137.stdout:(18/150): ceph-radosgw-19.0.0-3133.ga8c84f59.el 594 kB/s | 11 MB 00:18 2024-04-20T21:15:24.144 INFO:teuthology.orchestra.run.smithi071.stdout:(39/150): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 803 kB 00:00 2024-04-20T21:15:24.194 INFO:teuthology.orchestra.run.smithi071.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2024-04-20T21:15:24.245 INFO:teuthology.orchestra.run.smithi071.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-20T21:15:24.268 INFO:teuthology.orchestra.run.smithi137.stdout:(19/150): python3-ceph-argparse-19.0.0-3133.ga8 321 kB/s | 45 kB 00:00 2024-04-20T21:15:24.345 INFO:teuthology.orchestra.run.smithi071.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-04-20T21:15:24.387 INFO:teuthology.orchestra.run.smithi071.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-04-20T21:15:24.429 INFO:teuthology.orchestra.run.smithi071.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-04-20T21:15:24.476 INFO:teuthology.orchestra.run.smithi137.stdout:(20/150): python3-ceph-common-19.0.0-3133.ga8c8 650 kB/s | 135 kB 00:00 2024-04-20T21:15:24.479 INFO:teuthology.orchestra.run.smithi071.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 2.5 MB/s | 125 kB 00:00 2024-04-20T21:15:24.546 INFO:teuthology.orchestra.run.smithi071.stdout:(46/150): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-04-20T21:15:24.760 INFO:teuthology.orchestra.run.smithi137.stdout:(21/150): python3-cephfs-19.0.0-3133.ga8c84f59. 573 kB/s | 162 kB 00:00 2024-04-20T21:15:25.368 INFO:teuthology.orchestra.run.smithi137.stdout:(22/150): python3-rados-19.0.0-3133.ga8c84f59.e 528 kB/s | 321 kB 00:00 2024-04-20T21:15:25.986 INFO:teuthology.orchestra.run.smithi137.stdout:(23/150): librgw2-19.0.0-3133.ga8c84f59.el9.x86 661 kB/s | 5.4 MB 00:08 2024-04-20T21:15:26.019 INFO:teuthology.orchestra.run.smithi137.stdout:(24/150): python3-rbd-19.0.0-3133.ga8c84f59.el9 460 kB/s | 299 kB 00:00 2024-04-20T21:15:26.146 INFO:teuthology.orchestra.run.smithi071.stdout:(47/150): automake-1.16.2-8.el9.noarch.rpm 431 kB/s | 689 kB 00:01 2024-04-20T21:15:26.219 INFO:teuthology.orchestra.run.smithi137.stdout:(25/150): rbd-fuse-19.0.0-3133.ga8c84f59.el9.x8 427 kB/s | 85 kB 00:00 2024-04-20T21:15:26.320 INFO:teuthology.orchestra.run.smithi137.stdout:(26/150): python3-rgw-19.0.0-3133.ga8c84f59.el9 299 kB/s | 99 kB 00:00 2024-04-20T21:15:26.961 INFO:teuthology.orchestra.run.smithi137.stdout:(27/150): rbd-nbd-19.0.0-3133.ga8c84f59.el9.x86 266 kB/s | 170 kB 00:00 2024-04-20T21:15:27.162 INFO:teuthology.orchestra.run.smithi137.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3133.g 172 kB/s | 34 kB 00:00 2024-04-20T21:15:27.870 INFO:teuthology.orchestra.run.smithi137.stdout:(29/150): ceph-mgr-cephadm-19.0.0-3133.ga8c84f5 201 kB/s | 142 kB 00:00 2024-04-20T21:15:28.096 INFO:teuthology.orchestra.run.smithi071.stdout:(48/150): bison-3.7.4-5.el9.x86_64.rpm 484 kB/s | 943 kB 00:01 2024-04-20T21:15:28.972 INFO:teuthology.orchestra.run.smithi071.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 122 kB/s | 107 kB 00:00 2024-04-20T21:15:29.664 INFO:teuthology.orchestra.run.smithi071.stdout:(50/150): elfutils-libelf-devel-0.190-2.el9.x86 31 kB/s | 21 kB 00:00 2024-04-20T21:15:30.637 INFO:teuthology.orchestra.run.smithi137.stdout:(30/150): rbd-mirror-19.0.0-3133.ga8c84f59.el9. 716 kB/s | 3.1 MB 00:04 2024-04-20T21:15:30.772 INFO:teuthology.orchestra.run.smithi071.stdout:(51/150): flex-2.6.4-9.el9.x86_64.rpm 283 kB/s | 313 kB 00:01 2024-04-20T21:15:31.431 INFO:teuthology.orchestra.run.smithi071.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 50 kB/s | 33 kB 00:00 2024-04-20T21:15:34.270 INFO:teuthology.orchestra.run.smithi137.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3133.ga8c84 566 kB/s | 3.5 MB 00:06 2024-04-20T21:15:34.670 INFO:teuthology.orchestra.run.smithi137.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3133.ga8 624 kB/s | 249 kB 00:00 2024-04-20T21:15:34.812 INFO:teuthology.orchestra.run.smithi137.stdout:(33/150): ceph-mgr-rook-19.0.0-3133.ga8c84f59.e 349 kB/s | 49 kB 00:00 2024-04-20T21:15:34.937 INFO:teuthology.orchestra.run.smithi137.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3133.ga 132 kB/s | 16 kB 00:00 2024-04-20T21:15:35.354 INFO:teuthology.orchestra.run.smithi137.stdout:(35/150): ceph-volume-19.0.0-3133.ga8c84f59.el9 657 kB/s | 273 kB 00:00 2024-04-20T21:15:35.922 INFO:teuthology.orchestra.run.smithi071.stdout:(53/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 682 kB/s | 3.0 MB 00:04 2024-04-20T21:15:36.246 INFO:teuthology.orchestra.run.smithi137.stdout:(36/150): cephadm-19.0.0-3133.ga8c84f59.el9.noa 856 kB/s | 763 kB 00:00 2024-04-20T21:15:36.363 INFO:teuthology.orchestra.run.smithi137.stdout:(37/150): cephfs-top-19.0.0-3133.ga8c84f59.el9. 158 kB/s | 18 kB 00:00 2024-04-20T21:15:36.472 INFO:teuthology.orchestra.run.smithi137.stdout:(38/150): fuse-2.9.9-15.el9.x86_64.rpm 752 kB/s | 80 kB 00:00 2024-04-20T21:15:36.555 INFO:teuthology.orchestra.run.smithi071.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 29 kB/s | 18 kB 00:00 2024-04-20T21:15:36.597 INFO:teuthology.orchestra.run.smithi137.stdout:(39/150): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-04-20T21:15:36.647 INFO:teuthology.orchestra.run.smithi137.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2024-04-20T21:15:36.706 INFO:teuthology.orchestra.run.smithi137.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-04-20T21:15:36.873 INFO:teuthology.orchestra.run.smithi137.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 7.4 MB/s | 1.2 MB 00:00 2024-04-20T21:15:36.923 INFO:teuthology.orchestra.run.smithi137.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-20T21:15:36.998 INFO:teuthology.orchestra.run.smithi137.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-04-20T21:15:37.049 INFO:teuthology.orchestra.run.smithi137.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 2.5 MB/s | 125 kB 00:00 2024-04-20T21:15:37.099 INFO:teuthology.orchestra.run.smithi137.stdout:(46/150): python3-urllib3-1.26.5-5.el9.noarch.r 4.3 MB/s | 215 kB 00:00 2024-04-20T21:15:37.122 INFO:teuthology.orchestra.run.smithi071.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 20 kB/s | 11 kB 00:00 2024-04-20T21:15:37.282 INFO:teuthology.orchestra.run.smithi137.stdout:(47/150): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-04-20T21:15:37.366 INFO:teuthology.orchestra.run.smithi137.stdout:(48/150): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-04-20T21:15:37.416 INFO:teuthology.orchestra.run.smithi137.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-20T21:15:37.492 INFO:teuthology.orchestra.run.smithi137.stdout:(50/150): elfutils-libelf-devel-0.190-2.el9.x86 289 kB/s | 21 kB 00:00 2024-04-20T21:15:37.550 INFO:teuthology.orchestra.run.smithi137.stdout:(51/150): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-04-20T21:15:37.626 INFO:teuthology.orchestra.run.smithi137.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 439 kB/s | 33 kB 00:00 2024-04-20T21:15:37.751 INFO:teuthology.orchestra.run.smithi137.stdout:(53/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-20T21:15:37.826 INFO:teuthology.orchestra.run.smithi137.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 246 kB/s | 18 kB 00:00 2024-04-20T21:15:37.902 INFO:teuthology.orchestra.run.smithi137.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 150 kB/s | 11 kB 00:00 2024-04-20T21:15:37.952 INFO:teuthology.orchestra.run.smithi137.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 160 kB 00:00 2024-04-20T21:15:37.956 INFO:teuthology.orchestra.run.smithi071.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 192 kB/s | 160 kB 00:00 2024-04-20T21:15:38.119 INFO:teuthology.orchestra.run.smithi137.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 272 kB/s | 45 kB 00:00 2024-04-20T21:15:38.186 INFO:teuthology.orchestra.run.smithi137.stdout:(58/150): librdkafka-1.6.1-102.el9.x86_64.rpm 9.9 MB/s | 662 kB 00:00 2024-04-20T21:15:38.246 INFO:teuthology.orchestra.run.smithi137.stdout:(59/150): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 582 kB 00:00 2024-04-20T21:15:38.312 INFO:teuthology.orchestra.run.smithi137.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 385 kB/s | 25 kB 00:00 2024-04-20T21:15:38.379 INFO:teuthology.orchestra.run.smithi137.stdout:(61/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 719 kB/s | 47 kB 00:00 2024-04-20T21:15:38.429 INFO:teuthology.orchestra.run.smithi137.stdout:(62/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.8 MB/s | 292 kB 00:00 2024-04-20T21:15:38.479 INFO:teuthology.orchestra.run.smithi137.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 3.8 MB/s | 188 kB 00:00 2024-04-20T21:15:38.546 INFO:teuthology.orchestra.run.smithi137.stdout:(64/150): openblas-0.3.21-2.el9.x86_64.rpm 533 kB/s | 35 kB 00:00 2024-04-20T21:15:38.673 INFO:teuthology.orchestra.run.smithi071.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 63 kB/s | 45 kB 00:00 2024-04-20T21:15:38.713 INFO:teuthology.orchestra.run.smithi137.stdout:(65/150): openblas-openmp-0.3.21-2.el9.x86_64.r 29 MB/s | 4.7 MB 00:00 2024-04-20T21:15:38.872 INFO:teuthology.orchestra.run.smithi137.stdout:(66/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 26 MB/s | 4.1 MB 00:00 2024-04-20T21:15:38.964 INFO:teuthology.orchestra.run.smithi137.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-04-20T21:15:39.039 INFO:teuthology.orchestra.run.smithi137.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-04-20T21:15:39.089 INFO:teuthology.orchestra.run.smithi137.stdout:(69/150): postgresql-private-libs-13.14-1.el9.x 2.6 MB/s | 133 kB 00:00 2024-04-20T21:15:39.265 INFO:teuthology.orchestra.run.smithi137.stdout:(70/150): postgresql-server-13.14-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2024-04-20T21:15:39.348 INFO:teuthology.orchestra.run.smithi137.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-04-20T21:15:39.398 INFO:teuthology.orchestra.run.smithi137.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-04-20T21:15:39.574 INFO:teuthology.orchestra.run.smithi137.stdout:(73/150): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-04-20T21:15:39.624 INFO:teuthology.orchestra.run.smithi137.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 4.9 MB/s | 244 kB 00:00 2024-04-20T21:15:39.674 INFO:teuthology.orchestra.run.smithi137.stdout:(75/150): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-20T21:15:39.741 INFO:teuthology.orchestra.run.smithi137.stdout:(76/150): python3-jsonpatch-1.21-16.el9.noarch. 388 kB/s | 26 kB 00:00 2024-04-20T21:15:39.800 INFO:teuthology.orchestra.run.smithi137.stdout:(77/150): python3-jsonpointer-2.0-4.el9.noarch. 333 kB/s | 19 kB 00:00 2024-04-20T21:15:39.867 INFO:teuthology.orchestra.run.smithi137.stdout:(78/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-20T21:15:39.942 INFO:teuthology.orchestra.run.smithi137.stdout:(79/150): python3-markupsafe-1.1.1-12.el9.x86_6 468 kB/s | 35 kB 00:00 2024-04-20T21:15:40.118 INFO:teuthology.orchestra.run.smithi137.stdout:(80/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-04-20T21:15:40.156 INFO:teuthology.orchestra.run.smithi071.stdout:(58/150): librdkafka-1.6.1-102.el9.x86_64.rpm 447 kB/s | 662 kB 00:01 2024-04-20T21:15:40.168 INFO:teuthology.orchestra.run.smithi137.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.0 MB/s | 250 kB 00:00 2024-04-20T21:15:40.227 INFO:teuthology.orchestra.run.smithi137.stdout:(82/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 222 kB 00:00 2024-04-20T21:15:40.302 INFO:teuthology.orchestra.run.smithi137.stdout:(83/150): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-04-20T21:15:40.365 INFO:teuthology.orchestra.run.smithi071.stdout:(59/150): ceph-mgr-diskprediction-local-19.0.0- 400 kB/s | 7.4 MB 00:18 2024-04-20T21:15:40.394 INFO:teuthology.orchestra.run.smithi137.stdout:(84/150): python3-prettytable-0.7.2-27.el9.noar 463 kB/s | 42 kB 00:00 2024-04-20T21:15:40.453 INFO:teuthology.orchestra.run.smithi137.stdout:(85/150): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 269 kB 00:00 2024-04-20T21:15:40.511 INFO:teuthology.orchestra.run.smithi137.stdout:(86/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-04-20T21:15:40.578 INFO:teuthology.orchestra.run.smithi137.stdout:(87/150): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-20T21:15:40.653 INFO:teuthology.orchestra.run.smithi137.stdout:(88/150): python3-pytz-2021.1-5.el9.noarch.rpm 686 kB/s | 51 kB 00:00 2024-04-20T21:15:40.729 INFO:teuthology.orchestra.run.smithi137.stdout:(89/150): python3-requests-oauthlib-1.3.0-12.el 724 kB/s | 54 kB 00:00 2024-04-20T21:15:41.031 INFO:teuthology.orchestra.run.smithi071.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 38 kB/s | 25 kB 00:00 2024-04-20T21:15:41.112 INFO:teuthology.orchestra.run.smithi137.stdout:(90/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-04-20T21:15:41.211 INFO:teuthology.orchestra.run.smithi137.stdout:(91/150): python3-toml-0.10.2-6.el9.noarch.rpm 428 kB/s | 42 kB 00:00 2024-04-20T21:15:41.288 INFO:teuthology.orchestra.run.smithi137.stdout:(92/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 584 kB/s | 44 kB 00:00 2024-04-20T21:15:41.338 INFO:teuthology.orchestra.run.smithi137.stdout:(93/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.4 MB/s | 221 kB 00:00 2024-04-20T21:15:41.414 INFO:teuthology.orchestra.run.smithi137.stdout:(94/150): qatlib-service-24.02.0-1.el9.x86_64.r 482 kB/s | 36 kB 00:00 2024-04-20T21:15:41.489 INFO:teuthology.orchestra.run.smithi137.stdout:(95/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 640 kB/s | 47 kB 00:00 2024-04-20T21:15:41.539 INFO:teuthology.orchestra.run.smithi137.stdout:(96/150): socat-1.7.4.1-5.el9.x86_64.rpm 6.1 MB/s | 305 kB 00:00 2024-04-20T21:15:41.615 INFO:teuthology.orchestra.run.smithi137.stdout:(97/150): uuid-1.6.2-55.el9.x86_64.rpm 777 kB/s | 58 kB 00:00 2024-04-20T21:15:41.665 INFO:teuthology.orchestra.run.smithi137.stdout:(98/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-04-20T21:15:41.740 INFO:teuthology.orchestra.run.smithi137.stdout:(99/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 858 kB/s | 64 kB 00:00 2024-04-20T21:15:41.740 INFO:teuthology.orchestra.run.smithi071.stdout:(61/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 67 kB/s | 47 kB 00:00 2024-04-20T21:15:41.832 INFO:teuthology.orchestra.run.smithi137.stdout:(100/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-04-20T21:15:41.840 INFO:teuthology.orchestra.run.smithi071.stdout:(62/150): libtool-2.4.6-45.el9.x86_64.rpm 346 kB/s | 582 kB 00:01 2024-04-20T21:15:42.124 INFO:teuthology.orchestra.run.smithi137.stdout:(101/150): lua-devel-5.4.4-4.el9.x86_64.rpm 77 kB/s | 22 kB 00:00 2024-04-20T21:15:42.724 INFO:teuthology.orchestra.run.smithi071.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 214 kB/s | 188 kB 00:00 2024-04-20T21:15:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:(102/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.4 MB/s | 863 kB 00:00 2024-04-20T21:15:42.849 INFO:teuthology.orchestra.run.smithi071.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 264 kB/s | 292 kB 00:01 2024-04-20T21:15:43.208 INFO:teuthology.orchestra.run.smithi137.stdout:(103/150): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-04-20T21:15:43.391 INFO:teuthology.orchestra.run.smithi137.stdout:(104/150): gperftools-libs-2.9.1-2.el9.x86_64.r 1.7 MB/s | 309 kB 00:00 2024-04-20T21:15:43.474 INFO:teuthology.orchestra.run.smithi071.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 47 kB/s | 35 kB 00:00 2024-04-20T21:15:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 196 kB/s | 19 kB 00:00 2024-04-20T21:15:44.184 INFO:teuthology.orchestra.run.smithi137.stdout:(106/150): libarrow-9.0.0-10.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-04-20T21:15:44.276 INFO:teuthology.orchestra.run.smithi137.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 287 kB/s | 26 kB 00:00 2024-04-20T21:15:44.401 INFO:teuthology.orchestra.run.smithi137.stdout:(108/150): ceph-mgr-diskprediction-local-19.0.0 551 kB/s | 7.4 MB 00:13 2024-04-20T21:15:44.443 INFO:teuthology.orchestra.run.smithi137.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 292 kB/s | 49 kB 00:00 2024-04-20T21:15:44.468 INFO:teuthology.orchestra.run.smithi137.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-20T21:15:44.560 INFO:teuthology.orchestra.run.smithi137.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-04-20T21:15:44.719 INFO:teuthology.orchestra.run.smithi137.stdout:(112/150): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-04-20T21:15:44.752 INFO:teuthology.orchestra.run.smithi137.stdout:(113/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.9 MB/s | 838 kB 00:00 2024-04-20T21:15:44.861 INFO:teuthology.orchestra.run.smithi137.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 310 kB/s | 43 kB 00:00 2024-04-20T21:15:44.920 INFO:teuthology.orchestra.run.smithi137.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 193 kB/s | 32 kB 00:00 2024-04-20T21:15:44.978 INFO:teuthology.orchestra.run.smithi137.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 129 kB/s | 15 kB 00:00 2024-04-20T21:15:45.037 INFO:teuthology.orchestra.run.smithi137.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-04-20T21:15:45.087 INFO:teuthology.orchestra.run.smithi137.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 3.3 MB/s | 358 kB 00:00 2024-04-20T21:15:45.179 INFO:teuthology.orchestra.run.smithi137.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-04-20T21:15:45.221 INFO:teuthology.orchestra.run.smithi137.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 265 kB/s | 35 kB 00:00 2024-04-20T21:15:45.338 INFO:teuthology.orchestra.run.smithi137.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 1.7 MB/s | 203 kB 00:00 2024-04-20T21:15:45.530 INFO:teuthology.orchestra.run.smithi137.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 762 kB/s | 144 kB 00:00 2024-04-20T21:15:45.647 INFO:teuthology.orchestra.run.smithi137.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 95 kB/s | 11 kB 00:00 2024-04-20T21:15:45.714 INFO:teuthology.orchestra.run.smithi137.stdout:(124/150): python3-grpcio-1.46.7-10.el9.x86_64. 4.1 MB/s | 2.0 MB 00:00 2024-04-20T21:15:45.756 INFO:teuthology.orchestra.run.smithi137.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 166 kB/s | 18 kB 00:00 2024-04-20T21:15:45.814 INFO:teuthology.orchestra.run.smithi137.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 233 kB/s | 23 kB 00:00 2024-04-20T21:15:45.856 INFO:teuthology.orchestra.run.smithi137.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 195 kB/s | 19 kB 00:00 2024-04-20T21:15:45.973 INFO:teuthology.orchestra.run.smithi137.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 125 kB/s | 20 kB 00:00 2024-04-20T21:15:46.115 INFO:teuthology.orchestra.run.smithi137.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 329 kB/s | 46 kB 00:00 2024-04-20T21:15:46.174 INFO:teuthology.orchestra.run.smithi137.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 3.2 MB/s | 1.0 MB 00:00 2024-04-20T21:15:46.241 INFO:teuthology.orchestra.run.smithi137.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 653 kB/s | 79 kB 00:00 2024-04-20T21:15:46.304 INFO:teuthology.orchestra.run.smithi137.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 447 kB/s | 58 kB 00:00 2024-04-20T21:15:46.358 INFO:teuthology.orchestra.run.smithi137.stdout:(133/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-20T21:15:46.400 INFO:teuthology.orchestra.run.smithi137.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 175 kB/s | 16 kB 00:00 2024-04-20T21:15:46.434 INFO:teuthology.orchestra.run.smithi137.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-20T21:15:46.484 INFO:teuthology.orchestra.run.smithi137.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 340 kB/s | 28 kB 00:00 2024-04-20T21:15:46.534 INFO:teuthology.orchestra.run.smithi137.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 308 kB/s | 31 kB 00:00 2024-04-20T21:15:46.568 INFO:teuthology.orchestra.run.smithi137.stdout:(138/150): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-04-20T21:15:46.627 INFO:teuthology.orchestra.run.smithi137.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 650 kB/s | 59 kB 00:00 2024-04-20T21:15:46.677 INFO:teuthology.orchestra.run.smithi137.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 331 kB/s | 36 kB 00:00 2024-04-20T21:15:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:(141/150): python3-typing-extensions-4.4.0-2.el 514 kB/s | 51 kB 00:00 2024-04-20T21:15:46.761 INFO:teuthology.orchestra.run.smithi137.stdout:(142/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-20T21:15:46.803 INFO:teuthology.orchestra.run.smithi137.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-20T21:15:46.920 INFO:teuthology.orchestra.run.smithi137.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 172 kB/s | 20 kB 00:00 2024-04-20T21:15:46.953 INFO:teuthology.orchestra.run.smithi137.stdout:(145/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.2 MB/s | 427 kB 00:00 2024-04-20T21:15:47.095 INFO:teuthology.orchestra.run.smithi137.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-04-20T21:15:47.295 INFO:teuthology.orchestra.run.smithi137.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 4.6 MB/s | 1.6 MB 00:00 2024-04-20T21:15:49.407 INFO:teuthology.orchestra.run.smithi071.stdout:(66/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 713 kB/s | 4.1 MB 00:05 2024-04-20T21:15:49.865 INFO:teuthology.orchestra.run.smithi071.stdout:(67/150): openblas-openmp-0.3.21-2.el9.x86_64.r 692 kB/s | 4.7 MB 00:07 2024-04-20T21:15:51.732 INFO:teuthology.orchestra.run.smithi071.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 489 kB/s | 911 kB 00:01 2024-04-20T21:15:52.282 INFO:teuthology.orchestra.run.smithi071.stdout:(69/150): postgresql-13.14-1.el9.x86_64.rpm 566 kB/s | 1.6 MB 00:02 2024-04-20T21:15:52.607 INFO:teuthology.orchestra.run.smithi071.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 152 kB/s | 133 kB 00:00 2024-04-20T21:15:54.054 INFO:teuthology.orchestra.run.smithi137.stdout:(148/150): librados2-19.0.0-3133.ga8c84f59.el9. 500 kB/s | 3.4 MB 00:06 2024-04-20T21:15:54.516 INFO:teuthology.orchestra.run.smithi071.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 542 kB/s | 1.0 MB 00:01 2024-04-20T21:15:55.274 INFO:teuthology.orchestra.run.smithi071.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 116 kB/s | 87 kB 00:00 2024-04-20T21:15:58.721 INFO:teuthology.orchestra.run.smithi137.stdout:(149/150): librbd1-19.0.0-3133.ga8c84f59.el9.x8 282 kB/s | 3.1 MB 00:11 2024-04-20T21:16:00.399 INFO:teuthology.orchestra.run.smithi071.stdout:(73/150): postgresql-server-13.14-1.el9.x86_64. 729 kB/s | 5.8 MB 00:08 2024-04-20T21:16:01.408 INFO:teuthology.orchestra.run.smithi071.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 243 kB/s | 244 kB 00:01 2024-04-20T21:16:02.366 INFO:teuthology.orchestra.run.smithi071.stdout:(75/150): python3-jinja2-2.11.3-5.el9.noarch.rp 259 kB/s | 248 kB 00:00 2024-04-20T21:16:03.008 INFO:teuthology.orchestra.run.smithi071.stdout:(76/150): python3-jsonpatch-1.21-16.el9.noarch. 40 kB/s | 26 kB 00:00 2024-04-20T21:16:03.641 INFO:teuthology.orchestra.run.smithi071.stdout:(77/150): python3-babel-2.9.1-2.el9.noarch.rpm 730 kB/s | 6.0 MB 00:08 2024-04-20T21:16:03.683 INFO:teuthology.orchestra.run.smithi071.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 28 kB/s | 19 kB 00:00 2024-04-20T21:16:04.434 INFO:teuthology.orchestra.run.smithi071.stdout:(79/150): python3-markupsafe-1.1.1-12.el9.x86_6 46 kB/s | 35 kB 00:00 2024-04-20T21:16:04.634 INFO:teuthology.orchestra.run.smithi071.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 174 kB/s | 172 kB 00:00 2024-04-20T21:16:05.709 INFO:teuthology.orchestra.run.smithi071.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 233 kB/s | 250 kB 00:01 2024-04-20T21:16:06.684 INFO:teuthology.orchestra.run.smithi071.stdout:(82/150): python3-oauthlib-3.1.1-5.el9.noarch.r 228 kB/s | 222 kB 00:00 2024-04-20T21:16:07.442 INFO:teuthology.orchestra.run.smithi071.stdout:(83/150): python3-packaging-20.9-5.el9.noarch.r 102 kB/s | 77 kB 00:00 2024-04-20T21:16:08.143 INFO:teuthology.orchestra.run.smithi071.stdout:(84/150): python3-prettytable-0.7.2-27.el9.noar 60 kB/s | 42 kB 00:00 2024-04-20T21:16:09.134 INFO:teuthology.orchestra.run.smithi071.stdout:(85/150): python3-protobuf-3.14.0-13.el9.noarch 272 kB/s | 269 kB 00:00 2024-04-20T21:16:10.051 INFO:teuthology.orchestra.run.smithi071.stdout:(86/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 173 kB/s | 159 kB 00:00 2024-04-20T21:16:11.160 INFO:teuthology.orchestra.run.smithi071.stdout:(87/150): python3-pyasn1-modules-0.4.8-6.el9.no 252 kB/s | 279 kB 00:01 2024-04-20T21:16:11.760 INFO:teuthology.orchestra.run.smithi071.stdout:(88/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 713 kB/s | 5.1 MB 00:07 2024-04-20T21:16:11.935 INFO:teuthology.orchestra.run.smithi071.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 66 kB/s | 51 kB 00:00 2024-04-20T21:16:12.544 INFO:teuthology.orchestra.run.smithi071.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 69 kB/s | 54 kB 00:00 2024-04-20T21:16:13.286 INFO:teuthology.orchestra.run.smithi071.stdout:(91/150): python3-toml-0.10.2-6.el9.noarch.rpm 56 kB/s | 42 kB 00:00 2024-04-20T21:16:13.978 INFO:teuthology.orchestra.run.smithi071.stdout:(92/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 64 kB/s | 44 kB 00:00 2024-04-20T21:16:14.953 INFO:teuthology.orchestra.run.smithi071.stdout:(93/150): qatlib-24.02.0-1.el9.x86_64.rpm 227 kB/s | 221 kB 00:00 2024-04-20T21:16:15.670 INFO:teuthology.orchestra.run.smithi071.stdout:(94/150): qatlib-service-24.02.0-1.el9.x86_64.r 50 kB/s | 36 kB 00:00 2024-04-20T21:16:16.420 INFO:teuthology.orchestra.run.smithi071.stdout:(95/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 63 kB/s | 47 kB 00:00 2024-04-20T21:16:17.520 INFO:teuthology.orchestra.run.smithi071.stdout:(96/150): socat-1.7.4.1-5.el9.x86_64.rpm 277 kB/s | 305 kB 00:01 2024-04-20T21:16:18.253 INFO:teuthology.orchestra.run.smithi071.stdout:(97/150): uuid-1.6.2-55.el9.x86_64.rpm 79 kB/s | 58 kB 00:00 2024-04-20T21:16:19.045 INFO:teuthology.orchestra.run.smithi071.stdout:(98/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 119 kB/s | 94 kB 00:00 2024-04-20T21:16:19.762 INFO:teuthology.orchestra.run.smithi071.stdout:(99/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 89 kB/s | 64 kB 00:00 2024-04-20T21:16:20.454 INFO:teuthology.orchestra.run.smithi071.stdout:(100/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 65 kB/s | 45 kB 00:00 2024-04-20T21:16:20.546 INFO:teuthology.orchestra.run.smithi071.stdout:(101/150): lua-devel-5.4.4-4.el9.x86_64.rpm 247 kB/s | 22 kB 00:00 2024-04-20T21:16:20.846 INFO:teuthology.orchestra.run.smithi071.stdout:(102/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-04-20T21:16:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:(103/150): abseil-cpp-20211102.0-3.el9.x86_64.r 915 kB/s | 548 kB 00:00 2024-04-20T21:16:22.038 INFO:teuthology.orchestra.run.smithi071.stdout:(104/150): gperftools-libs-2.9.1-2.el9.x86_64.r 523 kB/s | 309 kB 00:00 2024-04-20T21:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-04-20T21:16:23.322 INFO:teuthology.orchestra.run.smithi071.stdout:(106/150): libarrow-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2024-04-20T21:16:23.589 INFO:teuthology.orchestra.run.smithi071.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 98 kB/s | 26 kB 00:00 2024-04-20T21:16:23.939 INFO:teuthology.orchestra.run.smithi071.stdout:(108/150): liboath-2.6.7-2.el9.x86_64.rpm 139 kB/s | 49 kB 00:00 2024-04-20T21:16:24.290 INFO:teuthology.orchestra.run.smithi071.stdout:(109/150): libunwind-1.6.2-1.el9.x86_64.rpm 193 kB/s | 67 kB 00:00 2024-04-20T21:16:24.723 INFO:teuthology.orchestra.run.smithi071.stdout:(110/150): luarocks-3.9.2-1.el9.noarch.rpm 349 kB/s | 151 kB 00:00 2024-04-20T21:16:25.407 INFO:teuthology.orchestra.run.smithi071.stdout:(111/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-20T21:16:26.024 INFO:teuthology.orchestra.run.smithi071.stdout:(112/150): python3-asyncssh-2.13.2-5.el9.noarch 890 kB/s | 548 kB 00:00 2024-04-20T21:16:26.382 INFO:teuthology.orchestra.run.smithi071.stdout:(113/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 122 kB/s | 43 kB 00:00 2024-04-20T21:16:26.649 INFO:teuthology.orchestra.run.smithi071.stdout:(114/150): python3-cachetools-4.2.4-1.el9.noarc 121 kB/s | 32 kB 00:00 2024-04-20T21:16:26.916 INFO:teuthology.orchestra.run.smithi071.stdout:(115/150): python3-certifi-2021.10.8-2.el9.noar 56 kB/s | 15 kB 00:00 2024-04-20T21:16:27.350 INFO:teuthology.orchestra.run.smithi071.stdout:(116/150): python3-cheroot-8.6.0-4.el9.noarch.r 397 kB/s | 172 kB 00:00 2024-04-20T21:16:27.950 INFO:teuthology.orchestra.run.smithi071.stdout:(117/150): python3-cherrypy-18.6.1-2.el9.noarch 598 kB/s | 358 kB 00:00 2024-04-20T21:16:28.475 INFO:teuthology.orchestra.run.smithi071.stdout:(118/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 578 kB/s | 303 kB 00:00 2024-04-20T21:16:28.742 INFO:teuthology.orchestra.run.smithi071.stdout:(119/150): python3-colorama-0.4.4-12.el9.noarch 133 kB/s | 35 kB 00:00 2024-04-20T21:16:29.251 INFO:teuthology.orchestra.run.smithi071.stdout:(120/150): python3-google-auth-2.28.2-1.el9.noa 399 kB/s | 203 kB 00:00 2024-04-20T21:16:30.051 INFO:teuthology.orchestra.run.smithi071.stdout:(121/150): python3-grpcio-1.46.7-10.el9.x86_64. 2.5 MB/s | 2.0 MB 00:00 2024-04-20T21:16:30.476 INFO:teuthology.orchestra.run.smithi071.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 342 kB/s | 144 kB 00:00 2024-04-20T21:16:30.660 INFO:teuthology.orchestra.run.smithi071.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 59 kB/s | 11 kB 00:00 2024-04-20T21:16:30.927 INFO:teuthology.orchestra.run.smithi071.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 66 kB/s | 18 kB 00:00 2024-04-20T21:16:31.202 INFO:teuthology.orchestra.run.smithi071.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 84 kB/s | 23 kB 00:00 2024-04-20T21:16:31.527 INFO:teuthology.orchestra.run.smithi071.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 60 kB/s | 19 kB 00:00 2024-04-20T21:16:31.795 INFO:teuthology.orchestra.run.smithi071.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-04-20T21:16:32.561 INFO:teuthology.orchestra.run.smithi071.stdout:(128/150): python3-kubernetes-26.1.0-2.el9.noar 1.3 MB/s | 1.0 MB 00:00 2024-04-20T21:16:32.912 INFO:teuthology.orchestra.run.smithi071.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 132 kB/s | 46 kB 00:00 2024-04-20T21:16:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 220 kB/s | 79 kB 00:00 2024-04-20T21:16:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:(131/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 772 kB/s | 16 MB 00:21 2024-04-20T21:16:33.779 INFO:teuthology.orchestra.run.smithi071.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 114 kB/s | 58 kB 00:00 2024-04-20T21:16:34.038 INFO:teuthology.orchestra.run.smithi071.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 64 kB/s | 16 kB 00:00 2024-04-20T21:16:34.105 INFO:teuthology.orchestra.run.smithi071.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 455 kB/s | 272 kB 00:00 2024-04-20T21:16:34.372 INFO:teuthology.orchestra.run.smithi071.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 106 kB/s | 28 kB 00:00 2024-04-20T21:16:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 251 kB/s | 90 kB 00:00 2024-04-20T21:16:34.639 INFO:teuthology.orchestra.run.smithi071.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 116 kB/s | 31 kB 00:00 2024-04-20T21:16:34.906 INFO:teuthology.orchestra.run.smithi071.stdout:(138/150): python3-routes-2.5.1-5.el9.noarch.rp 371 kB/s | 188 kB 00:00 2024-04-20T21:16:34.990 INFO:teuthology.orchestra.run.smithi071.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 169 kB/s | 59 kB 00:00 2024-04-20T21:16:35.181 INFO:teuthology.orchestra.run.smithi071.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 130 kB/s | 36 kB 00:00 2024-04-20T21:16:35.349 INFO:teuthology.orchestra.run.smithi071.stdout:(141/150): python3-typing-extensions-4.4.0-2.el 142 kB/s | 51 kB 00:00 2024-04-20T21:16:35.690 INFO:teuthology.orchestra.run.smithi071.stdout:(142/150): python3-webob-1.8.7-6.el9.noarch.rpm 452 kB/s | 230 kB 00:00 2024-04-20T21:16:35.774 INFO:teuthology.orchestra.run.smithi071.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 211 kB/s | 90 kB 00:00 2024-04-20T21:16:36.058 INFO:teuthology.orchestra.run.smithi071.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 71 kB/s | 20 kB 00:00 2024-04-20T21:16:36.283 INFO:teuthology.orchestra.run.smithi071.stdout:(145/150): python3-werkzeug-2.0.3-3.el9.1.noarc 722 kB/s | 427 kB 00:00 2024-04-20T21:16:36.492 INFO:teuthology.orchestra.run.smithi071.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 443 kB/s | 192 kB 00:00 2024-04-20T21:16:37.141 INFO:teuthology.orchestra.run.smithi071.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 1.8 MB/s | 1.6 MB 00:00 2024-04-20T21:16:41.555 INFO:teuthology.orchestra.run.smithi137.stdout:(150/150): ceph-test-19.0.0-3133.ga8c84f59.el9. 534 kB/s | 49 MB 01:34 2024-04-20T21:16:41.563 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:16:41.563 INFO:teuthology.orchestra.run.smithi137.stdout:Total 2.0 MB/s | 218 MB 01:48 2024-04-20T21:16:44.329 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-20T21:16:44.540 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-20T21:16:44.540 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-20T21:16:44.732 INFO:teuthology.orchestra.run.smithi071.stdout:(148/150): librados2-19.0.0-3133.ga8c84f59.el9. 422 kB/s | 3.4 MB 00:08 2024-04-20T21:16:46.916 INFO:teuthology.orchestra.run.smithi071.stdout:(149/150): librbd1-19.0.0-3133.ga8c84f59.el9.x8 329 kB/s | 3.1 MB 00:09 2024-04-20T21:16:46.996 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-20T21:16:46.997 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-20T21:16:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-20T21:16:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-20T21:16:53.234 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-20T21:16:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-20T21:16:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-20T21:16:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T21:16:54.125 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T21:16:54.159 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T21:16:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T21:16:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T21:16:54.450 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-20T21:16:54.487 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-20T21:16:54.883 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-20T21:16:54.949 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-20T21:16:54.981 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T21:16:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T21:16:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T21:16:55.328 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T21:16:55.367 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T21:16:55.465 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T21:16:55.991 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T21:16:56.042 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T21:16:56.239 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-20T21:16:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-20T21:16:56.409 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-20T21:16:56.457 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-20T21:16:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-20T21:16:56.605 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-20T21:16:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-20T21:16:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-20T21:16:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-20T21:16:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-20T21:16:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-20T21:16:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-20T21:16:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-20T21:16:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-20T21:16:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 30/152 2024-04-20T21:16:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 31/152 2024-04-20T21:16:57.328 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 32/152 2024-04-20T21:16:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-20T21:16:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-20T21:16:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-20T21:16:57.799 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-20T21:16:57.869 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-20T21:16:58.581 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-20T21:16:58.691 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-20T21:16:58.726 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-20T21:16:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-20T21:16:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 42/152 2024-04-20T21:16:58.853 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-20T21:16:58.937 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-20T21:16:59.041 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-20T21:16:59.084 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-20T21:16:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-20T21:16:59.200 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-20T21:16:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-20T21:16:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-20T21:16:59.379 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-20T21:16:59.585 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-20T21:16:59.646 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-20T21:16:59.685 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-20T21:16:59.741 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-20T21:16:59.871 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-20T21:16:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-20T21:16:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-20T21:17:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-20T21:17:00.041 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-20T21:17:00.249 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-20T21:17:00.429 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-20T21:17:00.472 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-20T21:17:00.533 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-20T21:17:00.591 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-20T21:17:00.671 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-20T21:17:00.734 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-20T21:17:00.793 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-20T21:17:00.834 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-20T21:17:00.881 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-20T21:17:00.933 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-20T21:17:01.004 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-20T21:17:01.044 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-20T21:17:01.186 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-20T21:17:01.244 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-20T21:17:01.288 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-20T21:17:01.358 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-20T21:17:01.506 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-20T21:17:01.576 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-20T21:17:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-20T21:17:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-20T21:17:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-20T21:17:02.681 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-20T21:17:02.745 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-20T21:17:02.860 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-20T21:17:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-20T21:17:03.131 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-20T21:17:03.165 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-20T21:17:03.281 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-20T21:17:04.122 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-20T21:17:04.256 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-20T21:17:05.853 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-20T21:17:05.955 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-20T21:17:05.989 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-20T21:17:06.026 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-20T21:17:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-20T21:17:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T21:17:06.604 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T21:17:06.641 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 98/152 2024-04-20T21:17:06.699 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-20T21:17:07.242 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-20T21:17:07.279 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T21:17:07.412 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T21:17:07.439 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 102/152 2024-04-20T21:17:09.220 INFO:teuthology.orchestra.run.smithi071.stdout:(150/150): ceph-test-19.0.0-3133.ga8c84f59.el9. 415 kB/s | 49 MB 02:01 2024-04-20T21:17:09.225 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:17:09.225 INFO:teuthology.orchestra.run.smithi071.stdout:Total 1.5 MB/s | 218 MB 02:22 2024-04-20T21:17:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T21:17:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T21:17:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T21:17:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T21:17:11.434 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T21:17:11.434 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-20T21:17:11.434 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-20T21:17:11.434 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:11.473 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T21:17:11.977 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-04-20T21:17:12.193 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-04-20T21:17:12.194 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-04-20T21:17:14.869 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-04-20T21:17:14.869 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-04-20T21:17:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-04-20T21:17:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-20T21:17:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-20T21:17:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-20T21:17:21.619 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-20T21:17:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T21:17:21.889 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T21:17:21.958 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T21:17:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T21:17:22.199 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T21:17:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-20T21:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-20T21:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-20T21:17:22.704 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-20T21:17:22.729 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T21:17:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T21:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T21:17:23.085 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T21:17:23.115 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T21:17:23.178 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T21:17:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T21:17:23.825 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T21:17:24.021 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-20T21:17:24.157 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-20T21:17:24.201 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-20T21:17:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-20T21:17:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-20T21:17:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-20T21:17:24.429 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T21:17:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-04-20T21:17:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-04-20T21:17:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-04-20T21:17:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-04-20T21:17:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-04-20T21:17:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /root 2024-04-20T21:17:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-04-20T21:17:24.429 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-20T21:17:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-20T21:17:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-20T21:17:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-20T21:17:24.661 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T21:17:24.708 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T21:17:24.709 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:24.709 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-20T21:17:24.709 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-20T21:17:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-20T21:17:24.824 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-20T21:17:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-20T21:17:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 30/152 2024-04-20T21:17:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 31/152 2024-04-20T21:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 32/152 2024-04-20T21:17:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-20T21:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-20T21:17:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-20T21:17:25.512 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-20T21:17:25.586 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-20T21:17:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-20T21:17:26.338 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T21:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-20T21:17:26.416 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T21:17:26.416 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:26.416 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-20T21:17:26.416 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T21:17:26.416 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T21:17:26.417 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-20T21:17:26.473 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-20T21:17:26.515 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 42/152 2024-04-20T21:17:26.557 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-20T21:17:26.638 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-20T21:17:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T21:17:26.724 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T21:17:26.724 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:26.725 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-20T21:17:26.725 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T21:17:26.725 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T21:17:26.725 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:26.742 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-20T21:17:26.778 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-20T21:17:26.817 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-20T21:17:26.883 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-20T21:17:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-20T21:17:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-20T21:17:27.044 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-20T21:17:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T21:17:27.243 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-20T21:17:27.273 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T21:17:27.273 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:27.273 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-20T21:17:27.273 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T21:17:27.273 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T21:17:27.274 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:27.321 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-20T21:17:27.361 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-20T21:17:27.397 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-20T21:17:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-20T21:17:27.457 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-20T21:17:27.532 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-20T21:17:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-20T21:17:27.603 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-20T21:17:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-20T21:17:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-20T21:17:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-20T21:17:27.764 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-20T21:17:27.826 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-20T21:17:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-20T21:17:27.921 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-20T21:17:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-20T21:17:28.098 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-20T21:17:28.144 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-20T21:17:28.193 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-20T21:17:28.213 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-20T21:17:28.242 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-20T21:17:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-20T21:17:28.283 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-20T21:17:28.316 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-20T21:17:28.351 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-20T21:17:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-20T21:17:28.475 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-20T21:17:28.523 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-20T21:17:28.570 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-20T21:17:28.618 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-20T21:17:28.694 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-20T21:17:28.742 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-20T21:17:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-20T21:17:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-20T21:17:28.983 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-20T21:17:29.060 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-20T21:17:29.077 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T21:17:29.120 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T21:17:29.175 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 122/152 2024-04-20T21:17:29.238 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-20T21:17:29.284 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 123/152 2024-04-20T21:17:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-20T21:17:29.321 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T21:17:30.207 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-20T21:17:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-20T21:17:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-20T21:17:30.453 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-20T21:17:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-20T21:17:30.631 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T21:17:30.653 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-20T21:17:30.673 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T21:17:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-20T21:17:30.932 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-20T21:17:30.962 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-20T21:17:31.067 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-20T21:17:31.778 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T21:17:31.815 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T21:17:31.901 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-20T21:17:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T21:17:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-20T21:17:32.142 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 127/152 2024-04-20T21:17:32.175 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T21:17:32.246 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T21:17:32.246 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:32.246 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-20T21:17:32.246 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T21:17:32.246 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T21:17:32.246 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:32.301 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T21:17:32.338 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T21:17:32.480 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/152 2024-04-20T21:17:32.544 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 131/152 2024-04-20T21:17:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-20T21:17:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T21:17:33.645 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-20T21:17:33.665 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T21:17:33.666 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:33.666 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-20T21:17:33.666 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T21:17:33.666 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T21:17:33.666 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:33.712 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T21:17:33.737 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-20T21:17:33.778 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-20T21:17:33.780 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T21:17:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:33.780 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-20T21:17:33.780 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:33.821 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-20T21:17:33.846 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T21:17:33.920 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T21:17:33.920 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:33.920 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-20T21:17:33.920 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T21:17:33.920 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T21:17:33.920 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:34.196 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-20T21:17:34.234 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T21:17:34.280 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T21:17:34.355 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T21:17:34.356 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T21:17:34.356 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:34.356 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-20T21:17:34.356 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T21:17:34.356 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T21:17:34.356 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:34.391 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 98/152 2024-04-20T21:17:34.449 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-20T21:17:35.013 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-20T21:17:35.045 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T21:17:35.121 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T21:17:35.147 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 102/152 2024-04-20T21:17:37.906 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T21:17:37.953 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T21:17:38.588 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T21:17:38.631 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T21:17:38.839 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T21:17:38.839 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-20T21:17:38.839 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-20T21:17:38.839 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:17:38.883 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T21:17:39.407 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 137/152 2024-04-20T21:17:39.463 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 138/152 2024-04-20T21:17:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 139/152 2024-04-20T21:17:39.621 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-20T21:17:39.667 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-20T21:17:39.986 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 142/152 2024-04-20T21:17:40.043 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-20T21:17:40.071 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 144/152 2024-04-20T21:17:41.102 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T21:17:41.152 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T21:17:41.207 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T21:17:42.421 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 146/152 2024-04-20T21:17:42.542 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-20T21:17:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-20T21:17:42.817 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-20T21:17:42.857 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-20T21:17:42.857 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T21:17:43.013 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T21:17:43.013 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T21:17:43.576 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T21:17:43.576 INFO:teuthology.orchestra.run.smithi137.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-20T21:17:43.576 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 1/152 2024-04-20T21:17:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2/152 2024-04-20T21:17:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 3/152 2024-04-20T21:17:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 4/152 2024-04-20T21:17:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 5/152 2024-04-20T21:17:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T21:17:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T21:17:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 8/152 2024-04-20T21:17:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 9/152 2024-04-20T21:17:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/152 2024-04-20T21:17:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 13/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 14/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 15/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 17/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 18/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 19/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 20/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 21/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 22/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 23/152 2024-04-20T21:17:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 24/152 2024-04-20T21:17:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 25/152 2024-04-20T21:17:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 26/152 2024-04-20T21:17:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 27/152 2024-04-20T21:17:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 28/152 2024-04-20T21:17:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 29/152 2024-04-20T21:17:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 30/152 2024-04-20T21:17:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 31/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 32/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 33/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 34/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 35/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 36/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 37/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 38/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 39/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-20T21:17:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-20T21:17:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-20T21:17:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-20T21:17:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-20T21:17:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-20T21:17:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-20T21:17:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-20T21:17:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-20T21:17:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-20T21:17:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-20T21:17:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 149/152 2024-04-20T21:17:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-20T21:17:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/152 2024-04-20T21:17:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T21:17:51.338 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-04-20T21:17:51.338 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-04-20T21:17:51.338 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-04-20T21:17:51.338 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-04-20T21:17:51.338 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-04-20T21:17:51.338 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-04-20T21:17:51.339 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-04-20T21:17:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:17:51.585 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T21:17:51.630 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T21:17:51.631 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:51.631 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-20T21:17:51.631 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:17:51.837 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T21:17:51.837 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:51.837 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-04-20T21:17:51.837 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.837 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.837 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: automake-1.16.2-8.el9.noarch 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: bison-3.7.4-5.el9.x86_64 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:17:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:17:51.839 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: flex-2.6.4-9.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-20T21:17:51.840 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: lua-5.4.4-4.el9.x86_64 2024-04-20T21:17:51.841 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-13.14-1.el9.x86_64 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-20T21:17:51.842 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-20T21:17:51.843 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-20T21:17:51.844 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply-3.11-14.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-20T21:17:51.845 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-20T21:17:51.846 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: re2-1:20211101-3.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-20T21:17:51.847 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-20T21:17:51.848 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:17:51.848 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-20T21:17:52.464 DEBUG:teuthology.parallel:result is None 2024-04-20T21:17:53.244 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T21:17:53.329 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T21:17:53.330 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:53.330 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-20T21:17:53.330 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T21:17:53.330 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T21:17:53.330 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:17:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T21:17:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T21:17:53.670 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:53.670 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-20T21:17:53.670 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T21:17:53.670 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T21:17:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:17:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T21:17:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T21:17:54.249 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:54.249 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-20T21:17:54.249 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T21:17:54.249 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T21:17:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:17:54.405 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-20T21:17:54.474 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-20T21:17:54.562 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-20T21:17:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-20T21:17:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-20T21:17:54.964 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-20T21:17:55.068 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-20T21:17:55.232 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-20T21:17:55.275 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-20T21:17:55.323 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-20T21:17:55.349 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-20T21:17:55.988 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T21:17:56.029 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T21:17:56.082 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 122/152 2024-04-20T21:17:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 123/152 2024-04-20T21:17:56.229 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T21:17:57.524 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T21:17:57.565 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T21:17:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T21:17:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T21:17:58.836 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T21:17:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 127/152 2024-04-20T21:17:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T21:17:59.117 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T21:17:59.118 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:17:59.118 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-20T21:17:59.118 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T21:17:59.118 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T21:17:59.118 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:17:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T21:17:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T21:17:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/152 2024-04-20T21:17:59.389 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 131/152 2024-04-20T21:18:00.396 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-20T21:18:00.458 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T21:18:00.527 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T21:18:00.527 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:18:00.527 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-20T21:18:00.527 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T21:18:00.527 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T21:18:00.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:00.580 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T21:18:00.651 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T21:18:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:18:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-20T21:18:00.652 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:00.722 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T21:18:00.795 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T21:18:00.795 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:18:00.795 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-20T21:18:00.795 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T21:18:00.795 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T21:18:00.795 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T21:18:01.217 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T21:18:01.217 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:18:01.217 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-20T21:18:01.217 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T21:18:01.217 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T21:18:01.217 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:06.196 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 137/152 2024-04-20T21:18:06.249 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 138/152 2024-04-20T21:18:06.321 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 139/152 2024-04-20T21:18:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-20T21:18:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-20T21:18:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 142/152 2024-04-20T21:18:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-20T21:18:06.761 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 144/152 2024-04-20T21:18:07.965 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T21:18:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T21:18:08.075 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T21:18:09.344 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 146/152 2024-04-20T21:18:09.476 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-20T21:18:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-20T21:18:09.757 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-20T21:18:09.801 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-20T21:18:09.801 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T21:18:09.917 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T21:18:09.917 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T21:18:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T21:18:10.478 INFO:teuthology.orchestra.run.smithi071.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-20T21:18:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 1/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 3/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 4/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 5/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 8/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 9/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T21:18:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 13/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 14/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 15/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 17/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 18/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 19/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 20/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 21/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 22/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 23/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 24/152 2024-04-20T21:18:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 25/152 2024-04-20T21:18:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 26/152 2024-04-20T21:18:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 27/152 2024-04-20T21:18:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 28/152 2024-04-20T21:18:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 29/152 2024-04-20T21:18:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 30/152 2024-04-20T21:18:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 31/152 2024-04-20T21:18:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 32/152 2024-04-20T21:18:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 33/152 2024-04-20T21:18:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 34/152 2024-04-20T21:18:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 35/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 36/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 37/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 38/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 39/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-20T21:18:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-20T21:18:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-20T21:18:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-20T21:18:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-20T21:18:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-20T21:18:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-20T21:18:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 149/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-20T21:18:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/152 2024-04-20T21:18:18.625 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T21:18:18.625 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:18.625 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-04-20T21:18:18.625 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.2-8.el9.noarch 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.7.4-5.el9.x86_64 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.626 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:18:18.627 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.4-9.el9.x86_64 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-20T21:18:18.628 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-20T21:18:18.629 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: lua-5.4.4-4.el9.x86_64 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-13.14-1.el9.x86_64 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-20T21:18:18.630 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-20T21:18:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-20T21:18:18.632 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-20T21:18:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-20T21:18:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-20T21:18:18.635 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.636 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.636 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T21:18:18.636 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-3.el9.x86_64 2024-04-20T21:18:18.636 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-20T21:18:18.636 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-20T21:18:18.636 INFO:teuthology.orchestra.run.smithi071.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-20T21:18:18.636 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-20T21:18:18.636 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-20T21:18:18.636 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-20T21:18:18.636 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:18.636 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-04-20T21:18:19.208 DEBUG:teuthology.parallel:result is None 2024-04-20T21:18:19.208 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:18:19.551 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-20T21:18:19.606 INFO:teuthology.orchestra.run.smithi071.stdout:19.0.0-3133.ga8c84f59.el9 2024-04-20T21:18:19.607 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133.ga8c84f59.el9 2024-04-20T21:18:19.607 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133.ga8c84f59 is installed. 2024-04-20T21:18:19.609 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:18:19.752 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-20T21:18:19.819 INFO:teuthology.orchestra.run.smithi137.stdout:19.0.0-3133.ga8c84f59.el9 2024-04-20T21:18:19.819 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133.ga8c84f59.el9 2024-04-20T21:18:19.819 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133.ga8c84f59 is installed. 2024-04-20T21:18:19.821 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-20T21:18:19.821 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:19.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-20T21:18:19.893 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:18:19.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-20T21:18:19.984 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-20T21:18:19.984 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:19.984 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-04-20T21:18:20.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-20T21:18:20.155 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:18:20.155 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-04-20T21:18:20.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-20T21:18:20.330 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-20T21:18:20.330 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:20.330 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-20T21:18:20.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-20T21:18:20.505 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:18:20.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-20T21:18:20.586 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-20T21:18:20.712 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-20T21:18:20.713 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:20.713 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-04-20T21:18:20.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-20T21:18:20.886 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:18:20.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-04-20T21:18:20.974 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-20T21:18:21.053 INFO:teuthology.run_tasks:Running task ceph... 2024-04-20T21:18:21.136 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-20T21:18:21.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2024-04-20T21:18:21.144 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-04-20T21:18:21.231 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-20T21:18:21.231 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-20T21:18:21.236 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-20T21:18:21.322 INFO:tasks.ceph:Creating extra log directories... 2024-04-20T21:18:21.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-20T21:18:21.327 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-20T21:18:21.416 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-20T21:18:21.416 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-20T21:18:21.416 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-20T21:18:21.416 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:21.416 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-20T21:18:21.465 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-20T21:18:21.661 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-20T21:18:21.731 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:18:21.731 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-20T21:18:21.786 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-20T21:18:22.002 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-20T21:18:22.091 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-20T21:18:22.092 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-20T21:18:22.092 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665373', 'branch': 'wip-rishabh-testing-20240416.193735', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7665373', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240416.193735'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240416.193735', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7954, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'sleep_before_teardown': 0, 'subset': '364/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240416.193735', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEhUkEvue3v9oerQXcwSs3xW5MKtXD47xNG2+pYE7EfMoVbArBA3sqwFXq5Q00+YFigMcvmIU7AlPM9tJxiixEc=', 'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO1Egv43Nsuc1fqpg2HR8WN8dljTq/deQ/IqL9RvWhVvAXm8EXiupX41dWcnnaYkjBYzDSPcZ7kYNX3xDvOOSDk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-20_20:50:37', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-20T21:18:22.092 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-20T21:18:22.097 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-20T21:18:22.148 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2024-04-20T21:18:22.182 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-04-20T21:18:22.271 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:22.271 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-04-20T21:18:22.312 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-20T21:18:22.312 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-04-20T21:18:22.393 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-20T21:18:22.394 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:18:22.394 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-04-20T21:18:22.394 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:18:22.394 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:18:22.394 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-20 21:18:10.954398776 +0000 2024-04-20T21:18:22.394 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-20 21:13:50.636185492 +0000 2024-04-20T21:18:22.394 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-20 21:13:50.636185492 +0000 2024-04-20T21:18:22.394 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-04-20 21:13:50.636185492 +0000 2024-04-20T21:18:22.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-20T21:18:22.491 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-20T21:18:22.491 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-20T21:18:22.492 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000352097 s, 1.5 MB/s 2024-04-20T21:18:22.494 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-20T21:18:22.535 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-04-20T21:18:22.617 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-20T21:18:22.618 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:18:22.618 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-04-20T21:18:22.618 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:18:22.618 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:18:22.618 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-20 21:18:10.956398741 +0000 2024-04-20T21:18:22.618 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-20 21:13:51.404171757 +0000 2024-04-20T21:18:22.618 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-20 21:13:51.404171757 +0000 2024-04-20T21:18:22.619 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-04-20 21:13:51.404171757 +0000 2024-04-20T21:18:22.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-20T21:18:22.718 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-20T21:18:22.718 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-20T21:18:22.718 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000280876 s, 1.8 MB/s 2024-04-20T21:18:22.721 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-20T21:18:22.760 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-04-20T21:18:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-20T21:18:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:18:22.838 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-04-20T21:18:22.838 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:18:22.838 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:18:22.838 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-20 21:18:10.956398741 +0000 2024-04-20T21:18:22.838 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-20 21:13:51.984161383 +0000 2024-04-20T21:18:22.839 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-20 21:13:51.984161383 +0000 2024-04-20T21:18:22.839 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-04-20 21:13:51.984161383 +0000 2024-04-20T21:18:22.839 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-20T21:18:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-20T21:18:22.937 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-20T21:18:22.937 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000301402 s, 1.7 MB/s 2024-04-20T21:18:22.939 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-20T21:18:22.980 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-04-20T21:18:23.062 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-20T21:18:23.062 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:18:23.063 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-04-20T21:18:23.063 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:18:23.063 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:18:23.063 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-20 21:18:10.957398724 +0000 2024-04-20T21:18:23.063 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-20 21:13:52.637149705 +0000 2024-04-20T21:18:23.063 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-20 21:13:52.637149705 +0000 2024-04-20T21:18:23.063 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-04-20 21:13:52.637149705 +0000 2024-04-20T21:18:23.063 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-20T21:18:23.162 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-20T21:18:23.163 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-20T21:18:23.163 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000300226 s, 1.7 MB/s 2024-04-20T21:18:23.165 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-20T21:18:23.204 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-20T21:18:23.204 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:18:23.204 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-04-20T21:18:23.261 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-20T21:18:23.261 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-04-20T21:18:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-20T21:18:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:18:23.316 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-20T21:18:23.316 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:18:23.316 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:18:23.317 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-20 21:17:44.066673660 +0000 2024-04-20T21:18:23.317 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-20 21:13:50.630095849 +0000 2024-04-20T21:18:23.317 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-20 21:13:50.630095849 +0000 2024-04-20T21:18:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-20 21:13:50.630095849 +0000 2024-04-20T21:18:23.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-20T21:18:23.394 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-20T21:18:23.395 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-20T21:18:23.395 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.00032958 s, 1.6 MB/s 2024-04-20T21:18:23.398 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-20T21:18:23.452 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-04-20T21:18:23.503 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-20T21:18:23.503 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:18:23.503 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-04-20T21:18:23.503 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:18:23.503 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:18:23.503 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-20 21:17:44.067673642 +0000 2024-04-20T21:18:23.503 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-20 21:13:51.250084033 +0000 2024-04-20T21:18:23.503 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-20 21:13:51.250084033 +0000 2024-04-20T21:18:23.503 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-20 21:13:51.250084033 +0000 2024-04-20T21:18:23.503 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-20T21:18:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-20T21:18:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-20T21:18:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000348315 s, 1.5 MB/s 2024-04-20T21:18:23.583 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-20T21:18:23.640 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-04-20T21:18:23.690 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-20T21:18:23.690 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:18:23.690 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-04-20T21:18:23.690 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:18:23.690 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:18:23.690 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-20 21:17:44.067673642 +0000 2024-04-20T21:18:23.690 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-20 21:13:51.891071816 +0000 2024-04-20T21:18:23.690 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-20 21:13:51.891071816 +0000 2024-04-20T21:18:23.690 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-20 21:13:51.891071816 +0000 2024-04-20T21:18:23.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-20T21:18:23.761 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-20T21:18:23.761 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-20T21:18:23.761 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.00033003 s, 1.6 MB/s 2024-04-20T21:18:23.764 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-20T21:18:23.817 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-04-20T21:18:23.864 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-20T21:18:23.865 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:18:23.865 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-20T21:18:23.865 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:18:23.865 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:18:23.865 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-20 21:17:44.068673625 +0000 2024-04-20T21:18:23.865 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-20 21:13:52.513059963 +0000 2024-04-20T21:18:23.865 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-20 21:13:52.513059963 +0000 2024-04-20T21:18:23.865 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-20 21:13:52.513059963 +0000 2024-04-20T21:18:23.865 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-20T21:18:23.939 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-20T21:18:23.939 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-20T21:18:23.939 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000339705 s, 1.5 MB/s 2024-04-20T21:18:23.943 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-20T21:18:23.997 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-20T21:18:23.997 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-20T21:18:23.997 INFO:tasks.ceph:Generating config... 2024-04-20T21:18:23.998 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-20T21:18:23.998 INFO:tasks.ceph:[client] debug client = 20 2024-04-20T21:18:23.998 INFO:tasks.ceph:[client] debug ms = 1 2024-04-20T21:18:23.998 INFO:tasks.ceph:[client] pid file = 2024-04-20T21:18:23.998 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-20T21:18:23.998 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-20T21:18:23.999 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-20T21:18:24.000 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-20T21:18:24.000 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-20T21:18:24.000 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-20T21:18:24.000 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-20T21:18:24.001 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-20T21:18:24.001 INFO:tasks.ceph:Setting up mon.a... 2024-04-20T21:18:24.001 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-20T21:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.keyring 2024-04-20T21:18:24.101 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-20T21:18:24.194 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-20T21:18:24.255 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.71'), ('mon.b', '172.21.15.137'), ('mon.c', '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]')] 2024-04-20T21:18:24.256 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.71,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-20T21:18:24.256 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:24.257 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-20T21:18:24.294 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.71 --add b 172.21.15.137 --addv c '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: generated fsid da776687-7be6-4259-b098-1ebb1c5bd96b 2024-04-20T21:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout:setting min_mon_release = quincy 2024-04-20T21:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 0 2024-04-20T21:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout:fsid da776687-7be6-4259-b098-1ebb1c5bd96b 2024-04-20T21:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout:last_changed 2024-04-20T21:18:24.417180+0000 2024-04-20T21:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-04-20T21:18:24.417180+0000 2024-04-20T21:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout:min_mon_release 17 (quincy) 2024-04-20T21:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout:election_strategy: 1 2024-04-20T21:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-04-20T21:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout:1: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-04-20T21:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-04-20T21:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-20T21:18:24.419 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-20T21:18:24.459 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID da776687-7be6-4259-b098-1ebb1c5bd96b... 2024-04-20T21:18:24.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-20T21:18:24.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-20T21:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-04-20T21:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2024-04-20T21:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-20T21:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2024-04-20T21:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2024-04-20T21:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2024-04-20T21:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2024-04-20T21:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.71,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = da776687-7be6-4259-b098-1ebb1c5bd96b 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.612 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug trim objects = true 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2024-04-20T21:18:24.613 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 20 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 20 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 10 2024-04-20T21:18:24.614 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-04-20T21:18:24.615 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout: debug client = 20 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2024-04-20T21:18:24.616 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.617 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2024-04-20T21:18:24.618 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2024-04-20T21:18:24.618 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.618 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2024-04-20T21:18:24.618 INFO:teuthology.orchestra.run.smithi071.stdout: mon down mkfs grace = 300 2024-04-20T21:18:24.618 INFO:teuthology.orchestra.run.smithi071.stdout: mon op complaint time = 120 2024-04-20T21:18:24.618 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:18:24.618 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2024-04-20T21:18:24.618 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2024-04-20T21:18:24.618 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2024-04-20T21:18:24.618 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2024-04-20T21:18:24.618 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout: client mount timeout = 600 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout: debug client = 20 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = "" 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 900 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 900 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2024-04-20T21:18:24.619 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout:[mds] 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout: debug mds = 20 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout: debug mds balancer = 20 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug frag = True 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug scatterstat = True 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout: mds op complaint time = 180 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout: mds verify scatter = True 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 900 2024-04-20T21:18:24.620 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 900 2024-04-20T21:18:24.649 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-20T21:18:24.649 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-04-20T21:18:24.649 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-20T21:18:24.649 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-04-20T21:18:24.649 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.649 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-04-20T21:18:24.649 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-20T21:18:24.650 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.651 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.71,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = da776687-7be6-4259-b098-1ebb1c5bd96b 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.652 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-04-20T21:18:24.653 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-04-20T21:18:24.654 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 20 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 20 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 10 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-04-20T21:18:24.655 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-04-20T21:18:24.656 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.657 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2024-04-20T21:18:24.658 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-04-20T21:18:24.659 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-04-20T21:18:24.660 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-04-20T21:18:24.660 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-20T21:18:24.660 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-20T21:18:24.660 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-20T21:18:24.680 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-20T21:18:24.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-20T21:18:24.784 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-20T21:18:24.784 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:24.784 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-20T21:18:24.826 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:24.826 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-20T21:18:24.905 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2024-04-20T21:18:24.905 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:24.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-20T21:18:24.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-20T21:18:25.036 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:25.036 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:25.125 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-04-20T21:18:25.125 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:18:25.125 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-20T21:18:25.125 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-20T21:18:25.259 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:18:25.259 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:25.357 INFO:tasks.ceph:Setting up mon nodes... 2024-04-20T21:18:25.357 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-20T21:18:25.357 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-20T21:18:25.472 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-20T21:18:25.479 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-20T21:18:25.645 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-20T21:18:25.656 INFO:tasks.ceph:Setting up mds nodes... 2024-04-20T21:18:25.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-20T21:18:25.800 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-20T21:18:25.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-20T21:18:25.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-20T21:18:26.003 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-20T21:18:26.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-20T21:18:26.086 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-20T21:18:26.252 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-20T21:18:26.260 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-20T21:18:26.340 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-20T21:18:26.480 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-20T21:18:26.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-20T21:18:26.561 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-20T21:18:26.562 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-20T21:18:26.672 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-20T21:18:26.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-20T21:18:26.806 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-20T21:18:26.848 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-20T21:18:26.969 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-20T21:18:27.007 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-20T21:18:27.123 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-20T21:18:27.163 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-20T21:18:27.163 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-20T21:18:27.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-20T21:18:27.246 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-20T21:18:27.246 INFO:tasks.ceph:role: osd.0 2024-04-20T21:18:27.246 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-20T21:18:27.246 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-20T21:18:27.326 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T21:18:27.327 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T21:18:27.327 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T21:18:27.327 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T21:18:27.327 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T21:18:27.327 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-20T21:18:27.327 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T21:18:27.327 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T21:18:27.327 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T21:18:27.327 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T21:18:27.749 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-20T21:18:27.755 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-20T21:18:27.755 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-20T21:18:27.910 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-20T21:18:27.999 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-20T21:18:28.072 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-20T21:18:28.072 INFO:tasks.ceph:role: osd.1 2024-04-20T21:18:28.072 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-20T21:18:28.072 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-20T21:18:28.145 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T21:18:28.145 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T21:18:28.145 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T21:18:28.145 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T21:18:28.145 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T21:18:28.145 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-20T21:18:28.145 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T21:18:28.145 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T21:18:28.145 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T21:18:28.145 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T21:18:28.510 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-20T21:18:28.517 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-20T21:18:28.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-20T21:18:28.688 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-20T21:18:28.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-20T21:18:28.842 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-20T21:18:28.842 INFO:tasks.ceph:role: osd.2 2024-04-20T21:18:28.842 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-20T21:18:28.842 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-20T21:18:28.920 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T21:18:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T21:18:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T21:18:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T21:18:28.920 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T21:18:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-20T21:18:28.920 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T21:18:28.920 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T21:18:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T21:18:28.920 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T21:18:29.329 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-20T21:18:29.335 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-20T21:18:29.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-20T21:18:29.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-20T21:18:29.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-20T21:18:29.666 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-20T21:18:29.666 INFO:tasks.ceph:role: osd.3 2024-04-20T21:18:29.666 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-20T21:18:29.666 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-20T21:18:29.751 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T21:18:29.751 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T21:18:29.752 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T21:18:29.752 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T21:18:29.752 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T21:18:29.752 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-20T21:18:29.752 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T21:18:29.752 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T21:18:29.752 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T21:18:29.752 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T21:18:30.163 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-20T21:18:30.168 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-20T21:18:30.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-20T21:18:30.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-20T21:18:30.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:30.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:30.557+0000 7f5af9521640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-20T21:18:30.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:30.558+0000 7f5af9521640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-20T21:18:30.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:30.558+0000 7f5af9521640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-20T21:18:30.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:30.558+0000 7f5af9521640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-20T21:18:30.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:30.558+0000 7f5af9521640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-20T21:18:30.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:30.562+0000 7f5af9521640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-20T21:18:33.528 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-20T21:18:33.615 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:33.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:33.747+0000 7fb4d7c1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-20T21:18:33.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:33.747+0000 7fb4d7c1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-20T21:18:33.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:33.748+0000 7fb4d7c1b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-20T21:18:33.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:33.748+0000 7fb4d7c1b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-20T21:18:33.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:33.748+0000 7fb4d7c1b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-20T21:18:33.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:33.750+0000 7fb4d7c1b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-20T21:18:36.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-20T21:18:36.792 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:36.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:36.915+0000 7f6d5e1f8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-20T21:18:36.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:36.916+0000 7f6d5e1f8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-20T21:18:36.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:36.916+0000 7f6d5e1f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-20T21:18:36.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:36.916+0000 7f6d5e1f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-20T21:18:36.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:36.916+0000 7f6d5e1f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-20T21:18:36.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:36.919+0000 7f6d5e1f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-20T21:18:39.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-20T21:18:39.970 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:40.100+0000 7ff5bea11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-20T21:18:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:40.101+0000 7ff5bea11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-20T21:18:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:40.101+0000 7ff5bea11640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-20T21:18:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:40.101+0000 7ff5bea11640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-20T21:18:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:40.101+0000 7ff5bea11640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-20T21:18:40.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:18:40.103+0000 7ff5bea11640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-20T21:18:43.040 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-20T21:18:43.125 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-20T21:18:43.215 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-20T21:18:43.216 INFO:tasks.ceph:role: osd.4 2024-04-20T21:18:43.216 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-20T21:18:43.216 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-20T21:18:43.303 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T21:18:43.303 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T21:18:43.303 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T21:18:43.303 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T21:18:43.303 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T21:18:43.303 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-20T21:18:43.303 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T21:18:43.303 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T21:18:43.303 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T21:18:43.304 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T21:18:43.712 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-20T21:18:43.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-20T21:18:43.718 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-20T21:18:43.862 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-20T21:18:43.956 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-20T21:18:44.035 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-20T21:18:44.035 INFO:tasks.ceph:role: osd.5 2024-04-20T21:18:44.035 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-20T21:18:44.035 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-20T21:18:44.121 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T21:18:44.121 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T21:18:44.121 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T21:18:44.121 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T21:18:44.121 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T21:18:44.121 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-20T21:18:44.121 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T21:18:44.121 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T21:18:44.122 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T21:18:44.122 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T21:18:44.476 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-20T21:18:44.483 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-20T21:18:44.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-20T21:18:44.601 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-20T21:18:44.676 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-20T21:18:44.749 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-20T21:18:44.749 INFO:tasks.ceph:role: osd.6 2024-04-20T21:18:44.749 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-20T21:18:44.749 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-20T21:18:44.835 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T21:18:44.836 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T21:18:44.836 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T21:18:44.836 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T21:18:44.836 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T21:18:44.836 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-20T21:18:44.836 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T21:18:44.836 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T21:18:44.836 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T21:18:44.836 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T21:18:45.224 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-20T21:18:45.230 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-20T21:18:45.230 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-20T21:18:45.351 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-20T21:18:45.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-20T21:18:45.510 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-20T21:18:45.510 INFO:tasks.ceph:role: osd.7 2024-04-20T21:18:45.510 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-20T21:18:45.511 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-20T21:18:45.596 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T21:18:45.596 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T21:18:45.596 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T21:18:45.596 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T21:18:45.596 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T21:18:45.596 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-20T21:18:45.596 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T21:18:45.596 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T21:18:45.596 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T21:18:45.596 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T21:18:46.000 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-20T21:18:46.007 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-20T21:18:46.007 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-20T21:18:46.159 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-20T21:18:46.254 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:46.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:46.389+0000 7f4b75b2d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-20T21:18:46.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:46.389+0000 7f4b75b2d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-20T21:18:46.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:46.390+0000 7f4b75b2d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-20T21:18:46.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:46.390+0000 7f4b75b2d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-20T21:18:46.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:46.390+0000 7f4b75b2d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-20T21:18:46.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:46.393+0000 7f4b75b2d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-20T21:18:49.616 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-20T21:18:49.694 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:49.807+0000 7fd9b380d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-20T21:18:49.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:49.808+0000 7fd9b380d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-20T21:18:49.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:49.808+0000 7fd9b380d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-20T21:18:49.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:49.808+0000 7fd9b380d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-20T21:18:49.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:49.808+0000 7fd9b380d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-20T21:18:49.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:49.811+0000 7fd9b380d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-20T21:18:52.093 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:18:52.101 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:18:52.772 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-20T21:18:52.848 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:52.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:52.972+0000 7f4e5a701640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-20T21:18:52.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:52.972+0000 7f4e5a701640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-20T21:18:52.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:52.972+0000 7f4e5a701640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-20T21:18:52.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:52.972+0000 7f4e5a701640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-20T21:18:52.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:52.972+0000 7f4e5a701640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-20T21:18:52.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:52.975+0000 7f4e5a701640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-20T21:18:55.936 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-20T21:18:56.021 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:18:56.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:56.149+0000 7f3085625640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-20T21:18:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:56.150+0000 7f3085625640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-20T21:18:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:56.150+0000 7f3085625640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-20T21:18:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:56.150+0000 7f3085625640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-20T21:18:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:56.150+0000 7f3085625640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-20T21:18:56.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:18:56.152+0000 7f3085625640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-20T21:18:59.367 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-20T21:18:59.451 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-20T21:18:59.451 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:59.451 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-20T21:18:59.541 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:59.541 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-20T21:18:59.628 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:59.628 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-20T21:18:59.711 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:59.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-20T21:18:59.787 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:59.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-20T21:18:59.866 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:59.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-20T21:18:59.948 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:18:59.948 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-20T21:19:00.032 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:00.032 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-20T21:19:00.121 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:00.121 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-20T21:19:00.205 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:00.205 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-20T21:19:00.290 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:00.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-20T21:19:00.374 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:00.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-20T21:19:00.449 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:00.450 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-20T21:19:00.524 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:00.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-20T21:19:00.642 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:19:00.642 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-20T21:19:00.699 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:19:00.699 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-20T21:19:00.748 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:00.749 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-20T21:19:00.804 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:00.804 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-20T21:19:00.858 INFO:tasks.ceph:Adding keys to all mons... 2024-04-20T21:19:00.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-20T21:19:00.866 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-20T21:19:00.942 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.y] 2024-04-20T21:19:00.942 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAhMSRmvw9LHBAAfBY+B69mgIG99gmBIYl/HQ== 2024-04-20T21:19:00.942 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2024-04-20T21:19:00.942 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAhMSRmc23ILxAAScYMtIu+/WMy6jZuH6NPcA== 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAiMSRm6mtTABAAqAjiCFmvi/O77FTuVG9zyw== 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAmMSRmFKxCIRAATO2CL53EzAJaGeKG48OgrQ== 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQApMSRm4M6RLBAAncjZyWTnWQCAS3BHoF40Gg== 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAsMSRmRY+rNhAAb/9T+r/YcjekP2BQr1vaEw== 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.3] 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAwMSRmvZ8XBhAA+gbY3hosO36P5RFhzmAukg== 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAhMSRmmSyPJhAA+kjZMv8Wian5J9TXnhAfuQ== 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2024-04-20T21:19:00.943 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAiMSRmt2AfDxAAd7jEzbZXFB1pem/Pfmn89Q== 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAiMSRmTCC2HBAAq7padk3XNf2DJJuikyxZUw== 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.4] 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQA2MSRm5lJGFxAA8+tM9iz2DtRtQTAmOaxmeg== 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.5] 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQA5MSRmyRA3MBAAgv27liO92ZlnKa6uhVIkdw== 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.6] 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQA8MSRmlnoBOhAAbQp+9wzBJdZVgyjzOvijAw== 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.7] 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBAMSRmjcv+CBAAQWkkeqvIkvObYUslhvmhTQ== 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAiMSRmBYIpKBAAXd3vf56ttxfmvMK2YXpHOg== 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout:[client.2] 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAiMSRmG3koMBAAlDOy0tz0naK1+lk4ITsMwg== 2024-04-20T21:19:00.944 INFO:teuthology.orchestra.run.smithi071.stdout:[client.1] 2024-04-20T21:19:00.945 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAiMSRm9YjeORAAG9pTTD8Tmv6Awhjo26t6BA== 2024-04-20T21:19:00.945 INFO:teuthology.orchestra.run.smithi071.stdout:[client.3] 2024-04-20T21:19:00.945 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAjMSRmpXtyBxAAYAvmCwtumpheJd4pQ5FgPg== 2024-04-20T21:19:00.945 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.y] 2024-04-20T21:19:00.945 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAhMSRmvw9LHBAAfBY+B69mgIG99gmBIYl/HQ== 2024-04-20T21:19:00.945 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-20T21:19:00.945 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAhMSRmc23ILxAAScYMtIu+/WMy6jZuH6NPcA== 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAiMSRm6mtTABAAqAjiCFmvi/O77FTuVG9zyw== 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAmMSRmFKxCIRAATO2CL53EzAJaGeKG48OgrQ== 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQApMSRm4M6RLBAAncjZyWTnWQCAS3BHoF40Gg== 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAsMSRmRY+rNhAAb/9T+r/YcjekP2BQr1vaEw== 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAwMSRmvZ8XBhAA+gbY3hosO36P5RFhzmAukg== 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAhMSRmmSyPJhAA+kjZMv8Wian5J9TXnhAfuQ== 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-20T21:19:00.946 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAiMSRmt2AfDxAAd7jEzbZXFB1pem/Pfmn89Q== 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAiMSRmTCC2HBAAq7padk3XNf2DJJuikyxZUw== 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.4] 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQA2MSRm5lJGFxAA8+tM9iz2DtRtQTAmOaxmeg== 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.5] 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQA5MSRmyRA3MBAAgv27liO92ZlnKa6uhVIkdw== 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.6] 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQA8MSRmlnoBOhAAbQp+9wzBJdZVgyjzOvijAw== 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.7] 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBAMSRmjcv+CBAAQWkkeqvIkvObYUslhvmhTQ== 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAiMSRmBYIpKBAAXd3vf56ttxfmvMK2YXpHOg== 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout:[client.2] 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAiMSRmG3koMBAAlDOy0tz0naK1+lk4ITsMwg== 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout:[client.1] 2024-04-20T21:19:00.947 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAiMSRm9YjeORAAG9pTTD8Tmv6Awhjo26t6BA== 2024-04-20T21:19:00.948 INFO:teuthology.orchestra.run.smithi137.stdout:[client.3] 2024-04-20T21:19:00.948 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAjMSRmpXtyBxAAYAvmCwtumpheJd4pQ5FgPg== 2024-04-20T21:19:00.949 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-20T21:19:00.996 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-20T21:19:01.132 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T21:19:01.138 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T21:19:01.270 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T21:19:01.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T21:19:01.398 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:01.403 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:01.530 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:01.535 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:01.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:01.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:01.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:01.811 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:01.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-20T21:19:01.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-20T21:19:02.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T21:19:02.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T21:19:02.208 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T21:19:02.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T21:19:02.341 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:02.348 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:02.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:02.490 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:02.618 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:02.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:02.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:02.763 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T21:19:02.896 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T21:19:02.903 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T21:19:03.038 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T21:19:03.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T21:19:03.173 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T21:19:03.178 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T21:19:03.313 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T21:19:03.318 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T21:19:03.452 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-20T21:19:03.453 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-20T21:19:03.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-20T21:19:03.679 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-20T21:19:03.751 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-20T21:19:03.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-20T21:19:03.977 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-20T21:19:04.046 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-20T21:19:04.124 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-20T21:19:04.260 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-20T21:19:04.337 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:19:04.344 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-20T21:19:04.395 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-20T21:19:04.395 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-20T21:19:04.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-20T21:19:04.400 INFO:tasks.ceph.mon.a:Started 2024-04-20T21:19:04.400 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-20T21:19:04.400 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-20T21:19:04.405 INFO:tasks.ceph.mon.b:Started 2024-04-20T21:19:04.405 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-20T21:19:04.405 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-20T21:19:04.410 INFO:tasks.ceph.mon.c:Started 2024-04-20T21:19:04.410 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-20T21:19:04.410 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-20T21:19:04.410 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-20T21:19:04.415 INFO:tasks.ceph.mgr.y:Started 2024-04-20T21:19:04.415 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-20T21:19:04.415 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-20T21:19:04.420 INFO:tasks.ceph.mgr.x:Started 2024-04-20T21:19:04.420 INFO:tasks.ceph:Setting crush tunables to default 2024-04-20T21:19:04.420 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd crush tunables default 2024-04-20T21:19:04.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.590+0000 7f9502400640 1 Processor -- start 2024-04-20T21:19:04.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.591+0000 7f9502400640 1 -- start start 2024-04-20T21:19:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.592+0000 7f9502400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 0x7f94fc0d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.592+0000 7f9502400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94fc0d1e90 con 0x7f94fc0d1a00 2024-04-20T21:19:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.592+0000 7f9502400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94fc0d0d50 con 0x7f94fc0d4270 2024-04-20T21:19:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.592+0000 7f9502400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f94fc0d40c0 con 0x7f94fc0d0380 2024-04-20T21:19:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.592+0000 7f94fb400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f94fc0d4270 0x7f94fc0d4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:56812/0 (socket says 172.21.15.71:56812) 2024-04-20T21:19:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.592+0000 7f94fb400640 1 -- 172.21.15.71:0/2535900968 learned_addr learned my addr 172.21.15.71:0/2535900968 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.593+0000 7f94fbe00640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 0x7f94fc0d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.593+0000 7f94fbe00640 1 -- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 msgr2=0x7f94fc0d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-20T21:19:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.593+0000 7f94fbe00640 1 -- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 msgr2=0x7f94fc0d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-20T21:19:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.593+0000 7f94fbe00640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 0x7f94fc0d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-20T21:19:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.593+0000 7f94fbe00640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 0x7f94fc0d0810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T21:19:04.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1981683936 0 0) 0x7f94fc0d0d50 con 0x7f94fc0d4270 2024-04-20T21:19:04.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94e0003520 con 0x7f94fc0d4270 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2762992668 0 0) 0x7f94e0003520 con 0x7f94fc0d4270 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 msgr2=0x7f94fc0d0810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 0x7f94fc0d0810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 >> v1:172.21.15.71:6789/0 conn(0x7f94fc0d1a00 legacy=0x7f94fc0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94fc0d3820 con 0x7f94fc0d4270 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f94ec001670 con 0x7f94fc0d4270 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 >> v1:172.21.15.137:6789/0 conn(0x7f94fc0d4270 legacy=0x7f94fc0d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 0x7f94e00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e0004030 0x7f94e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94e0004d40 0x7f94e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc0d40c0 con 0x7f94e0004030 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f94e000bb80 con 0x7f94e0004d40 2024-04-20T21:19:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.609+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f94e000bd80 con 0x7f94fc0d0380 2024-04-20T21:19:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.610+0000 7f94faa00640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e0004030 0x7f94e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.610+0000 7f94fbe00640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94e0004d40 0x7f94e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.610+0000 7f94fb400640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 0x7f94e00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.610+0000 7f94fb400640 1 -- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94e0004d40 msgr2=0x7f94e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.610+0000 7f94fb400640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94e0004d40 0x7f94e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.610+0000 7f94fb400640 1 -- 172.21.15.71:0/2535900968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e0004030 msgr2=0x7f94e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.610+0000 7f94fb400640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e0004030 0x7f94e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.610+0000 7f94fb400640 1 -- 172.21.15.71:0/2535900968 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e0003520 con 0x7f94fc0d0380 2024-04-20T21:19:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.612+0000 7f94fb400640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 0x7f94e00039b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00c190 tx=0x7f94e0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b3869669c40457a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.612+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec007c60 con 0x7f94fc0d0380 2024-04-20T21:19:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.612+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ec030070 con 0x7f94fc0d0380 2024-04-20T21:19:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.612+0000 7f94fa000640 1 -- 172.21.15.71:0/2535900968 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec005db0 con 0x7f94fc0d0380 2024-04-20T21:19:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.613+0000 7f9502400640 1 -- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 msgr2=0x7f94e00039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.613+0000 7f9502400640 1 --2- 172.21.15.71:0/2535900968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0d0380 0x7f94e00039b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00c190 tx=0x7f94e0005830 comp rx=0 tx=0).stop 2024-04-20T21:19:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.613+0000 7f94fbe00640 1 -- 172.21.15.71:0/2535900968 reap_dead start 2024-04-20T21:19:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.613+0000 7f9502400640 1 -- 172.21.15.71:0/2535900968 shutdown_connections 2024-04-20T21:19:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.613+0000 7f9502400640 1 -- 172.21.15.71:0/2535900968 >> 172.21.15.71:0/2535900968 conn(0x7f94fc0b99c0 msgr2=0x7f94fc0b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.613+0000 7f9502400640 1 -- 172.21.15.71:0/2535900968 shutdown_connections 2024-04-20T21:19:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.613+0000 7f9502400640 1 -- 172.21.15.71:0/2535900968 wait complete. 2024-04-20T21:19:04.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.615+0000 7f9502400640 1 Processor -- start 2024-04-20T21:19:04.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.615+0000 7f9502400640 1 -- start start 2024-04-20T21:19:04.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.616+0000 7f9502400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94fc0d0380 0x7f94fc159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:04.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.616+0000 7f9502400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0ca5f0 0x7f94fc06d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:04.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.616+0000 7f9502400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94fc0caa70 0x7f94fc06de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.616+0000 7f9502400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc0cfe60 con 0x7f94fc0caa70 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.616+0000 7f9502400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc0d3de0 con 0x7f94fc0d0380 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.616+0000 7f9502400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f94fc0b19a0 con 0x7f94fc0ca5f0 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.616+0000 7f94fbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94fc0caa70 0x7f94fc06de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.616+0000 7f94fbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94fc0caa70 0x7f94fc06de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59042/0 (socket says 172.21.15.71:59042) 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.616+0000 7f94fbe00640 1 -- 172.21.15.71:0/959291068 learned_addr learned my addr 172.21.15.71:0/959291068 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.616+0000 7f94faa00640 1 --2- 172.21.15.71:0/959291068 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0ca5f0 0x7f94fc06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.616+0000 7f94fb400640 1 --2- 172.21.15.71:0/959291068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94fc0d0380 0x7f94fc159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f94fbe00640 1 -- 172.21.15.71:0/959291068 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0ca5f0 msgr2=0x7f94fc06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f94fbe00640 1 --2- 172.21.15.71:0/959291068 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0ca5f0 0x7f94fc06d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f94fbe00640 1 -- 172.21.15.71:0/959291068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94fc0d0380 msgr2=0x7f94fc159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f94fbe00640 1 --2- 172.21.15.71:0/959291068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94fc0d0380 0x7f94fc159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f94fbe00640 1 -- 172.21.15.71:0/959291068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94fc1f4530 con 0x7f94fc0caa70 2024-04-20T21:19:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f94fb400640 1 --2- 172.21.15.71:0/959291068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94fc0d0380 0x7f94fc159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:19:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f94fbe00640 1 --2- 172.21.15.71:0/959291068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94fc0caa70 0x7f94fc06de90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f94fc08cc90 tx=0x7f94f400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f94f3400640 1 -- 172.21.15.71:0/959291068 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f40145f0 con 0x7f94fc0caa70 2024-04-20T21:19:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f94f3400640 1 -- 172.21.15.71:0/959291068 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f401a070 con 0x7f94fc0caa70 2024-04-20T21:19:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f94f3400640 1 -- 172.21.15.71:0/959291068 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f40149f0 con 0x7f94fc0caa70 2024-04-20T21:19:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f9502400640 1 -- 172.21.15.71:0/959291068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94fc1f4810 con 0x7f94fc0caa70 2024-04-20T21:19:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.617+0000 7f9502400640 1 -- 172.21.15.71:0/959291068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94fc1f4dd0 con 0x7f94fc0caa70 2024-04-20T21:19:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.618+0000 7f94f3400640 1 -- 172.21.15.71:0/959291068 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f94f401e400 con 0x7f94fc0caa70 2024-04-20T21:19:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.618+0000 7f94f3400640 1 -- 172.21.15.71:0/959291068 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f94f401d4f0 con 0x7f94fc0caa70 2024-04-20T21:19:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.618+0000 7f9502400640 1 -- 172.21.15.71:0/959291068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94fc0cc6f0 con 0x7f94fc0caa70 2024-04-20T21:19:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.622+0000 7f94f3400640 1 -- 172.21.15.71:0/959291068 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f94f4023020 con 0x7f94fc0caa70 2024-04-20T21:19:04.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.693+0000 7f9502400640 1 -- 172.21.15.71:0/959291068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f94fc068980 con 0x7f94fc0caa70 2024-04-20T21:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.696+0000 7f94f3400640 1 -- 172.21.15.71:0/959291068 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f94f401e8d0 con 0x7f94fc0caa70 2024-04-20T21:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2024-04-20T21:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.698+0000 7f9502400640 1 -- 172.21.15.71:0/959291068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94fc0caa70 msgr2=0x7f94fc06de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.698+0000 7f9502400640 1 --2- 172.21.15.71:0/959291068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94fc0caa70 0x7f94fc06de90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f94fc08cc90 tx=0x7f94f400f520 comp rx=0 tx=0).stop 2024-04-20T21:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.698+0000 7f9502400640 1 -- 172.21.15.71:0/959291068 shutdown_connections 2024-04-20T21:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.698+0000 7f9502400640 1 --2- 172.21.15.71:0/959291068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94fc0caa70 0x7f94fc06de90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.698+0000 7f9502400640 1 --2- 172.21.15.71:0/959291068 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94fc0ca5f0 0x7f94fc06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.698+0000 7f9502400640 1 --2- 172.21.15.71:0/959291068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94fc0d0380 0x7f94fc159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.698+0000 7f9502400640 1 -- 172.21.15.71:0/959291068 >> 172.21.15.71:0/959291068 conn(0x7f94fc0b99c0 msgr2=0x7f94fc0b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.698+0000 7f9502400640 1 -- 172.21.15.71:0/959291068 shutdown_connections 2024-04-20T21:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:04.698+0000 7f9502400640 1 -- 172.21.15.71:0/959291068 wait complete. 2024-04-20T21:19:04.715 INFO:tasks.ceph:check_enable_crimson: False 2024-04-20T21:19:04.716 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-20T21:19:04.716 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:19:04.716 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-20T21:19:04.788 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:19:04.789 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-20T21:19:04.901 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:19:04.901 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-20T21:19:04.901 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:04.902+0000 7fa7defbd040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T21:19:04.936 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:04.936+0000 7f0ddfbb8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T21:19:04.966 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:19:04.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-20T21:19:05.087 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:05.087 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-20T21:19:05.101 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:05.101+0000 7fa7defbd040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T21:19:05.145 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:05.145+0000 7f0ddfbb8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T21:19:05.165 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:05.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-20T21:19:05.167 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:05.168+0000 7fa7defbd040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T21:19:05.212 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:05.213+0000 7f0ddfbb8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T21:19:05.238 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:05.238 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-20T21:19:05.355 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:19:05.355 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-20T21:19:05.477 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:05.477+0000 7fa7defbd040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T21:19:05.480 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new a47e3be4-c3de-4701-add3-a0e02bf6f343 0 2024-04-20T21:19:05.527 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:05.527+0000 7f0ddfbb8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T21:19:05.530 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:05.530+0000 7fa7defbd040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T21:19:05.587 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:05.587+0000 7f0ddfbb8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T21:19:05.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.663+0000 7f1fa2600640 1 Processor -- start 2024-04-20T21:19:05.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.663+0000 7f1fa2600640 1 -- start start 2024-04-20T21:19:05.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.665+0000 7f1fa2600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0d4270 0x7f1f9c0d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:05.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.665+0000 7f1fa2600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1f9c0d4650 0x7f1f9c0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:05.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.665+0000 7f1fa2600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1f9c0b17d0 0x7f1f9c0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:05.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.665+0000 7f1fa2600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9c0d40c0 con 0x7f1f9c0d4650 2024-04-20T21:19:05.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.665+0000 7f1fa2600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9c0d3820 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.665+0000 7f1fa2600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c0d3b00 con 0x7f1f9c0d4270 2024-04-20T21:19:05.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.666+0000 7f1f9b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0d4270 0x7f1f9c0d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:05.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.666+0000 7f1f9be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1f9c0b17d0 0x7f1f9c0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:05.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.666+0000 7f1f9b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0d4270 0x7f1f9c0d1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41704/0 (socket says 172.21.15.137:41704) 2024-04-20T21:19:05.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.666+0000 7f1f9be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1f9c0b17d0 0x7f1f9c0d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56680/0 (socket says 172.21.15.137:56680) 2024-04-20T21:19:05.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.666+0000 7f1f9b400640 1 -- 172.21.15.137:0/52527078 learned_addr learned my addr 172.21.15.137:0/52527078 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:05.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.666+0000 7f1f9aa00640 1 --2- 172.21.15.137:0/52527078 >> v2:172.21.15.71:3300/0 conn(0x7f1f9c0d4650 0x7f1f9c0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:05.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.666+0000 7f1f9b400640 1 -- 172.21.15.137:0/52527078 >> v2:172.21.15.137:3300/0 conn(0x7f1f9c0b17d0 msgr2=0x7f1f9c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:05.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.666+0000 7f1f9b400640 1 --2- 172.21.15.137:0/52527078 >> v2:172.21.15.137:3300/0 conn(0x7f1f9c0b17d0 0x7f1f9c0d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.666+0000 7f1f9b400640 1 -- 172.21.15.137:0/52527078 >> v2:172.21.15.71:3300/0 conn(0x7f1f9c0d4650 msgr2=0x7f1f9c0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:05.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.666+0000 7f1f9b400640 1 --2- 172.21.15.137:0/52527078 >> v2:172.21.15.71:3300/0 conn(0x7f1f9c0d4650 0x7f1f9c0b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.666+0000 7f1f9b400640 1 -- 172.21.15.137:0/52527078 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c0d3de0 con 0x7f1f9c0d4270 2024-04-20T21:19:05.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.667+0000 7f1f9b400640 1 --2- 172.21.15.137:0/52527078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0d4270 0x7f1f9c0d1a00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c08edb0 tx=0x7f1f8c02b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f4e71f7d100941b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:05.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.667+0000 7f1f9a000640 1 -- 172.21.15.137:0/52527078 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c035020 con 0x7f1f9c0d4270 2024-04-20T21:19:05.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.668+0000 7f1f9a000640 1 -- 172.21.15.137:0/52527078 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f8c031870 con 0x7f1f9c0d4270 2024-04-20T21:19:05.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.668+0000 7f1f9a000640 1 -- 172.21.15.137:0/52527078 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c031c40 con 0x7f1f9c0d4270 2024-04-20T21:19:05.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.668+0000 7f1fa2600640 1 -- 172.21.15.137:0/52527078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0d4270 msgr2=0x7f1f9c0d1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:05.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.668+0000 7f1fa2600640 1 --2- 172.21.15.137:0/52527078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0d4270 0x7f1f9c0d1a00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c08edb0 tx=0x7f1f8c02b910 comp rx=0 tx=0).stop 2024-04-20T21:19:05.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.669+0000 7f1fa2600640 1 -- 172.21.15.137:0/52527078 shutdown_connections 2024-04-20T21:19:05.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.669+0000 7f1fa2600640 1 --2- 172.21.15.137:0/52527078 >> v2:172.21.15.137:3300/0 conn(0x7f1f9c0b17d0 0x7f1f9c0d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.669+0000 7f1fa2600640 1 --2- 172.21.15.137:0/52527078 >> v2:172.21.15.71:3300/0 conn(0x7f1f9c0d4650 0x7f1f9c0b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.669+0000 7f1fa2600640 1 --2- 172.21.15.137:0/52527078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0d4270 0x7f1f9c0d1a00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.669+0000 7f1fa2600640 1 -- 172.21.15.137:0/52527078 >> 172.21.15.137:0/52527078 conn(0x7f1f9c0b99c0 msgr2=0x7f1f9c0b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:05.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.669+0000 7f1fa2600640 1 -- 172.21.15.137:0/52527078 shutdown_connections 2024-04-20T21:19:05.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.669+0000 7f1fa2600640 1 -- 172.21.15.137:0/52527078 wait complete. 2024-04-20T21:19:05.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.671+0000 7f1fa2600640 1 Processor -- start 2024-04-20T21:19:05.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.672+0000 7f1fa2600640 1 -- start start 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.673+0000 7f1fa2600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0b17d0 0x7f1f9c0c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.673+0000 7f1fa2600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f9c0d4270 0x7f1f9c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.673+0000 7f1fa2600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f9c0d4650 0x7f1f9c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.673+0000 7f1fa2600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c161f70 con 0x7f1f9c0d4650 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.673+0000 7f1fa2600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c0d53b0 con 0x7f1f9c0d4270 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.673+0000 7f1fa2600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c1620f0 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.673+0000 7f1f9b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0b17d0 0x7f1f9c0c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.674+0000 7f1f9aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f9c0d4270 0x7f1f9c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.674+0000 7f1f9b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0b17d0 0x7f1f9c0c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41712/0 (socket says 172.21.15.137:41712) 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.674+0000 7f1f9b400640 1 -- 172.21.15.137:0/397162072 learned_addr learned my addr 172.21.15.137:0/397162072 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.674+0000 7f1f9be00640 1 --2- 172.21.15.137:0/397162072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f9c0d4650 0x7f1f9c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.674+0000 7f1f9b400640 1 -- 172.21.15.137:0/397162072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f9c0d4270 msgr2=0x7f1f9c0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:05.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.674+0000 7f1f9b400640 1 --2- 172.21.15.137:0/397162072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f9c0d4270 0x7f1f9c0cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.674+0000 7f1f9b400640 1 -- 172.21.15.137:0/397162072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f9c0d4650 msgr2=0x7f1f9c15ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:05.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.674+0000 7f1f9b400640 1 --2- 172.21.15.137:0/397162072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f9c0d4650 0x7f1f9c15ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.674+0000 7f1f9b400640 1 -- 172.21.15.137:0/397162072 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c0cd7c0 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.674+0000 7f1f9aa00640 1 --2- 172.21.15.137:0/397162072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f9c0d4270 0x7f1f9c0cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:05.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.674+0000 7f1f9b400640 1 --2- 172.21.15.137:0/397162072 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0b17d0 0x7f1f9c0c8830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c02b950 tx=0x7f1f8c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:05.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.675+0000 7f1f93400640 1 -- 172.21.15.137:0/397162072 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c040070 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.675+0000 7f1f93400640 1 -- 172.21.15.137:0/397162072 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f8c030d00 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.675+0000 7f1fa2600640 1 -- 172.21.15.137:0/397162072 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c0c8e50 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.675+0000 7f1f93400640 1 -- 172.21.15.137:0/397162072 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c035040 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.675+0000 7f1fa2600640 1 -- 172.21.15.137:0/397162072 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c0c9410 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.675+0000 7f1f93400640 1 -- 172.21.15.137:0/397162072 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f8c04b060 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.675+0000 7f1f93400640 1 -- 172.21.15.137:0/397162072 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1f8c03a9d0 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.676+0000 7f1fa2600640 1 -- 172.21.15.137:0/397162072 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9c0cb210 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.679+0000 7f1f93400640 1 -- 172.21.15.137:0/397162072 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f1f9c0cb210 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.758+0000 7f1fa2600640 1 -- 172.21.15.137:0/397162072 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a47e3be4-c3de-4701-add3-a0e02bf6f343", "id": 0} v 0) -- 0x7f1f9c068980 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.765+0000 7f1f93400640 1 -- 172.21.15.137:0/397162072 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a47e3be4-c3de-4701-add3-a0e02bf6f343", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1f8c03abd0 con 0x7f1f9c0b17d0 2024-04-20T21:19:05.765 INFO:teuthology.orchestra.run.smithi137.stdout:0 2024-04-20T21:19:05.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.767+0000 7f1fa2600640 1 -- 172.21.15.137:0/397162072 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0b17d0 msgr2=0x7f1f9c0c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:05.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.767+0000 7f1fa2600640 1 --2- 172.21.15.137:0/397162072 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0b17d0 0x7f1f9c0c8830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c02b950 tx=0x7f1f8c0046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.767+0000 7f1fa2600640 1 -- 172.21.15.137:0/397162072 shutdown_connections 2024-04-20T21:19:05.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.767+0000 7f1fa2600640 1 --2- 172.21.15.137:0/397162072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f9c0d4650 0x7f1f9c15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.767+0000 7f1fa2600640 1 --2- 172.21.15.137:0/397162072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f9c0d4270 0x7f1f9c0cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.767+0000 7f1fa2600640 1 --2- 172.21.15.137:0/397162072 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c0b17d0 0x7f1f9c0c8830 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.767+0000 7f1fa2600640 1 -- 172.21.15.137:0/397162072 >> 172.21.15.137:0/397162072 conn(0x7f1f9c0b99c0 msgr2=0x7f1f9c15f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:05.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.767+0000 7f1fa2600640 1 -- 172.21.15.137:0/397162072 shutdown_connections 2024-04-20T21:19:05.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.767+0000 7f1fa2600640 1 -- 172.21.15.137:0/397162072 wait complete. 2024-04-20T21:19:05.783 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new fa82906b-04fc-437c-a3cc-cf2c2b492b41 1 2024-04-20T21:19:05.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.954+0000 7f9495a00640 1 Processor -- start 2024-04-20T21:19:05.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.954+0000 7f9495a00640 1 -- start start 2024-04-20T21:19:05.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.956+0000 7f9495a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f949006c010 0x7f94900b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:05.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.956+0000 7f9495a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94900d0980 con 0x7f94900d3b20 2024-04-20T21:19:05.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.956+0000 7f9495a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9490162490 con 0x7f9490161a50 2024-04-20T21:19:05.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.956+0000 7f9495a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f94900d0c60 con 0x7f949006c010 2024-04-20T21:19:05.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.956+0000 7f9495000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f949006c010 0x7f94900b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:05.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.956+0000 7f948fe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9490161a50 0x7f949006b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48550/0 (socket says 172.21.15.137:48550) 2024-04-20T21:19:05.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.956+0000 7f948fe00640 1 -- 172.21.15.137:0/3028587038 learned_addr learned my addr 172.21.15.137:0/3028587038 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-20T21:19:05.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.956+0000 7f9495000640 1 -- 172.21.15.137:0/3028587038 >> v1:172.21.15.137:6789/0 conn(0x7f9490161a50 legacy=0x7f949006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:05.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.956+0000 7f9495000640 1 -- 172.21.15.137:0/3028587038 >> v1:172.21.15.71:6789/0 conn(0x7f94900d3b20 legacy=0x7f94900ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:05.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.956+0000 7f948ea00640 1 -- 172.21.15.137:0/3028587038 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1002326849 0 0) 0x7f9490162490 con 0x7f9490161a50 2024-04-20T21:19:05.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.956+0000 7f9495000640 1 -- 172.21.15.137:0/3028587038 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9490162770 con 0x7f949006c010 2024-04-20T21:19:05.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.958+0000 7f9495000640 1 --2- 172.21.15.137:0/3028587038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949006c010 0x7f94900b3180 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9488009dc0 tx=0x7f948802be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1de62244680f559f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:05.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.958+0000 7f948ea00640 1 -- 172.21.15.137:0/3028587038 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488039070 con 0x7f949006c010 2024-04-20T21:19:05.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.958+0000 7f948ea00640 1 -- 172.21.15.137:0/3028587038 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948802cc40 con 0x7f949006c010 2024-04-20T21:19:05.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.958+0000 7f948ea00640 1 -- 172.21.15.137:0/3028587038 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488034440 con 0x7f949006c010 2024-04-20T21:19:05.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.958+0000 7f9495a00640 1 -- 172.21.15.137:0/3028587038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949006c010 msgr2=0x7f94900b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:05.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.958+0000 7f9495a00640 1 --2- 172.21.15.137:0/3028587038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949006c010 0x7f94900b3180 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9488009dc0 tx=0x7f948802be90 comp rx=0 tx=0).stop 2024-04-20T21:19:05.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.958+0000 7f9495a00640 1 -- 172.21.15.137:0/3028587038 shutdown_connections 2024-04-20T21:19:05.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.959+0000 7f9495a00640 1 --2- 172.21.15.137:0/3028587038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949006c010 0x7f94900b3180 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.959+0000 7f9495a00640 1 -- 172.21.15.137:0/3028587038 >> 172.21.15.137:0/3028587038 conn(0x7f94900d0ed0 msgr2=0x7f94900d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:05.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.959+0000 7f9495a00640 1 -- 172.21.15.137:0/3028587038 shutdown_connections 2024-04-20T21:19:05.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.959+0000 7f9495a00640 1 -- 172.21.15.137:0/3028587038 wait complete. 2024-04-20T21:19:05.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.960+0000 7f9495a00640 1 Processor -- start 2024-04-20T21:19:05.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.961+0000 7f9495a00640 1 -- start start 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.961+0000 7f9495a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949006c010 0x7f949014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.961+0000 7f9495a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9490161a50 0x7f94900cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.961+0000 7f9495a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94900cdf60 0x7f94901f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.961+0000 7f9495a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9490162ae0 con 0x7f94900cdf60 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.961+0000 7f9495a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f94900d0690 con 0x7f949006c010 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.961+0000 7f9495a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9490161e30 con 0x7f9490161a50 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f948fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949006c010 0x7f949014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f948f400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9490161a50 0x7f94900cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f948fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949006c010 0x7f949014f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56696/0 (socket says 172.21.15.137:56696) 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f948fe00640 1 -- 172.21.15.137:0/761184356 learned_addr learned my addr 172.21.15.137:0/761184356 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f9495000640 1 --2- 172.21.15.137:0/761184356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94900cdf60 0x7f94901f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f948fe00640 1 -- 172.21.15.137:0/761184356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9490161a50 msgr2=0x7f94900cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:05.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f948fe00640 1 --2- 172.21.15.137:0/761184356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9490161a50 0x7f94900cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f948fe00640 1 -- 172.21.15.137:0/761184356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94900cdf60 msgr2=0x7f94901f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f948fe00640 1 --2- 172.21.15.137:0/761184356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94900cdf60 0x7f94901f8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f948fe00640 1 -- 172.21.15.137:0/761184356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94900aaf30 con 0x7f949006c010 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f9495000640 1 --2- 172.21.15.137:0/761184356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94900cdf60 0x7f94901f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f948f400640 1 --2- 172.21.15.137:0/761184356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9490161a50 0x7f94900cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.962+0000 7f948fe00640 1 --2- 172.21.15.137:0/761184356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949006c010 0x7f949014f770 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f948000c430 tx=0x7f948000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.963+0000 7f9487e00640 1 -- 172.21.15.137:0/761184356 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94800074e0 con 0x7f949006c010 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.963+0000 7f9487e00640 1 -- 172.21.15.137:0/761184356 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94800047e0 con 0x7f949006c010 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.963+0000 7f9487e00640 1 -- 172.21.15.137:0/761184356 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480004bd0 con 0x7f949006c010 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.963+0000 7f9495a00640 1 -- 172.21.15.137:0/761184356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94900ab210 con 0x7f949006c010 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.963+0000 7f9495a00640 1 -- 172.21.15.137:0/761184356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94900ab7d0 con 0x7f949006c010 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.963+0000 7f9487e00640 1 -- 172.21.15.137:0/761184356 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9480011070 con 0x7f949006c010 2024-04-20T21:19:05.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.963+0000 7f9487e00640 1 -- 172.21.15.137:0/761184356 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f9480013770 con 0x7f949006c010 2024-04-20T21:19:05.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.964+0000 7f9495a00640 1 -- 172.21.15.137:0/761184356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94900ce370 con 0x7f949006c010 2024-04-20T21:19:05.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:05.967+0000 7f9487e00640 1 -- 172.21.15.137:0/761184356 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f94900ce370 con 0x7f949006c010 2024-04-20T21:19:06.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.046+0000 7f9495a00640 1 -- 172.21.15.137:0/761184356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa82906b-04fc-437c-a3cc-cf2c2b492b41", "id": 1} v 0) -- 0x7f94900ab9d0 con 0x7f949006c010 2024-04-20T21:19:06.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.054+0000 7f9487e00640 1 -- 172.21.15.137:0/761184356 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa82906b-04fc-437c-a3cc-cf2c2b492b41", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f94900ab9d0 con 0x7f949006c010 2024-04-20T21:19:06.053 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-20T21:19:06.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.055+0000 7f9495a00640 1 -- 172.21.15.137:0/761184356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949006c010 msgr2=0x7f949014f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.055+0000 7f9495a00640 1 --2- 172.21.15.137:0/761184356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949006c010 0x7f949014f770 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f948000c430 tx=0x7f948000c8f0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.055+0000 7f9495a00640 1 -- 172.21.15.137:0/761184356 shutdown_connections 2024-04-20T21:19:06.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.055+0000 7f9495a00640 1 --2- 172.21.15.137:0/761184356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94900cdf60 0x7f94901f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.055+0000 7f9495a00640 1 --2- 172.21.15.137:0/761184356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9490161a50 0x7f94900cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.055+0000 7f9495a00640 1 --2- 172.21.15.137:0/761184356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949006c010 0x7f949014f770 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.055+0000 7f9495a00640 1 -- 172.21.15.137:0/761184356 >> 172.21.15.137:0/761184356 conn(0x7f94900d0ed0 msgr2=0x7f949006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:06.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.055+0000 7f9495a00640 1 -- 172.21.15.137:0/761184356 shutdown_connections 2024-04-20T21:19:06.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.056+0000 7f9495a00640 1 -- 172.21.15.137:0/761184356 wait complete. 2024-04-20T21:19:06.071 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new e0e07bfe-ce03-4b5b-9699-99745ba92f81 2 2024-04-20T21:19:06.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.241+0000 7f5784800640 1 Processor -- start 2024-04-20T21:19:06.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.241+0000 7f5784800640 1 -- start start 2024-04-20T21:19:06.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.242+0000 7f5784800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f577c073370 0x7f577c162c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.242+0000 7f5784800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577c0b6290 con 0x7f577c158de0 2024-04-20T21:19:06.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.242+0000 7f5784800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577c15f150 con 0x7f577c158a00 2024-04-20T21:19:06.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.242+0000 7f5784800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f577c15f430 con 0x7f577c073370 2024-04-20T21:19:06.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.242+0000 7f5781e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f577c158a00 0x7f577c072c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48556/0 (socket says 172.21.15.137:48556) 2024-04-20T21:19:06.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.242+0000 7f5781e00640 1 -- 172.21.15.137:0/128123446 learned_addr learned my addr 172.21.15.137:0/128123446 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-20T21:19:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.243+0000 7f5781400640 1 --2- 172.21.15.137:0/128123446 >> v2:172.21.15.71:3300/0 conn(0x7f577c073370 0x7f577c162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.243+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107262416 0 0) 0x7f577c15f150 con 0x7f577c158a00 2024-04-20T21:19:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.243+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5764003520 con 0x7f577c158a00 2024-04-20T21:19:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.243+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3206893547 0 0) 0x7f5764003520 con 0x7f577c158a00 2024-04-20T21:19:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.243+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 >> v2:172.21.15.71:3300/0 conn(0x7f577c073370 msgr2=0x7f577c162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.243+0000 7f5780a00640 1 --2- 172.21.15.137:0/128123446 >> v2:172.21.15.71:3300/0 conn(0x7f577c073370 0x7f577c162c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.243+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 >> v1:172.21.15.71:6789/0 conn(0x7f577c158de0 legacy=0x7f577c0ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.243+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c15f710 con 0x7f577c158a00 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.243+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f5770001670 con 0x7f577c158a00 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.243+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 >> v1:172.21.15.137:6789/0 conn(0x7f577c158a00 legacy=0x7f577c072c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.243+0000 7f5780a00640 1 --2- 172.21.15.137:0/128123446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5764003a00 0x7f5764003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5780a00640 1 --2- 172.21.15.137:0/128123446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5764004800 0x7f5764004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5780a00640 1 --2- 172.21.15.137:0/128123446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57640051c0 0x7f576400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f577c15f430 con 0x7f5764004800 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f576400c0c0 con 0x7f57640051c0 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f576400c2c0 con 0x7f5764003a00 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5781e00640 1 --2- 172.21.15.137:0/128123446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5764003a00 0x7f5764003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5782800640 1 --2- 172.21.15.137:0/128123446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57640051c0 0x7f576400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5781400640 1 --2- 172.21.15.137:0/128123446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5764004800 0x7f5764004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5781e00640 1 -- 172.21.15.137:0/128123446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57640051c0 msgr2=0x7f576400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:06.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5781e00640 1 --2- 172.21.15.137:0/128123446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57640051c0 0x7f576400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5781e00640 1 -- 172.21.15.137:0/128123446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5764004800 msgr2=0x7f5764004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:06.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5781e00640 1 --2- 172.21.15.137:0/128123446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5764004800 0x7f5764004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5781e00640 1 -- 172.21.15.137:0/128123446 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5764003520 con 0x7f5764003a00 2024-04-20T21:19:06.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.244+0000 7f5782800640 1 -- 172.21.15.137:0/128123446 reap_dead start 2024-04-20T21:19:06.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.245+0000 7f5781e00640 1 --2- 172.21.15.137:0/128123446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5764003a00 0x7f5764003e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f577000c190 tx=0x7f5764005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bf1a5a17b9c45f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:06.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.246+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770007c60 con 0x7f5764003a00 2024-04-20T21:19:06.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.246+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5770030070 con 0x7f5764003a00 2024-04-20T21:19:06.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.246+0000 7f5780a00640 1 -- 172.21.15.137:0/128123446 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770005d90 con 0x7f5764003a00 2024-04-20T21:19:06.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.247+0000 7f5784800640 1 -- 172.21.15.137:0/128123446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5764003a00 msgr2=0x7f5764003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.247+0000 7f5784800640 1 --2- 172.21.15.137:0/128123446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5764003a00 0x7f5764003e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f577000c190 tx=0x7f5764005830 comp rx=0 tx=0).stop 2024-04-20T21:19:06.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.247+0000 7f5784800640 1 -- 172.21.15.137:0/128123446 shutdown_connections 2024-04-20T21:19:06.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.247+0000 7f5784800640 1 --2- 172.21.15.137:0/128123446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5764003a00 0x7f5764003e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.247+0000 7f5784800640 1 -- 172.21.15.137:0/128123446 >> 172.21.15.137:0/128123446 conn(0x7f577c0b31c0 msgr2=0x7f577c0b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:06.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.247+0000 7f5784800640 1 -- 172.21.15.137:0/128123446 shutdown_connections 2024-04-20T21:19:06.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.247+0000 7f5784800640 1 -- 172.21.15.137:0/128123446 wait complete. 2024-04-20T21:19:06.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.249+0000 7f5784800640 1 Processor -- start 2024-04-20T21:19:06.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.249+0000 7f5784800640 1 -- start start 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.249+0000 7f5784800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5764003a00 0x7f577c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.249+0000 7f5784800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f577c1558b0 0x7f577c0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5784800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f577c140090 0x7f577c140540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5784800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f577c15ed50 con 0x7f5764003a00 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5784800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f577c15ebd0 con 0x7f577c140090 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5784800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f577c15eed0 con 0x7f577c1558b0 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5781400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f577c1558b0 0x7f577c0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5782800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f577c140090 0x7f577c140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5781400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f577c1558b0 0x7f577c0cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41746/0 (socket says 172.21.15.137:41746) 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5781400640 1 -- 172.21.15.137:0/1874106302 learned_addr learned my addr 172.21.15.137:0/1874106302 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5781400640 1 -- 172.21.15.137:0/1874106302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f577c140090 msgr2=0x7f577c140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5781400640 1 --2- 172.21.15.137:0/1874106302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f577c140090 0x7f577c140540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5781400640 1 -- 172.21.15.137:0/1874106302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5764003a00 msgr2=0x7f577c152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5781400640 1 --2- 172.21.15.137:0/1874106302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5764003a00 0x7f577c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.250+0000 7f5781400640 1 -- 172.21.15.137:0/1874106302 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c142f00 con 0x7f577c1558b0 2024-04-20T21:19:06.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.251+0000 7f5781400640 1 --2- 172.21.15.137:0/1874106302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f577c1558b0 0x7f577c0cf690 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f576c011aa0 tx=0x7f576c011f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:06.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.251+0000 7f5776000640 1 -- 172.21.15.137:0/1874106302 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c00fb80 con 0x7f577c1558b0 2024-04-20T21:19:06.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.251+0000 7f5776000640 1 -- 172.21.15.137:0/1874106302 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c00fd20 con 0x7f577c1558b0 2024-04-20T21:19:06.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.251+0000 7f5784800640 1 -- 172.21.15.137:0/1874106302 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f577c1431e0 con 0x7f577c1558b0 2024-04-20T21:19:06.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.251+0000 7f5776000640 1 -- 172.21.15.137:0/1874106302 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c014660 con 0x7f577c1558b0 2024-04-20T21:19:06.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.251+0000 7f5784800640 1 -- 172.21.15.137:0/1874106302 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f577c1437a0 con 0x7f577c1558b0 2024-04-20T21:19:06.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.251+0000 7f5776000640 1 -- 172.21.15.137:0/1874106302 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f576c012040 con 0x7f577c1558b0 2024-04-20T21:19:06.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.251+0000 7f5776000640 1 -- 172.21.15.137:0/1874106302 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f576c01db40 con 0x7f577c1558b0 2024-04-20T21:19:06.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.252+0000 7f5784800640 1 -- 172.21.15.137:0/1874106302 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f577c069090 con 0x7f577c1558b0 2024-04-20T21:19:06.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.255+0000 7f5776000640 1 -- 172.21.15.137:0/1874106302 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f576c019030 con 0x7f577c1558b0 2024-04-20T21:19:06.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.333+0000 7f5784800640 1 -- 172.21.15.137:0/1874106302 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e0e07bfe-ce03-4b5b-9699-99745ba92f81", "id": 2} v 0) -- 0x7f577c0b5db0 con 0x7f577c1558b0 2024-04-20T21:19:06.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.341+0000 7f5776000640 1 -- 172.21.15.137:0/1874106302 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e0e07bfe-ce03-4b5b-9699-99745ba92f81", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f576c02b020 con 0x7f577c1558b0 2024-04-20T21:19:06.341 INFO:teuthology.orchestra.run.smithi137.stdout:2 2024-04-20T21:19:06.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.343+0000 7f5784800640 1 -- 172.21.15.137:0/1874106302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f577c1558b0 msgr2=0x7f577c0cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.343+0000 7f5784800640 1 --2- 172.21.15.137:0/1874106302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f577c1558b0 0x7f577c0cf690 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f576c011aa0 tx=0x7f576c011f60 comp rx=0 tx=0).stop 2024-04-20T21:19:06.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.343+0000 7f5784800640 1 -- 172.21.15.137:0/1874106302 shutdown_connections 2024-04-20T21:19:06.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.343+0000 7f5784800640 1 --2- 172.21.15.137:0/1874106302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f577c140090 0x7f577c140540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.343+0000 7f5784800640 1 --2- 172.21.15.137:0/1874106302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f577c1558b0 0x7f577c0cf690 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.343+0000 7f5784800640 1 --2- 172.21.15.137:0/1874106302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5764003a00 0x7f577c152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.343+0000 7f5784800640 1 -- 172.21.15.137:0/1874106302 >> 172.21.15.137:0/1874106302 conn(0x7f577c0b31c0 msgr2=0x7f577c0b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:06.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.344+0000 7f5784800640 1 -- 172.21.15.137:0/1874106302 shutdown_connections 2024-04-20T21:19:06.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.344+0000 7f5784800640 1 -- 172.21.15.137:0/1874106302 wait complete. 2024-04-20T21:19:06.359 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new cb81eb8b-d46b-44e1-9b17-f235e458ac38 3 2024-04-20T21:19:06.520 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:06.520+0000 7fa7defbd040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T21:19:06.531 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:06.532+0000 7f0ddfbb8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T21:19:06.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.540+0000 7f552ce00640 1 Processor -- start 2024-04-20T21:19:06.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.540+0000 7f552ce00640 1 -- start start 2024-04-20T21:19:06.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.541+0000 7f552ce00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5528147fe0 0x7f55280cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.542+0000 7f552ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55280716e0 0x7f5528071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.542+0000 7f552ce00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552806d4f0 con 0x7f552806e2b0 2024-04-20T21:19:06.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.542+0000 7f552ce00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f552806d2a0 con 0x7f5528147fe0 2024-04-20T21:19:06.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.542+0000 7f552ce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f552806de20 con 0x7f55280716e0 2024-04-20T21:19:06.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.542+0000 7f5525400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55280716e0 0x7f5528071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.542+0000 7f5525400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55280716e0 0x7f5528071b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41762/0 (socket says 172.21.15.137:41762) 2024-04-20T21:19:06.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.542+0000 7f5525400640 1 -- 172.21.15.137:0/3216925733 learned_addr learned my addr 172.21.15.137:0/3216925733 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:06.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.542+0000 7f5525e00640 1 --2- 172.21.15.137:0/3216925733 >> v2:172.21.15.71:3300/0 conn(0x7f5528147fe0 0x7f55280cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.543+0000 7f5525400640 1 -- 172.21.15.137:0/3216925733 >> v2:172.21.15.71:3300/0 conn(0x7f5528147fe0 msgr2=0x7f55280cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:06.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.543+0000 7f5525400640 1 --2- 172.21.15.137:0/3216925733 >> v2:172.21.15.71:3300/0 conn(0x7f5528147fe0 0x7f55280cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.543+0000 7f5525400640 1 -- 172.21.15.137:0/3216925733 >> v1:172.21.15.71:6789/0 conn(0x7f552806e2b0 legacy=0x7f552806e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.543+0000 7f5525400640 1 -- 172.21.15.137:0/3216925733 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552806d7d0 con 0x7f55280716e0 2024-04-20T21:19:06.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.544+0000 7f5525400640 1 --2- 172.21.15.137:0/3216925733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55280716e0 0x7f5528071b60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5514009870 tx=0x7f551402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=887f1ee6819139af server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:06.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.544+0000 7f5524a00640 1 -- 172.21.15.137:0/3216925733 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514034070 con 0x7f55280716e0 2024-04-20T21:19:06.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.544+0000 7f5524a00640 1 -- 172.21.15.137:0/3216925733 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5514030840 con 0x7f55280716e0 2024-04-20T21:19:06.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.544+0000 7f5524a00640 1 -- 172.21.15.137:0/3216925733 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514030c10 con 0x7f55280716e0 2024-04-20T21:19:06.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.545+0000 7f552ce00640 1 -- 172.21.15.137:0/3216925733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55280716e0 msgr2=0x7f5528071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.545+0000 7f552ce00640 1 --2- 172.21.15.137:0/3216925733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55280716e0 0x7f5528071b60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5514009870 tx=0x7f551402b980 comp rx=0 tx=0).stop 2024-04-20T21:19:06.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.545+0000 7f552ce00640 1 -- 172.21.15.137:0/3216925733 shutdown_connections 2024-04-20T21:19:06.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.545+0000 7f552ce00640 1 --2- 172.21.15.137:0/3216925733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55280716e0 0x7f5528071b60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.545+0000 7f552ce00640 1 --2- 172.21.15.137:0/3216925733 >> v2:172.21.15.71:3300/0 conn(0x7f5528147fe0 0x7f55280cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.545+0000 7f552ce00640 1 -- 172.21.15.137:0/3216925733 >> 172.21.15.137:0/3216925733 conn(0x7f55280d2340 msgr2=0x7f55280d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:06.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.545+0000 7f552ce00640 1 -- 172.21.15.137:0/3216925733 shutdown_connections 2024-04-20T21:19:06.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.545+0000 7f552ce00640 1 -- 172.21.15.137:0/3216925733 wait complete. 2024-04-20T21:19:06.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.547+0000 7f552ce00640 1 Processor -- start 2024-04-20T21:19:06.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.547+0000 7f552ce00640 1 -- start start 2024-04-20T21:19:06.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.548+0000 7f552ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f552806e2b0 0x7f552815e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.548+0000 7f552ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55280716e0 0x7f55280b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.548+0000 7f552ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5528147fe0 0x7f55280ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.548+0000 7f552ce00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55280cced0 con 0x7f55280716e0 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.548+0000 7f552ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55281483c0 con 0x7f552806e2b0 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.548+0000 7f552ce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55280cd050 con 0x7f5528147fe0 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.548+0000 7f5525e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f552806e2b0 0x7f552815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.548+0000 7f5525e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f552806e2b0 0x7f552815e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56720/0 (socket says 172.21.15.137:56720) 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.548+0000 7f5526800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5528147fe0 0x7f55280ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.548+0000 7f5525e00640 1 -- 172.21.15.137:0/1490659603 learned_addr learned my addr 172.21.15.137:0/1490659603 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.549+0000 7f5525400640 1 --2- 172.21.15.137:0/1490659603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55280716e0 0x7f55280b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.549+0000 7f5526800640 1 -- 172.21.15.137:0/1490659603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f552806e2b0 msgr2=0x7f552815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.549+0000 7f5526800640 1 --2- 172.21.15.137:0/1490659603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f552806e2b0 0x7f552815e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.549+0000 7f5526800640 1 -- 172.21.15.137:0/1490659603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55280716e0 msgr2=0x7f55280b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.549+0000 7f5526800640 1 --2- 172.21.15.137:0/1490659603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55280716e0 0x7f55280b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.549+0000 7f5526800640 1 -- 172.21.15.137:0/1490659603 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55281f4d70 con 0x7f5528147fe0 2024-04-20T21:19:06.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.549+0000 7f5525e00640 1 --2- 172.21.15.137:0/1490659603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f552806e2b0 0x7f552815e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:06.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.549+0000 7f5526800640 1 --2- 172.21.15.137:0/1490659603 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5528147fe0 0x7f55280ca940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f552000c690 tx=0x7f552000cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.550+0000 7f551e000640 1 -- 172.21.15.137:0/1490659603 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520003b70 con 0x7f5528147fe0 2024-04-20T21:19:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.550+0000 7f551e000640 1 -- 172.21.15.137:0/1490659603 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5520003d10 con 0x7f5528147fe0 2024-04-20T21:19:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.550+0000 7f551e000640 1 -- 172.21.15.137:0/1490659603 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520005310 con 0x7f5528147fe0 2024-04-20T21:19:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.550+0000 7f552ce00640 1 -- 172.21.15.137:0/1490659603 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55280b6200 con 0x7f5528147fe0 2024-04-20T21:19:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.550+0000 7f552ce00640 1 -- 172.21.15.137:0/1490659603 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55281f4fe0 con 0x7f5528147fe0 2024-04-20T21:19:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.550+0000 7f551e000640 1 -- 172.21.15.137:0/1490659603 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f55200054b0 con 0x7f5528147fe0 2024-04-20T21:19:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.550+0000 7f551e000640 1 -- 172.21.15.137:0/1490659603 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5520012900 con 0x7f5528147fe0 2024-04-20T21:19:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.551+0000 7f552ce00640 1 -- 172.21.15.137:0/1490659603 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5528069090 con 0x7f5528147fe0 2024-04-20T21:19:06.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.553+0000 7f551e000640 1 -- 172.21.15.137:0/1490659603 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f5520012be0 con 0x7f5528147fe0 2024-04-20T21:19:06.626 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:06.626+0000 7fa7defbd040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T21:19:06.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.631+0000 7f552ce00640 1 -- 172.21.15.137:0/1490659603 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cb81eb8b-d46b-44e1-9b17-f235e458ac38", "id": 3} v 0) -- 0x7f55280b36d0 con 0x7f5528147fe0 2024-04-20T21:19:06.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.637+0000 7f551e000640 1 -- 172.21.15.137:0/1490659603 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb81eb8b-d46b-44e1-9b17-f235e458ac38", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5520012470 con 0x7f5528147fe0 2024-04-20T21:19:06.637 INFO:teuthology.orchestra.run.smithi137.stdout:3 2024-04-20T21:19:06.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.639+0000 7f552ce00640 1 -- 172.21.15.137:0/1490659603 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5528147fe0 msgr2=0x7f55280ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.639+0000 7f552ce00640 1 --2- 172.21.15.137:0/1490659603 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5528147fe0 0x7f55280ca940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f552000c690 tx=0x7f552000cb50 comp rx=0 tx=0).stop 2024-04-20T21:19:06.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.639+0000 7f552ce00640 1 -- 172.21.15.137:0/1490659603 shutdown_connections 2024-04-20T21:19:06.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.639+0000 7f552ce00640 1 --2- 172.21.15.137:0/1490659603 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5528147fe0 0x7f55280ca940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.639+0000 7f552ce00640 1 --2- 172.21.15.137:0/1490659603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55280716e0 0x7f55280b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.639+0000 7f552ce00640 1 --2- 172.21.15.137:0/1490659603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f552806e2b0 0x7f552815e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.639+0000 7f552ce00640 1 -- 172.21.15.137:0/1490659603 >> 172.21.15.137:0/1490659603 conn(0x7f55280d2340 msgr2=0x7f5528162960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:06.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.639+0000 7f552ce00640 1 -- 172.21.15.137:0/1490659603 shutdown_connections 2024-04-20T21:19:06.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.639+0000 7f552ce00640 1 -- 172.21.15.137:0/1490659603 wait complete. 2024-04-20T21:19:06.650 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:06.650+0000 7f0ddfbb8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T21:19:06.655 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new b97d7a8d-8636-46f4-b83b-a5af50c60430 4 2024-04-20T21:19:06.678 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:06.678+0000 7fa7defbd040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T21:19:06.707 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:06.708+0000 7f0ddfbb8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T21:19:06.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.826+0000 7f56ef400640 1 Processor -- start 2024-04-20T21:19:06.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.826+0000 7f56ef400640 1 -- start start 2024-04-20T21:19:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.827+0000 7f56ef400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4270 0x7f56e80d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.827+0000 7f56ef400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f56e80d0380 0x7f56e80d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.827+0000 7f56ef400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e80d0d50 con 0x7f56e80d4650 2024-04-20T21:19:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.827+0000 7f56ef400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f56e80d40c0 con 0x7f56e80d0380 2024-04-20T21:19:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.827+0000 7f56ef400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f56e80d3820 con 0x7f56e80d4270 2024-04-20T21:19:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.827+0000 7f56eca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4270 0x7f56e80d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.827+0000 7f56eca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4270 0x7f56e80d1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41788/0 (socket says 172.21.15.137:41788) 2024-04-20T21:19:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.827+0000 7f56eca00640 1 -- 172.21.15.137:0/1261429881 learned_addr learned my addr 172.21.15.137:0/1261429881 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.828+0000 7f56ed400640 1 --2- 172.21.15.137:0/1261429881 >> v2:172.21.15.71:3300/0 conn(0x7f56e80d0380 0x7f56e80d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.828+0000 7f56eca00640 1 -- 172.21.15.137:0/1261429881 >> v2:172.21.15.71:3300/0 conn(0x7f56e80d0380 msgr2=0x7f56e80d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.828+0000 7f56eca00640 1 --2- 172.21.15.137:0/1261429881 >> v2:172.21.15.71:3300/0 conn(0x7f56e80d0380 0x7f56e80d0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.828+0000 7f56eca00640 1 -- 172.21.15.137:0/1261429881 >> v1:172.21.15.71:6789/0 conn(0x7f56e80d4650 legacy=0x7f56e80b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.828+0000 7f56eca00640 1 -- 172.21.15.137:0/1261429881 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e80d3b00 con 0x7f56e80d4270 2024-04-20T21:19:06.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.829+0000 7f56eca00640 1 --2- 172.21.15.137:0/1261429881 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4270 0x7f56e80d1a00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009870 tx=0x7f56dc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35f3a495c5a71000 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:06.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.829+0000 7f56e7400640 1 -- 172.21.15.137:0/1261429881 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc035020 con 0x7f56e80d4270 2024-04-20T21:19:06.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.829+0000 7f56e7400640 1 -- 172.21.15.137:0/1261429881 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56dc031640 con 0x7f56e80d4270 2024-04-20T21:19:06.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.829+0000 7f56e7400640 1 -- 172.21.15.137:0/1261429881 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc02d040 con 0x7f56e80d4270 2024-04-20T21:19:06.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.830+0000 7f56ef400640 1 -- 172.21.15.137:0/1261429881 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4270 msgr2=0x7f56e80d1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.830+0000 7f56ef400640 1 --2- 172.21.15.137:0/1261429881 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4270 0x7f56e80d1a00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009870 tx=0x7f56dc02b8f0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.830+0000 7f56ef400640 1 -- 172.21.15.137:0/1261429881 shutdown_connections 2024-04-20T21:19:06.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.830+0000 7f56ef400640 1 --2- 172.21.15.137:0/1261429881 >> v2:172.21.15.71:3300/0 conn(0x7f56e80d0380 0x7f56e80d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.830+0000 7f56ef400640 1 --2- 172.21.15.137:0/1261429881 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4270 0x7f56e80d1a00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.830+0000 7f56ef400640 1 -- 172.21.15.137:0/1261429881 >> 172.21.15.137:0/1261429881 conn(0x7f56e80b99c0 msgr2=0x7f56e80b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:06.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.830+0000 7f56ef400640 1 -- 172.21.15.137:0/1261429881 shutdown_connections 2024-04-20T21:19:06.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.830+0000 7f56ef400640 1 -- 172.21.15.137:0/1261429881 wait complete. 2024-04-20T21:19:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.832+0000 7f56ef400640 1 Processor -- start 2024-04-20T21:19:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.832+0000 7f56ef400640 1 -- start start 2024-04-20T21:19:06.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ef400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e80d0380 0x7f56e806cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ef400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e80d4270 0x7f56e80cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ef400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4650 0x7f56e815be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:06.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ef400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56e80b19a0 con 0x7f56e80d0380 2024-04-20T21:19:06.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ef400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f56e80cfe60 con 0x7f56e80d4270 2024-04-20T21:19:06.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ef400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f56e80d53b0 con 0x7f56e80d4650 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e80d4270 0x7f56e80cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ed400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4650 0x7f56e815be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ed400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4650 0x7f56e815be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41796/0 (socket says 172.21.15.137:41796) 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e80d4270 0x7f56e80cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56728/0 (socket says 172.21.15.137:56728) 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ed400640 1 -- 172.21.15.137:0/4075972947 learned_addr learned my addr 172.21.15.137:0/4075972947 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56eca00640 1 --2- 172.21.15.137:0/4075972947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e80d0380 0x7f56e806cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ed400640 1 -- 172.21.15.137:0/4075972947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e80d4270 msgr2=0x7f56e80cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ed400640 1 --2- 172.21.15.137:0/4075972947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e80d4270 0x7f56e80cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ed400640 1 -- 172.21.15.137:0/4075972947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e80d0380 msgr2=0x7f56e806cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ed400640 1 --2- 172.21.15.137:0/4075972947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e80d0380 0x7f56e806cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56ed400640 1 -- 172.21.15.137:0/4075972947 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e80cbbf0 con 0x7f56e80d4650 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56e7e00640 1 --2- 172.21.15.137:0/4075972947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e80d4270 0x7f56e80cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.833+0000 7f56eca00640 1 --2- 172.21.15.137:0/4075972947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e80d0380 0x7f56e806cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:19:06.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.834+0000 7f56ed400640 1 --2- 172.21.15.137:0/4075972947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4650 0x7f56e815be60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f56e000cda0 tx=0x7f56e000a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:06.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.834+0000 7f56e4c00640 1 -- 172.21.15.137:0/4075972947 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0003b90 con 0x7f56e80d4650 2024-04-20T21:19:06.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.834+0000 7f56e4c00640 1 -- 172.21.15.137:0/4075972947 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e0003d30 con 0x7f56e80d4650 2024-04-20T21:19:06.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.834+0000 7f56e4c00640 1 -- 172.21.15.137:0/4075972947 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0004240 con 0x7f56e80d4650 2024-04-20T21:19:06.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.834+0000 7f56ef400640 1 -- 172.21.15.137:0/4075972947 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e80cbe70 con 0x7f56e80d4650 2024-04-20T21:19:06.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.834+0000 7f56ef400640 1 -- 172.21.15.137:0/4075972947 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e80cc430 con 0x7f56e80d4650 2024-04-20T21:19:06.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.834+0000 7f56e4c00640 1 -- 172.21.15.137:0/4075972947 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f56e001f440 con 0x7f56e80d4650 2024-04-20T21:19:06.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.835+0000 7f56e4c00640 1 -- 172.21.15.137:0/4075972947 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f56e001fc40 con 0x7f56e80d4650 2024-04-20T21:19:06.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.835+0000 7f56ef400640 1 -- 172.21.15.137:0/4075972947 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e8068980 con 0x7f56e80d4650 2024-04-20T21:19:06.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.838+0000 7f56e4c00640 1 -- 172.21.15.137:0/4075972947 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f56e0025080 con 0x7f56e80d4650 2024-04-20T21:19:06.867 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:06.867+0000 7fa7defbd040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T21:19:06.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.913+0000 7f56ef400640 1 -- 172.21.15.137:0/4075972947 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b97d7a8d-8636-46f4-b83b-a5af50c60430", "id": 4} v 0) -- 0x7f56e815f1b0 con 0x7f56e80d4650 2024-04-20T21:19:06.916 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:06.917+0000 7f0ddfbb8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T21:19:06.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.920+0000 7f56e4c00640 1 -- 172.21.15.137:0/4075972947 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b97d7a8d-8636-46f4-b83b-a5af50c60430", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f56e80cbbf0 con 0x7f56e80d4650 2024-04-20T21:19:06.920 INFO:teuthology.orchestra.run.smithi137.stdout:4 2024-04-20T21:19:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.922+0000 7f56ef400640 1 -- 172.21.15.137:0/4075972947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4650 msgr2=0x7f56e815be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.922+0000 7f56ef400640 1 --2- 172.21.15.137:0/4075972947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4650 0x7f56e815be60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f56e000cda0 tx=0x7f56e000a660 comp rx=0 tx=0).stop 2024-04-20T21:19:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.922+0000 7f56ef400640 1 -- 172.21.15.137:0/4075972947 shutdown_connections 2024-04-20T21:19:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.922+0000 7f56ef400640 1 --2- 172.21.15.137:0/4075972947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56e80d4650 0x7f56e815be60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.922+0000 7f56ef400640 1 --2- 172.21.15.137:0/4075972947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e80d4270 0x7f56e80cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.922+0000 7f56ef400640 1 --2- 172.21.15.137:0/4075972947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e80d0380 0x7f56e806cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.922+0000 7f56ef400640 1 -- 172.21.15.137:0/4075972947 >> 172.21.15.137:0/4075972947 conn(0x7f56e80b99c0 msgr2=0x7f56e815f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.922+0000 7f56ef400640 1 -- 172.21.15.137:0/4075972947 shutdown_connections 2024-04-20T21:19:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:06.922+0000 7f56ef400640 1 -- 172.21.15.137:0/4075972947 wait complete. 2024-04-20T21:19:06.937 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:06.937+0000 7fa7defbd040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T21:19:06.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new eac24a35-2c63-4936-8127-b428e91485d7 5 2024-04-20T21:19:06.981 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:06.981+0000 7f0ddfbb8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T21:19:06.997 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:06.997+0000 7fa7defbd040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T21:19:07.048 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:07.048+0000 7f0ddfbb8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T21:19:07.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.118+0000 7fc366600640 1 Processor -- start 2024-04-20T21:19:07.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.118+0000 7fc366600640 1 -- start start 2024-04-20T21:19:07.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.120+0000 7fc366600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3600c8560 0x7fc3600cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.120+0000 7fc366600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.120+0000 7fc366600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3600d0da0 con 0x7fc3600d0050 2024-04-20T21:19:07.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.120+0000 7fc366600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc3600d19b0 con 0x7fc3600c8560 2024-04-20T21:19:07.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.120+0000 7fc366600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc3600c6d40 con 0x7fc3600c8940 2024-04-20T21:19:07.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.120+0000 7fc35fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.120+0000 7fc35fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41808/0 (socket says 172.21.15.137:41808) 2024-04-20T21:19:07.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.120+0000 7fc35fe00640 1 -- 172.21.15.137:0/977280255 learned_addr learned my addr 172.21.15.137:0/977280255 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:07.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.120+0000 7fc365200640 1 --2- 172.21.15.137:0/977280255 >> v2:172.21.15.71:3300/0 conn(0x7fc3600c8560 0x7fc3600cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.121+0000 7fc35fe00640 1 -- 172.21.15.137:0/977280255 >> v2:172.21.15.71:3300/0 conn(0x7fc3600c8560 msgr2=0x7fc3600cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:07.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.121+0000 7fc35fe00640 1 --2- 172.21.15.137:0/977280255 >> v2:172.21.15.71:3300/0 conn(0x7fc3600c8560 0x7fc3600cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.121+0000 7fc35fe00640 1 -- 172.21.15.137:0/977280255 >> v1:172.21.15.71:6789/0 conn(0x7fc3600d0050 legacy=0x7fc3600d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:07.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.121+0000 7fc35fe00640 1 -- 172.21.15.137:0/977280255 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3600d1080 con 0x7fc3600c8940 2024-04-20T21:19:07.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.122+0000 7fc35fe00640 1 --2- 172.21.15.137:0/977280255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600cf130 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009870 tx=0x7fc34c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5771327ab38ee8d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:07.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.122+0000 7fc35f400640 1 -- 172.21.15.137:0/977280255 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c035020 con 0x7fc3600c8940 2024-04-20T21:19:07.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.122+0000 7fc35f400640 1 -- 172.21.15.137:0/977280255 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34c031640 con 0x7fc3600c8940 2024-04-20T21:19:07.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.122+0000 7fc35f400640 1 -- 172.21.15.137:0/977280255 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c02d040 con 0x7fc3600c8940 2024-04-20T21:19:07.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.123+0000 7fc366600640 1 -- 172.21.15.137:0/977280255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 msgr2=0x7fc3600cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.123+0000 7fc366600640 1 --2- 172.21.15.137:0/977280255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600cf130 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009870 tx=0x7fc34c02b8f0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.123+0000 7fc366600640 1 -- 172.21.15.137:0/977280255 shutdown_connections 2024-04-20T21:19:07.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.123+0000 7fc366600640 1 --2- 172.21.15.137:0/977280255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600cf130 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.123+0000 7fc366600640 1 --2- 172.21.15.137:0/977280255 >> v2:172.21.15.71:3300/0 conn(0x7fc3600c8560 0x7fc3600cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.123+0000 7fc366600640 1 -- 172.21.15.137:0/977280255 >> 172.21.15.137:0/977280255 conn(0x7fc3600b3d10 msgr2=0x7fc3600b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:07.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.123+0000 7fc366600640 1 -- 172.21.15.137:0/977280255 shutdown_connections 2024-04-20T21:19:07.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.123+0000 7fc366600640 1 -- 172.21.15.137:0/977280255 wait complete. 2024-04-20T21:19:07.124 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:07.124+0000 7fa7defbd040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T21:19:07.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.124+0000 7fc366600640 1 Processor -- start 2024-04-20T21:19:07.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.125+0000 7fc366600640 1 -- start start 2024-04-20T21:19:07.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc366600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600c8560 0x7fc36015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc366600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc366600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3600d0050 0x7fc3600b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc366600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3600d1e40 con 0x7fc3600c8560 2024-04-20T21:19:07.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc366600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3600d1640 con 0x7fc3600d0050 2024-04-20T21:19:07.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc366600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc3600c5d30 con 0x7fc3600c8940 2024-04-20T21:19:07.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc35fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc35fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600c92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41822/0 (socket says 172.21.15.137:41822) 2024-04-20T21:19:07.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc35fe00640 1 -- 172.21.15.137:0/3050473252 learned_addr learned my addr 172.21.15.137:0/3050473252 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:07.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc365c00640 1 --2- 172.21.15.137:0/3050473252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3600d0050 0x7fc3600b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc365200640 1 --2- 172.21.15.137:0/3050473252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600c8560 0x7fc36015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc35fe00640 1 -- 172.21.15.137:0/3050473252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3600d0050 msgr2=0x7fc3600b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc35fe00640 1 --2- 172.21.15.137:0/3050473252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3600d0050 0x7fc3600b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc35fe00640 1 -- 172.21.15.137:0/3050473252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600c8560 msgr2=0x7fc36015baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc35fe00640 1 --2- 172.21.15.137:0/3050473252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600c8560 0x7fc36015baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.126+0000 7fc35fe00640 1 -- 172.21.15.137:0/3050473252 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3600c9d50 con 0x7fc3600c8940 2024-04-20T21:19:07.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.127+0000 7fc35fe00640 1 --2- 172.21.15.137:0/3050473252 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600c92b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc34c000c00 tx=0x7fc34c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:07.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.127+0000 7fc35cc00640 1 -- 172.21.15.137:0/3050473252 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c040070 con 0x7fc3600c8940 2024-04-20T21:19:07.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.127+0000 7fc35cc00640 1 -- 172.21.15.137:0/3050473252 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34c0399f0 con 0x7fc3600c8940 2024-04-20T21:19:07.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.127+0000 7fc35cc00640 1 -- 172.21.15.137:0/3050473252 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c035040 con 0x7fc3600c8940 2024-04-20T21:19:07.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.127+0000 7fc366600640 1 -- 172.21.15.137:0/3050473252 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3600ca030 con 0x7fc3600c8940 2024-04-20T21:19:07.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.127+0000 7fc366600640 1 -- 172.21.15.137:0/3050473252 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36006ebf0 con 0x7fc3600c8940 2024-04-20T21:19:07.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.127+0000 7fc35cc00640 1 -- 172.21.15.137:0/3050473252 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc34c038020 con 0x7fc3600c8940 2024-04-20T21:19:07.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.128+0000 7fc35cc00640 1 -- 172.21.15.137:0/3050473252 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc34c03abf0 con 0x7fc3600c8940 2024-04-20T21:19:07.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.128+0000 7fc366600640 1 -- 172.21.15.137:0/3050473252 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc360075b30 con 0x7fc3600c8940 2024-04-20T21:19:07.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.131+0000 7fc35cc00640 1 -- 172.21.15.137:0/3050473252 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fc34c039e00 con 0x7fc3600c8940 2024-04-20T21:19:07.186 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:07.186+0000 7f0ddfbb8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T21:19:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.209+0000 7fc366600640 1 -- 172.21.15.137:0/3050473252 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "eac24a35-2c63-4936-8127-b428e91485d7", "id": 5} v 0) -- 0x7fc3600b3510 con 0x7fc3600c8940 2024-04-20T21:19:07.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.216+0000 7fc35cc00640 1 -- 172.21.15.137:0/3050473252 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eac24a35-2c63-4936-8127-b428e91485d7", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc34c03a420 con 0x7fc3600c8940 2024-04-20T21:19:07.216 INFO:teuthology.orchestra.run.smithi137.stdout:5 2024-04-20T21:19:07.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.217+0000 7fc366600640 1 -- 172.21.15.137:0/3050473252 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 msgr2=0x7fc3600c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.217+0000 7fc366600640 1 --2- 172.21.15.137:0/3050473252 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600c92b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc34c000c00 tx=0x7fc34c0046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.217+0000 7fc366600640 1 -- 172.21.15.137:0/3050473252 shutdown_connections 2024-04-20T21:19:07.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.217+0000 7fc366600640 1 --2- 172.21.15.137:0/3050473252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3600d0050 0x7fc3600b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.217+0000 7fc366600640 1 --2- 172.21.15.137:0/3050473252 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3600c8940 0x7fc3600c92b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.217+0000 7fc366600640 1 --2- 172.21.15.137:0/3050473252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600c8560 0x7fc36015baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.217+0000 7fc366600640 1 -- 172.21.15.137:0/3050473252 >> 172.21.15.137:0/3050473252 conn(0x7fc3600b3d10 msgr2=0x7fc36015ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:07.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.218+0000 7fc366600640 1 -- 172.21.15.137:0/3050473252 shutdown_connections 2024-04-20T21:19:07.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.218+0000 7fc366600640 1 -- 172.21.15.137:0/3050473252 wait complete. 2024-04-20T21:19:07.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new f5ed051c-e34c-4d88-90a7-612c88d5b6cc 6 2024-04-20T21:19:07.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.459+0000 7fe4e1e00640 1 Processor -- start 2024-04-20T21:19:07.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.459+0000 7fe4e1e00640 1 -- start start 2024-04-20T21:19:07.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.461+0000 7fe4e1e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe4dc15e8c0 0x7fe4dc06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.461+0000 7fe4e1e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4dc0d15b0 con 0x7fe4dc0d1010 2024-04-20T21:19:07.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.461+0000 7fe4e1e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4dc0d1890 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.461+0000 7fe4e1e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe4dc0b6d10 con 0x7fe4dc15e8c0 2024-04-20T21:19:07.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.461+0000 7fe4e0a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe4dc15e8c0 0x7fe4dc06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.461+0000 7fe4e1400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe4dc0d46f0 0x7fe4dc0cfa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48560/0 (socket says 172.21.15.137:48560) 2024-04-20T21:19:07.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.461+0000 7fe4e0a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe4dc15e8c0 0x7fe4dc06ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56754/0 (socket says 172.21.15.137:56754) 2024-04-20T21:19:07.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.461+0000 7fe4e1400640 1 -- 172.21.15.137:0/1614648929 learned_addr learned my addr 172.21.15.137:0/1614648929 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-20T21:19:07.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.462+0000 7fe4e0a00640 1 -- 172.21.15.137:0/1614648929 >> v1:172.21.15.137:6789/0 conn(0x7fe4dc0d46f0 legacy=0x7fe4dc0cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.462+0000 7fe4e0a00640 1 -- 172.21.15.137:0/1614648929 >> v1:172.21.15.71:6789/0 conn(0x7fe4dc0d1010 legacy=0x7fe4dc0b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:07.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.462+0000 7fe4e0a00640 1 -- 172.21.15.137:0/1614648929 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc0d1b70 con 0x7fe4dc15e8c0 2024-04-20T21:19:07.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.463+0000 7fe4e0a00640 1 --2- 172.21.15.137:0/1614648929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc15e8c0 0x7fe4dc06ec40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00097a0 tx=0x7fe4d002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=debc12d320032099 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:07.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.463+0000 7fe4db400640 1 -- 172.21.15.137:0/1614648929 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0035020 con 0x7fe4dc15e8c0 2024-04-20T21:19:07.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.463+0000 7fe4db400640 1 -- 172.21.15.137:0/1614648929 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d0031830 con 0x7fe4dc15e8c0 2024-04-20T21:19:07.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.463+0000 7fe4db400640 1 -- 172.21.15.137:0/1614648929 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0031c00 con 0x7fe4dc15e8c0 2024-04-20T21:19:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.464+0000 7fe4e1e00640 1 -- 172.21.15.137:0/1614648929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc15e8c0 msgr2=0x7fe4dc06ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.464+0000 7fe4e1e00640 1 --2- 172.21.15.137:0/1614648929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc15e8c0 0x7fe4dc06ec40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00097a0 tx=0x7fe4d002b8d0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.464+0000 7fe4e1e00640 1 -- 172.21.15.137:0/1614648929 shutdown_connections 2024-04-20T21:19:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.464+0000 7fe4e1e00640 1 --2- 172.21.15.137:0/1614648929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc15e8c0 0x7fe4dc06ec40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.464+0000 7fe4e1e00640 1 -- 172.21.15.137:0/1614648929 >> 172.21.15.137:0/1614648929 conn(0x7fe4dc09d6f0 msgr2=0x7fe4dc0b9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.464+0000 7fe4e1e00640 1 -- 172.21.15.137:0/1614648929 shutdown_connections 2024-04-20T21:19:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.464+0000 7fe4e1e00640 1 -- 172.21.15.137:0/1614648929 wait complete. 2024-04-20T21:19:07.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.466+0000 7fe4e1e00640 1 Processor -- start 2024-04-20T21:19:07.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.466+0000 7fe4e1e00640 1 -- start start 2024-04-20T21:19:07.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4e1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4dc0d1010 0x7fe4dc1f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4e1e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4dc0d46f0 0x7fe4dc0cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4e1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc15e8c0 0x7fe4dc0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4e1e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc06f180 con 0x7fe4dc0d1010 2024-04-20T21:19:07.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4e1e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc0b6170 con 0x7fe4dc15e8c0 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4e1e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe4dc0d0120 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4e1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc15e8c0 0x7fe4dc0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4dbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4dc0d46f0 0x7fe4dc0cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4e1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc15e8c0 0x7fe4dc0cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56764/0 (socket says 172.21.15.137:56764) 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4dbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4dc0d46f0 0x7fe4dc0cd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41834/0 (socket says 172.21.15.137:41834) 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4e1400640 1 -- 172.21.15.137:0/2017932562 learned_addr learned my addr 172.21.15.137:0/2017932562 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.467+0000 7fe4e0a00640 1 --2- 172.21.15.137:0/2017932562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4dc0d1010 0x7fe4dc1f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4dbe00640 1 -- 172.21.15.137:0/2017932562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc15e8c0 msgr2=0x7fe4dc0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4dbe00640 1 --2- 172.21.15.137:0/2017932562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc15e8c0 0x7fe4dc0cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4dbe00640 1 -- 172.21.15.137:0/2017932562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4dc0d1010 msgr2=0x7fe4dc1f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4dbe00640 1 --2- 172.21.15.137:0/2017932562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4dc0d1010 0x7fe4dc1f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4dbe00640 1 -- 172.21.15.137:0/2017932562 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc159120 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4e1400640 1 --2- 172.21.15.137:0/2017932562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc15e8c0 0x7fe4dc0cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4dbe00640 1 --2- 172.21.15.137:0/2017932562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4dc0d46f0 0x7fe4dc0cd210 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800c440 tx=0x7fe4c800c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:07.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4d8c00640 1 -- 172.21.15.137:0/2017932562 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8011790 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4d8c00640 1 -- 172.21.15.137:0/2017932562 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c8017070 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4e1e00640 1 -- 172.21.15.137:0/2017932562 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4dc159400 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4d8c00640 1 -- 172.21.15.137:0/2017932562 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8011b70 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.468+0000 7fe4e1e00640 1 -- 172.21.15.137:0/2017932562 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4dc1599c0 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.469+0000 7fe4d8c00640 1 -- 172.21.15.137:0/2017932562 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe4c8011d10 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.469+0000 7fe4d8c00640 1 -- 172.21.15.137:0/2017932562 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fe4c8012c40 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.469+0000 7fe4e1e00640 1 -- 172.21.15.137:0/2017932562 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4dc075b30 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.472+0000 7fe4d8c00640 1 -- 172.21.15.137:0/2017932562 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fe4c8012650 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.550+0000 7fe4e1e00640 1 -- 172.21.15.137:0/2017932562 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f5ed051c-e34c-4d88-90a7-612c88d5b6cc", "id": 6} v 0) -- 0x7fe4dc0caa20 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.557+0000 7fe4d8c00640 1 -- 172.21.15.137:0/2017932562 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f5ed051c-e34c-4d88-90a7-612c88d5b6cc", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fe4c8012830 con 0x7fe4dc0d46f0 2024-04-20T21:19:07.557 INFO:teuthology.orchestra.run.smithi137.stdout:6 2024-04-20T21:19:07.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.559+0000 7fe4e1e00640 1 -- 172.21.15.137:0/2017932562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4dc0d46f0 msgr2=0x7fe4dc0cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.559+0000 7fe4e1e00640 1 --2- 172.21.15.137:0/2017932562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4dc0d46f0 0x7fe4dc0cd210 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800c440 tx=0x7fe4c800c900 comp rx=0 tx=0).stop 2024-04-20T21:19:07.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.559+0000 7fe4e1e00640 1 -- 172.21.15.137:0/2017932562 shutdown_connections 2024-04-20T21:19:07.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.559+0000 7fe4e1e00640 1 --2- 172.21.15.137:0/2017932562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc15e8c0 0x7fe4dc0cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.559+0000 7fe4e1e00640 1 --2- 172.21.15.137:0/2017932562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4dc0d46f0 0x7fe4dc0cd210 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.559+0000 7fe4e1e00640 1 --2- 172.21.15.137:0/2017932562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4dc0d1010 0x7fe4dc1f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.559+0000 7fe4e1e00640 1 -- 172.21.15.137:0/2017932562 >> 172.21.15.137:0/2017932562 conn(0x7fe4dc09d6f0 msgr2=0x7fe4dc0b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:07.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.559+0000 7fe4e1e00640 1 -- 172.21.15.137:0/2017932562 shutdown_connections 2024-04-20T21:19:07.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.559+0000 7fe4e1e00640 1 -- 172.21.15.137:0/2017932562 wait complete. 2024-04-20T21:19:07.575 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 96df7b9e-3d3e-43e3-bfb2-df648e4fbc66 7 2024-04-20T21:19:07.576 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:07.576+0000 7fa7defbd040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T21:19:07.668 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:07.669+0000 7f0ddfbb8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T21:19:07.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.749+0000 7fca43600640 1 Processor -- start 2024-04-20T21:19:07.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.749+0000 7fca43600640 1 -- start start 2024-04-20T21:19:07.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.750+0000 7fca43600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d0380 0x7fca3c0d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.750+0000 7fca43600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3c0d1e90 con 0x7fca3c0d1a00 2024-04-20T21:19:07.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.750+0000 7fca43600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3c0d0d50 con 0x7fca3c0d4270 2024-04-20T21:19:07.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.750+0000 7fca43600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fca3c0d40c0 con 0x7fca3c0d0380 2024-04-20T21:19:07.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.751+0000 7fca40c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fca3c0d4270 0x7fca3c0d4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48564/0 (socket says 172.21.15.137:48564) 2024-04-20T21:19:07.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.751+0000 7fca40c00640 1 -- 172.21.15.137:0/787789711 learned_addr learned my addr 172.21.15.137:0/787789711 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-20T21:19:07.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.751+0000 7fca41600640 1 --2- 172.21.15.137:0/787789711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d0380 0x7fca3c0d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.751+0000 7fca3b400640 1 -- 172.21.15.137:0/787789711 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1960176332 0 0) 0x7fca3c0d0d50 con 0x7fca3c0d4270 2024-04-20T21:19:07.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.751+0000 7fca3b400640 1 -- 172.21.15.137:0/787789711 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca24003520 con 0x7fca3c0d4270 2024-04-20T21:19:07.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.751+0000 7fca41600640 1 -- 172.21.15.137:0/787789711 >> v1:172.21.15.137:6789/0 conn(0x7fca3c0d4270 legacy=0x7fca3c0d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.751+0000 7fca41600640 1 -- 172.21.15.137:0/787789711 >> v1:172.21.15.71:6789/0 conn(0x7fca3c0d1a00 legacy=0x7fca3c0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.751+0000 7fca41600640 1 -- 172.21.15.137:0/787789711 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c0d3820 con 0x7fca3c0d0380 2024-04-20T21:19:07.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.752+0000 7fca41600640 1 --2- 172.21.15.137:0/787789711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d0380 0x7fca3c0d0810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fca34009dc0 tx=0x7fca3402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d43bf26e066f86a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:07.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.753+0000 7fca3b400640 1 -- 172.21.15.137:0/787789711 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34039070 con 0x7fca3c0d0380 2024-04-20T21:19:07.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.753+0000 7fca3b400640 1 -- 172.21.15.137:0/787789711 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3402ccd0 con 0x7fca3c0d0380 2024-04-20T21:19:07.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.753+0000 7fca3b400640 1 -- 172.21.15.137:0/787789711 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34034660 con 0x7fca3c0d0380 2024-04-20T21:19:07.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.753+0000 7fca43600640 1 -- 172.21.15.137:0/787789711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d0380 msgr2=0x7fca3c0d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.753+0000 7fca43600640 1 --2- 172.21.15.137:0/787789711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d0380 0x7fca3c0d0810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fca34009dc0 tx=0x7fca3402bf20 comp rx=0 tx=0).stop 2024-04-20T21:19:07.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.753+0000 7fca43600640 1 -- 172.21.15.137:0/787789711 shutdown_connections 2024-04-20T21:19:07.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.753+0000 7fca43600640 1 --2- 172.21.15.137:0/787789711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d0380 0x7fca3c0d0810 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.753+0000 7fca43600640 1 -- 172.21.15.137:0/787789711 >> 172.21.15.137:0/787789711 conn(0x7fca3c0b99c0 msgr2=0x7fca3c0b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:07.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.754+0000 7fca43600640 1 -- 172.21.15.137:0/787789711 shutdown_connections 2024-04-20T21:19:07.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.754+0000 7fca43600640 1 -- 172.21.15.137:0/787789711 wait complete. 2024-04-20T21:19:07.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.755+0000 7fca43600640 1 Processor -- start 2024-04-20T21:19:07.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.755+0000 7fca43600640 1 -- start start 2024-04-20T21:19:07.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.756+0000 7fca43600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca3c0d0380 0x7fca3c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.756+0000 7fca43600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d1a00 0x7fca3c0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.756+0000 7fca43600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c0d4270 0x7fca3c1f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:07.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.756+0000 7fca43600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c0cfe60 con 0x7fca3c0d4270 2024-04-20T21:19:07.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.756+0000 7fca43600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c0d3de0 con 0x7fca3c0d0380 2024-04-20T21:19:07.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.756+0000 7fca43600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fca3c0b19a0 con 0x7fca3c0d1a00 2024-04-20T21:19:07.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.756+0000 7fca40c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca3c0d0380 0x7fca3c06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca3be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d1a00 0x7fca3c0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca40c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca3c0d0380 0x7fca3c06d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56776/0 (socket says 172.21.15.137:56776) 2024-04-20T21:19:07.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca3be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d1a00 0x7fca3c0ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:41848/0 (socket says 172.21.15.137:41848) 2024-04-20T21:19:07.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca40c00640 1 -- 172.21.15.137:0/4194231670 learned_addr learned my addr 172.21.15.137:0/4194231670 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-20T21:19:07.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca41600640 1 --2- 172.21.15.137:0/4194231670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c0d4270 0x7fca3c1f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:07.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca40c00640 1 -- 172.21.15.137:0/4194231670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d1a00 msgr2=0x7fca3c0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca40c00640 1 --2- 172.21.15.137:0/4194231670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d1a00 0x7fca3c0ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca40c00640 1 -- 172.21.15.137:0/4194231670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c0d4270 msgr2=0x7fca3c1f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca40c00640 1 --2- 172.21.15.137:0/4194231670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c0d4270 0x7fca3c1f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca40c00640 1 -- 172.21.15.137:0/4194231670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c06df90 con 0x7fca3c0d0380 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca3be00640 1 --2- 172.21.15.137:0/4194231670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d1a00 0x7fca3c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.757+0000 7fca40c00640 1 --2- 172.21.15.137:0/4194231670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca3c0d0380 0x7fca3c06d9b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca3000c410 tx=0x7fca3000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.758+0000 7fca38c00640 1 -- 172.21.15.137:0/4194231670 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30017070 con 0x7fca3c0d0380 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.758+0000 7fca38c00640 1 -- 172.21.15.137:0/4194231670 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca30005ce0 con 0x7fca3c0d0380 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.758+0000 7fca38c00640 1 -- 172.21.15.137:0/4194231670 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca300072f0 con 0x7fca3c0d0380 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.758+0000 7fca43600640 1 -- 172.21.15.137:0/4194231670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3c06e270 con 0x7fca3c0d0380 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.758+0000 7fca43600640 1 -- 172.21.15.137:0/4194231670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3c0cac10 con 0x7fca3c0d0380 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.758+0000 7fca38c00640 1 -- 172.21.15.137:0/4194231670 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca3001a070 con 0x7fca3c0d0380 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.758+0000 7fca38c00640 1 -- 172.21.15.137:0/4194231670 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fca30007490 con 0x7fca3c0d0380 2024-04-20T21:19:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.759+0000 7fca43600640 1 -- 172.21.15.137:0/4194231670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3c0cb670 con 0x7fca3c0d0380 2024-04-20T21:19:07.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.761+0000 7fca38c00640 1 -- 172.21.15.137:0/4194231670 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fca30021020 con 0x7fca3c0d0380 2024-04-20T21:19:07.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.839+0000 7fca43600640 1 -- 172.21.15.137:0/4194231670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96df7b9e-3d3e-43e3-bfb2-df648e4fbc66", "id": 7} v 0) -- 0x7fca3c06e790 con 0x7fca3c0d0380 2024-04-20T21:19:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.847+0000 7fca38c00640 1 -- 172.21.15.137:0/4194231670 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96df7b9e-3d3e-43e3-bfb2-df648e4fbc66", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fca3c06e790 con 0x7fca3c0d0380 2024-04-20T21:19:07.847 INFO:teuthology.orchestra.run.smithi137.stdout:7 2024-04-20T21:19:07.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.848+0000 7fca43600640 1 -- 172.21.15.137:0/4194231670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca3c0d0380 msgr2=0x7fca3c06d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:07.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.848+0000 7fca43600640 1 --2- 172.21.15.137:0/4194231670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca3c0d0380 0x7fca3c06d9b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca3000c410 tx=0x7fca3000c8d0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.848+0000 7fca43600640 1 -- 172.21.15.137:0/4194231670 shutdown_connections 2024-04-20T21:19:07.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.848+0000 7fca43600640 1 --2- 172.21.15.137:0/4194231670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c0d4270 0x7fca3c1f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.848+0000 7fca43600640 1 --2- 172.21.15.137:0/4194231670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca3c0d1a00 0x7fca3c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.848+0000 7fca43600640 1 --2- 172.21.15.137:0/4194231670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca3c0d0380 0x7fca3c06d9b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:07.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.848+0000 7fca43600640 1 -- 172.21.15.137:0/4194231670 >> 172.21.15.137:0/4194231670 conn(0x7fca3c0b99c0 msgr2=0x7fca3c0d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:07.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.849+0000 7fca43600640 1 -- 172.21.15.137:0/4194231670 shutdown_connections 2024-04-20T21:19:07.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:19:07.849+0000 7fca43600640 1 -- 172.21.15.137:0/4194231670 wait complete. 2024-04-20T21:19:07.863 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-20T21:19:07.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-20T21:19:07.870 INFO:tasks.ceph.osd.0:Started 2024-04-20T21:19:07.870 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-20T21:19:07.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-20T21:19:07.872 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:07.872+0000 7fa7defbd040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T21:19:07.877 INFO:tasks.ceph.osd.1:Started 2024-04-20T21:19:07.877 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-20T21:19:07.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-20T21:19:07.884 INFO:tasks.ceph.osd.2:Started 2024-04-20T21:19:07.884 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-20T21:19:07.884 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-20T21:19:07.889 INFO:tasks.ceph.osd.3:Started 2024-04-20T21:19:07.889 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-20T21:19:07.889 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-20T21:19:07.894 INFO:tasks.ceph.osd.4:Started 2024-04-20T21:19:07.894 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-20T21:19:07.894 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-20T21:19:07.898 INFO:tasks.ceph.osd.5:Started 2024-04-20T21:19:07.898 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-20T21:19:07.898 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-20T21:19:07.902 INFO:tasks.ceph.osd.6:Started 2024-04-20T21:19:07.902 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-20T21:19:07.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-20T21:19:07.908 INFO:tasks.ceph.osd.7:Started 2024-04-20T21:19:07.909 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:07.954 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:07.954+0000 7fa7defbd040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T21:19:08.000 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:08.000+0000 7f0ddfbb8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T21:19:08.069 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:08.070+0000 7f0ddfbb8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T21:19:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.104+0000 7fd2b8200640 1 Processor -- start 2024-04-20T21:19:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.105+0000 7fd2b8200640 1 -- start start 2024-04-20T21:19:08.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.106+0000 7fd2b8200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2b00d1a00 0x7fd2b00b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:08.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.106+0000 7fd2b8200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd2b00b17d0 0x7fd2b00d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:08.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.106+0000 7fd2b8200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b00d1e90 con 0x7fd2b00d4270 2024-04-20T21:19:08.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.106+0000 7fd2b8200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b00d40c0 con 0x7fd2b00b17d0 2024-04-20T21:19:08.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.106+0000 7fd2b8200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b00d3820 con 0x7fd2b00d1a00 2024-04-20T21:19:08.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.106+0000 7fd2b6200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd2b00b17d0 0x7fd2b00d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:08.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.106+0000 7fd2b4e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2b00d1a00 0x7fd2b00b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:08.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.106+0000 7fd2b6200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd2b00b17d0 0x7fd2b00d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59076/0 (socket says 172.21.15.71:59076) 2024-04-20T21:19:08.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.106+0000 7fd2b6200640 1 -- 172.21.15.71:0/4246209865 learned_addr learned my addr 172.21.15.71:0/4246209865 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:08.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.107+0000 7fd2b6200640 1 -- 172.21.15.71:0/4246209865 >> v2:172.21.15.137:3300/0 conn(0x7fd2b00d1a00 msgr2=0x7fd2b00b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:08.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.107+0000 7fd2b6200640 1 --2- 172.21.15.71:0/4246209865 >> v2:172.21.15.137:3300/0 conn(0x7fd2b00d1a00 0x7fd2b00b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:08.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.107+0000 7fd2b6200640 1 -- 172.21.15.71:0/4246209865 >> v1:172.21.15.71:6789/0 conn(0x7fd2b00d4270 legacy=0x7fd2b00d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:08.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.107+0000 7fd2afe00640 1 -- 172.21.15.71:0/4246209865 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 197338601 0 0) 0x7fd2a4001110 con 0x7fd2b00d4270 2024-04-20T21:19:08.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.107+0000 7fd2b6200640 1 -- 172.21.15.71:0/4246209865 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b00d3b00 con 0x7fd2b00b17d0 2024-04-20T21:19:08.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.108+0000 7fd2b6200640 1 --2- 172.21.15.71:0/4246209865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b00b17d0 0x7fd2b00d0380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00b8060 tx=0x7fd2a802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3589cceaff2484 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:08.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.108+0000 7fd2afe00640 1 -- 172.21.15.71:0/4246209865 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a802cb20 con 0x7fd2b00b17d0 2024-04-20T21:19:08.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.108+0000 7fd2afe00640 1 -- 172.21.15.71:0/4246209865 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a802ccc0 con 0x7fd2b00b17d0 2024-04-20T21:19:08.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.108+0000 7fd2afe00640 1 -- 172.21.15.71:0/4246209865 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8034610 con 0x7fd2b00b17d0 2024-04-20T21:19:08.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.109+0000 7fd2b8200640 1 -- 172.21.15.71:0/4246209865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b00b17d0 msgr2=0x7fd2b00d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:08.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.109+0000 7fd2b8200640 1 --2- 172.21.15.71:0/4246209865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b00b17d0 0x7fd2b00d0380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00b8060 tx=0x7fd2a802bf80 comp rx=0 tx=0).stop 2024-04-20T21:19:08.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.109+0000 7fd2b8200640 1 -- 172.21.15.71:0/4246209865 shutdown_connections 2024-04-20T21:19:08.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.109+0000 7fd2b8200640 1 --2- 172.21.15.71:0/4246209865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b00b17d0 0x7fd2b00d0380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:08.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.109+0000 7fd2b8200640 1 --2- 172.21.15.71:0/4246209865 >> v2:172.21.15.137:3300/0 conn(0x7fd2b00d1a00 0x7fd2b00b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:08.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.109+0000 7fd2b8200640 1 -- 172.21.15.71:0/4246209865 >> 172.21.15.71:0/4246209865 conn(0x7fd2b00b99c0 msgr2=0x7fd2b00b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:08.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.109+0000 7fd2b8200640 1 -- 172.21.15.71:0/4246209865 shutdown_connections 2024-04-20T21:19:08.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.109+0000 7fd2b8200640 1 -- 172.21.15.71:0/4246209865 wait complete. 2024-04-20T21:19:08.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.111+0000 7fd2b8200640 1 Processor -- start 2024-04-20T21:19:08.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.111+0000 7fd2b8200640 1 -- start start 2024-04-20T21:19:08.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.112+0000 7fd2b8200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b00b17d0 0x7fd2b00cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.112+0000 7fd2b8200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b00d1a00 0x7fd2b00cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.112+0000 7fd2b8200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2b00d4270 0x7fd2b015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.112+0000 7fd2b8200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b00d53b0 con 0x7fd2b00b17d0 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.112+0000 7fd2b8200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b00cfe60 con 0x7fd2b00d1a00 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.112+0000 7fd2b8200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b0161f70 con 0x7fd2b00d4270 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.112+0000 7fd2b5800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b00b17d0 0x7fd2b00cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.112+0000 7fd2b5800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b00b17d0 0x7fd2b00cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59080/0 (socket says 172.21.15.71:59080) 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.112+0000 7fd2b5800640 1 -- 172.21.15.71:0/131787612 learned_addr learned my addr 172.21.15.71:0/131787612 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.113+0000 7fd2b4e00640 1 --2- 172.21.15.71:0/131787612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b00d1a00 0x7fd2b00cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.113+0000 7fd2b6200640 1 --2- 172.21.15.71:0/131787612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2b00d4270 0x7fd2b015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.113+0000 7fd2b5800640 1 -- 172.21.15.71:0/131787612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2b00d4270 msgr2=0x7fd2b015b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.113+0000 7fd2b5800640 1 --2- 172.21.15.71:0/131787612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2b00d4270 0x7fd2b015b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:08.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.113+0000 7fd2b5800640 1 -- 172.21.15.71:0/131787612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b00d1a00 msgr2=0x7fd2b00cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:08.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.113+0000 7fd2b5800640 1 --2- 172.21.15.71:0/131787612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b00d1a00 0x7fd2b00cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:08.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.113+0000 7fd2b5800640 1 -- 172.21.15.71:0/131787612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b00cbd40 con 0x7fd2b00b17d0 2024-04-20T21:19:08.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.113+0000 7fd2b5800640 1 --2- 172.21.15.71:0/131787612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b00b17d0 0x7fd2b00cb6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c410 tx=0x7fd2a400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:08.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.113+0000 7fd2ad600640 1 -- 172.21.15.71:0/131787612 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4017070 con 0x7fd2b00b17d0 2024-04-20T21:19:08.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.114+0000 7fd2ad600640 1 -- 172.21.15.71:0/131787612 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a4003610 con 0x7fd2b00b17d0 2024-04-20T21:19:08.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.114+0000 7fd2ad600640 1 -- 172.21.15.71:0/131787612 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4003a00 con 0x7fd2b00b17d0 2024-04-20T21:19:08.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.114+0000 7fd2b8200640 1 -- 172.21.15.71:0/131787612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b00c7f50 con 0x7fd2b00b17d0 2024-04-20T21:19:08.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.114+0000 7fd2b8200640 1 -- 172.21.15.71:0/131787612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b00c8510 con 0x7fd2b00b17d0 2024-04-20T21:19:08.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.114+0000 7fd2ad600640 1 -- 172.21.15.71:0/131787612 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd2a401a070 con 0x7fd2b00b17d0 2024-04-20T21:19:08.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.114+0000 7fd2ad600640 1 -- 172.21.15.71:0/131787612 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd2a401cca0 con 0x7fd2b00b17d0 2024-04-20T21:19:08.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.115+0000 7fd2b8200640 1 -- 172.21.15.71:0/131787612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b0068980 con 0x7fd2b00b17d0 2024-04-20T21:19:08.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.117+0000 7fd2ad600640 1 -- 172.21.15.71:0/131787612 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fd2b00d1e90 con 0x7fd2b00b17d0 2024-04-20T21:19:08.131 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:08.132+0000 7fa7defbd040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T21:19:08.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.181+0000 7fd2b8200640 1 -- 172.21.15.71:0/131787612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2b006edb0 con 0x7fd2b00b17d0 2024-04-20T21:19:08.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.182+0000 7fd2ad600640 1 -- 172.21.15.71:0/131787612 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd2a4003cb0 con 0x7fd2b00b17d0 2024-04-20T21:19:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:08.182 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":10,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:07.841666+0000","last_up_change":"0.000000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:08.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.183+0000 7fd2b8200640 1 -- 172.21.15.71:0/131787612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b00b17d0 msgr2=0x7fd2b00cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:08.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.183+0000 7fd2b8200640 1 --2- 172.21.15.71:0/131787612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b00b17d0 0x7fd2b00cb6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c410 tx=0x7fd2a400c8d0 comp rx=0 tx=0).stop 2024-04-20T21:19:08.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.183+0000 7fd2b8200640 1 -- 172.21.15.71:0/131787612 shutdown_connections 2024-04-20T21:19:08.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.183+0000 7fd2b8200640 1 --2- 172.21.15.71:0/131787612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2b00d4270 0x7fd2b015b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:08.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.183+0000 7fd2b8200640 1 --2- 172.21.15.71:0/131787612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b00d1a00 0x7fd2b00cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:08.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.183+0000 7fd2b8200640 1 --2- 172.21.15.71:0/131787612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b00b17d0 0x7fd2b00cb6b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:08.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.183+0000 7fd2b8200640 1 -- 172.21.15.71:0/131787612 >> 172.21.15.71:0/131787612 conn(0x7fd2b00b99c0 msgr2=0x7fd2b00d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:08.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.183+0000 7fd2b8200640 1 -- 172.21.15.71:0/131787612 shutdown_connections 2024-04-20T21:19:08.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:08.184+0000 7fd2b8200640 1 -- 172.21.15.71:0/131787612 wait complete. 2024-04-20T21:19:08.199 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-20T21:19:08.200 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-20T21:19:08.205 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:08.205+0000 7f0ddfbb8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T21:19:08.475 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:08.475+0000 7fa7defbd040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T21:19:08.530 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:08.530+0000 7fa7defbd040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T21:19:08.533 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:08.533+0000 7f0ddfbb8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T21:19:08.572 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-20T21:19:08.572+0000 7f778691f640 -1 Falling back to public interface 2024-04-20T21:19:08.579 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-20T21:19:08.580+0000 7fab09c0c640 -1 Falling back to public interface 2024-04-20T21:19:08.590 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:08.591+0000 7f0ddfbb8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T21:19:08.597 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-20T21:19:08.597+0000 7f3db690f640 -1 Falling back to public interface 2024-04-20T21:19:08.603 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-20T21:19:08.604+0000 7f848ccb5640 -1 Falling back to public interface 2024-04-20T21:19:08.604 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-20T21:19:08.604+0000 7f788261d640 -1 Falling back to public interface 2024-04-20T21:19:08.605 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-20T21:19:08.605+0000 7f709440f640 -1 Falling back to public interface 2024-04-20T21:19:08.608 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-20T21:19:08.608+0000 7f6faa610640 -1 Falling back to public interface 2024-04-20T21:19:08.626 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-20T21:19:08.627+0000 7fa477e0d640 -1 Falling back to public interface 2024-04-20T21:19:08.726 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:08.726+0000 7fa7defbd040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T21:19:08.780 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:08.780+0000 7f0ddfbb8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T21:19:08.891 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:08.892+0000 7fa7defbd040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T21:19:08.949 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:08.949+0000 7f0ddfbb8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T21:19:08.951 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:08.952+0000 7fa7defbd040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T21:19:09.006 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:09.006 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:09.007+0000 7f0ddfbb8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T21:19:09.032 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:09.033+0000 7fa7defbd040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T21:19:09.086 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:09.086+0000 7f0ddfbb8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T21:19:09.088 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:09.088+0000 7fa7defbd040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T21:19:09.138 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:09.139+0000 7f0ddfbb8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T21:19:09.163 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.163+0000 7fb732600640 1 Processor -- start 2024-04-20T21:19:09.163 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.164+0000 7fb732600640 1 -- start start 2024-04-20T21:19:09.165 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.165+0000 7fb732600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c15e610 0x7fb72c162e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:09.165 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.165+0000 7fb732600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c0d1980 con 0x7fb72c0cfd90 2024-04-20T21:19:09.165 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.165+0000 7fb732600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c0d1c60 con 0x7fb72c15e9f0 2024-04-20T21:19:09.165 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.165+0000 7fb732600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c1629c0 con 0x7fb72c15e610 2024-04-20T21:19:09.165 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.165+0000 7fb731c00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb72c0cfd90 0x7fb72c0d30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33012/0 (socket says 172.21.15.71:33012) 2024-04-20T21:19:09.165 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.165+0000 7fb731c00640 1 -- 172.21.15.71:0/281669424 learned_addr learned my addr 172.21.15.71:0/281669424 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:09.165 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.166+0000 7fb731200640 1 --2- 172.21.15.71:0/281669424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c15e610 0x7fb72c162e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:09.166 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.166+0000 7fb72b400640 1 -- 172.21.15.71:0/281669424 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542973864 0 0) 0x7fb72c0d1980 con 0x7fb72c0cfd90 2024-04-20T21:19:09.166 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.166+0000 7fb72b400640 1 -- 172.21.15.71:0/281669424 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb714003520 con 0x7fb72c0cfd90 2024-04-20T21:19:09.166 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.166+0000 7fb731200640 1 -- 172.21.15.71:0/281669424 >> v1:172.21.15.137:6789/0 conn(0x7fb72c15e9f0 legacy=0x7fb72c0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:09.166 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.166+0000 7fb731200640 1 -- 172.21.15.71:0/281669424 >> v1:172.21.15.71:6789/0 conn(0x7fb72c0cfd90 legacy=0x7fb72c0d30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:09.166 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.166+0000 7fb731200640 1 -- 172.21.15.71:0/281669424 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c162650 con 0x7fb72c15e610 2024-04-20T21:19:09.167 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.167+0000 7fb731200640 1 --2- 172.21.15.71:0/281669424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c15e610 0x7fb72c162e50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097d0 tx=0x7fb72002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebe30fb960b2bf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:09.167 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.168+0000 7fb72b400640 1 -- 172.21.15.71:0/281669424 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720035020 con 0x7fb72c15e610 2024-04-20T21:19:09.167 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.168+0000 7fb72b400640 1 -- 172.21.15.71:0/281669424 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb720031890 con 0x7fb72c15e610 2024-04-20T21:19:09.167 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.168+0000 7fb72b400640 1 -- 172.21.15.71:0/281669424 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720031c40 con 0x7fb72c15e610 2024-04-20T21:19:09.168 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.168+0000 7fb732600640 1 -- 172.21.15.71:0/281669424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c15e610 msgr2=0x7fb72c162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:09.168 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.168+0000 7fb732600640 1 --2- 172.21.15.71:0/281669424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c15e610 0x7fb72c162e50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097d0 tx=0x7fb72002b930 comp rx=0 tx=0).stop 2024-04-20T21:19:09.168 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.168+0000 7fb732600640 1 -- 172.21.15.71:0/281669424 shutdown_connections 2024-04-20T21:19:09.168 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.168+0000 7fb732600640 1 --2- 172.21.15.71:0/281669424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c15e610 0x7fb72c162e50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:09.168 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.168+0000 7fb732600640 1 -- 172.21.15.71:0/281669424 >> 172.21.15.71:0/281669424 conn(0x7fb72c08bff0 msgr2=0x7fb72c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:09.168 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.168+0000 7fb732600640 1 -- 172.21.15.71:0/281669424 shutdown_connections 2024-04-20T21:19:09.169 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.168+0000 7fb732600640 1 -- 172.21.15.71:0/281669424 wait complete. 2024-04-20T21:19:09.169 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.170+0000 7fb732600640 1 Processor -- start 2024-04-20T21:19:09.170 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.170+0000 7fb732600640 1 -- start start 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.171+0000 7fb732600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c0cfd90 0x7fb72c15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.171+0000 7fb732600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb72c15e610 0x7fb72c06e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.171+0000 7fb732600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb72c15e9f0 0x7fb72c06e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.171+0000 7fb732600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c0b6d50 con 0x7fb72c15e9f0 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.171+0000 7fb732600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c162400 con 0x7fb72c15e610 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.171+0000 7fb732600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c0b6ed0 con 0x7fb72c0cfd90 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.171+0000 7fb731c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb72c15e9f0 0x7fb72c06e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.172+0000 7fb731200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c0cfd90 0x7fb72c15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.172+0000 7fb731c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb72c15e9f0 0x7fb72c06e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59086/0 (socket says 172.21.15.71:59086) 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.172+0000 7fb731c00640 1 -- 172.21.15.71:0/634656396 learned_addr learned my addr 172.21.15.71:0/634656396 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.172+0000 7fb72be00640 1 --2- 172.21.15.71:0/634656396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb72c15e610 0x7fb72c06e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.172+0000 7fb731c00640 1 -- 172.21.15.71:0/634656396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c0cfd90 msgr2=0x7fb72c15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:09.172 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.172+0000 7fb731c00640 1 --2- 172.21.15.71:0/634656396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c0cfd90 0x7fb72c15b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:09.173 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.172+0000 7fb731c00640 1 -- 172.21.15.71:0/634656396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb72c15e610 msgr2=0x7fb72c06e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:09.173 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.172+0000 7fb731c00640 1 --2- 172.21.15.71:0/634656396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb72c15e610 0x7fb72c06e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:09.173 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.172+0000 7fb731c00640 1 -- 172.21.15.71:0/634656396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c161290 con 0x7fb72c15e9f0 2024-04-20T21:19:09.173 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.172+0000 7fb731200640 1 --2- 172.21.15.71:0/634656396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c0cfd90 0x7fb72c15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:09.173 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.172+0000 7fb731c00640 1 --2- 172.21.15.71:0/634656396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb72c15e9f0 0x7fb72c06e570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb72400cb40 tx=0x7fb72400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:09.174 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.173+0000 7fb728c00640 1 -- 172.21.15.71:0/634656396 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724017070 con 0x7fb72c15e9f0 2024-04-20T21:19:09.174 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.173+0000 7fb728c00640 1 -- 172.21.15.71:0/634656396 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72400aca0 con 0x7fb72c15e9f0 2024-04-20T21:19:09.174 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.173+0000 7fb728c00640 1 -- 172.21.15.71:0/634656396 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724012620 con 0x7fb72c15e9f0 2024-04-20T21:19:09.174 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.173+0000 7fb732600640 1 -- 172.21.15.71:0/634656396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c161570 con 0x7fb72c15e9f0 2024-04-20T21:19:09.174 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.173+0000 7fb732600640 1 -- 172.21.15.71:0/634656396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c15bc10 con 0x7fb72c15e9f0 2024-04-20T21:19:09.174 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.173+0000 7fb728c00640 1 -- 172.21.15.71:0/634656396 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb72401a070 con 0x7fb72c15e9f0 2024-04-20T21:19:09.174 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.173+0000 7fb728c00640 1 -- 172.21.15.71:0/634656396 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb72401c440 con 0x7fb72c15e9f0 2024-04-20T21:19:09.174 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.174+0000 7fb732600640 1 -- 172.21.15.71:0/634656396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c06ef20 con 0x7fb72c15e9f0 2024-04-20T21:19:09.176 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.176+0000 7fb728c00640 1 -- 172.21.15.71:0/634656396 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fb72c06ef20 con 0x7fb72c15e9f0 2024-04-20T21:19:09.240 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.240+0000 7fb732600640 1 -- 172.21.15.71:0/634656396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb72c0b39d0 con 0x7fb72c15e9f0 2024-04-20T21:19:09.240 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.241+0000 7fb728c00640 1 -- 172.21.15.71:0/634656396 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb724021020 con 0x7fb72c15e9f0 2024-04-20T21:19:09.241 INFO:teuthology.misc.health.smithi071.stdout: 2024-04-20T21:19:09.241 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":10,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:07.841666+0000","last_up_change":"0.000000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:09.242 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.242+0000 7fb732600640 1 -- 172.21.15.71:0/634656396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb72c15e9f0 msgr2=0x7fb72c06e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:09.242 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.242+0000 7fb732600640 1 --2- 172.21.15.71:0/634656396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb72c15e9f0 0x7fb72c06e570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb72400cb40 tx=0x7fb72400a060 comp rx=0 tx=0).stop 2024-04-20T21:19:09.242 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.242+0000 7fb732600640 1 -- 172.21.15.71:0/634656396 shutdown_connections 2024-04-20T21:19:09.242 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.242+0000 7fb732600640 1 --2- 172.21.15.71:0/634656396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb72c15e9f0 0x7fb72c06e570 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:09.242 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.242+0000 7fb732600640 1 --2- 172.21.15.71:0/634656396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb72c15e610 0x7fb72c06e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:09.242 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.242+0000 7fb732600640 1 --2- 172.21.15.71:0/634656396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb72c0cfd90 0x7fb72c15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:09.242 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.242+0000 7fb732600640 1 -- 172.21.15.71:0/634656396 >> 172.21.15.71:0/634656396 conn(0x7fb72c08bff0 msgr2=0x7fb72c0b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:09.243 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.242+0000 7fb732600640 1 -- 172.21.15.71:0/634656396 shutdown_connections 2024-04-20T21:19:09.243 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:09.242+0000 7fb732600640 1 -- 172.21.15.71:0/634656396 wait complete. 2024-04-20T21:19:09.254 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-20T21:19:09.638 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:09.639+0000 7fa7defbd040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T21:19:09.678 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:09.678+0000 7f0ddfbb8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T21:19:09.772 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:09.772+0000 7fa7defbd040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T21:19:09.815 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-20T21:19:09.815+0000 7f0ddfbb8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T21:19:10.808 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:10.808+0000 7fa77e400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-20T21:19:10.809 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-20T21:19:10.809+0000 7fa77e400640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-20T21:19:12.017 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-20T21:19:12.018+0000 7fa477e0d640 -1 osd.3 0 log_to_monitors true 2024-04-20T21:19:12.048 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-20T21:19:12.049+0000 7f3db690f640 -1 osd.7 0 log_to_monitors true 2024-04-20T21:19:12.185 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-20T21:19:12.186+0000 7f778691f640 -1 osd.0 0 log_to_monitors true 2024-04-20T21:19:12.230 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-20T21:19:12.230+0000 7fab09c0c640 -1 osd.6 0 log_to_monitors true 2024-04-20T21:19:12.262 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-20T21:19:12.262+0000 7f848ccb5640 -1 osd.5 0 log_to_monitors true 2024-04-20T21:19:12.273 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-20T21:19:12.274+0000 7f788261d640 -1 osd.4 0 log_to_monitors true 2024-04-20T21:19:12.497 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-20T21:19:12.497+0000 7f6faa610640 -1 osd.1 0 log_to_monitors true 2024-04-20T21:19:12.510 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-20T21:19:12.511+0000 7f709440f640 -1 osd.2 0 log_to_monitors true 2024-04-20T21:19:16.061 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:16.198 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-20T21:19:16.199+0000 7fab04400640 -1 osd.6 0 waiting for initial osdmap 2024-04-20T21:19:16.206 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-20T21:19:16.207+0000 7faafa400640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:19:16.239 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-20T21:19:16.240+0000 7f3db1800640 -1 osd.7 0 waiting for initial osdmap 2024-04-20T21:19:16.250 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-20T21:19:16.250+0000 7f3da7800640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:19:16.251 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-20T21:19:16.251+0000 7f8487c00640 -1 osd.5 0 waiting for initial osdmap 2024-04-20T21:19:16.265 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-20T21:19:16.266+0000 7fa472600640 -1 osd.3 0 waiting for initial osdmap 2024-04-20T21:19:16.265 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-20T21:19:16.266+0000 7f847dc00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:19:16.271 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-20T21:19:16.273+0000 7f708ec00640 -1 osd.2 0 waiting for initial osdmap 2024-04-20T21:19:16.273 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-20T21:19:16.273+0000 7f787d000640 -1 osd.4 0 waiting for initial osdmap 2024-04-20T21:19:16.278 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-20T21:19:16.279+0000 7fa468600640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:19:16.282 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-20T21:19:16.283+0000 7f7084c00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:19:16.285 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-20T21:19:16.285+0000 7f7873000640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:19:16.297 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-20T21:19:16.299+0000 7f6fa5000640 -1 osd.1 0 waiting for initial osdmap 2024-04-20T21:19:16.300 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.301+0000 7fc97ee00640 1 Processor -- start 2024-04-20T21:19:16.300 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.301+0000 7fc97ee00640 1 -- start start 2024-04-20T21:19:16.302 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-20T21:19:16.303+0000 7f6f9b000640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:19:16.302 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.303+0000 7fc97ee00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc97815e900 0x7fc9780d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:16.302 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.303+0000 7fc97ee00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9780d5150 0x7fc9780cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:16.303 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.303+0000 7fc97ee00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc97815ece0 con 0x7fc9780d3c50 2024-04-20T21:19:16.304 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.303+0000 7fc97ee00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc9780b6f60 con 0x7fc9780d5150 2024-04-20T21:19:16.304 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.303+0000 7fc97ee00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc9780b61a0 con 0x7fc97815e900 2024-04-20T21:19:16.304 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.304+0000 7fc97ce00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9780d5150 0x7fc9780cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:16.304 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.304+0000 7fc97ce00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9780d5150 0x7fc9780cfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59676/0 (socket says 172.21.15.71:59676) 2024-04-20T21:19:16.304 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.304+0000 7fc97ce00640 1 -- 172.21.15.71:0/3306187675 learned_addr learned my addr 172.21.15.71:0/3306187675 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:16.304 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.304+0000 7fc977e00640 1 --2- 172.21.15.71:0/3306187675 >> v2:172.21.15.137:3300/0 conn(0x7fc97815e900 0x7fc9780d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:16.304 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.304+0000 7fc97ce00640 1 -- 172.21.15.71:0/3306187675 >> v2:172.21.15.137:3300/0 conn(0x7fc97815e900 msgr2=0x7fc9780d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:16.304 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.304+0000 7fc97ce00640 1 --2- 172.21.15.71:0/3306187675 >> v2:172.21.15.137:3300/0 conn(0x7fc97815e900 0x7fc9780d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:16.304 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.304+0000 7fc97ce00640 1 -- 172.21.15.71:0/3306187675 >> v1:172.21.15.137:6789/0 conn(0x7fc9780d3c50 legacy=0x7fc9780d4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:16.304 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.304+0000 7fc97ce00640 1 -- 172.21.15.71:0/3306187675 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9780b6480 con 0x7fc9780d5150 2024-04-20T21:19:16.304 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.304+0000 7fc977e00640 1 --2- 172.21.15.71:0/3306187675 >> v2:172.21.15.137:3300/0 conn(0x7fc97815e900 0x7fc9780d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.306+0000 7fc97ce00640 1 --2- 172.21.15.71:0/3306187675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9780d5150 0x7fc9780cfa10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc970009e50 tx=0x7fc97002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa63dd3a5b37366 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.306+0000 7fc976a00640 1 -- 172.21.15.71:0/3306187675 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97002cb20 con 0x7fc9780d5150 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.306+0000 7fc976a00640 1 -- 172.21.15.71:0/3306187675 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc97002ccc0 con 0x7fc9780d5150 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.306+0000 7fc976a00640 1 -- 172.21.15.71:0/3306187675 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970034610 con 0x7fc9780d5150 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.307+0000 7fc97ee00640 1 -- 172.21.15.71:0/3306187675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9780d5150 msgr2=0x7fc9780cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.307+0000 7fc97ee00640 1 --2- 172.21.15.71:0/3306187675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9780d5150 0x7fc9780cfa10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc970009e50 tx=0x7fc97002bf80 comp rx=0 tx=0).stop 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.307+0000 7fc97ee00640 1 -- 172.21.15.71:0/3306187675 shutdown_connections 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.307+0000 7fc97ee00640 1 --2- 172.21.15.71:0/3306187675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9780d5150 0x7fc9780cfa10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.307+0000 7fc97ee00640 1 --2- 172.21.15.71:0/3306187675 >> v2:172.21.15.137:3300/0 conn(0x7fc97815e900 0x7fc9780d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.307+0000 7fc97ee00640 1 -- 172.21.15.71:0/3306187675 >> 172.21.15.71:0/3306187675 conn(0x7fc9780b9720 msgr2=0x7fc9780b9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.307+0000 7fc97ee00640 1 -- 172.21.15.71:0/3306187675 shutdown_connections 2024-04-20T21:19:16.306 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.307+0000 7fc97ee00640 1 -- 172.21.15.71:0/3306187675 wait complete. 2024-04-20T21:19:16.308 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.310+0000 7fc97ee00640 1 Processor -- start 2024-04-20T21:19:16.308 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.310+0000 7fc97ee00640 1 -- start start 2024-04-20T21:19:16.311 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.311+0000 7fc97ee00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9780d3c50 0x7fc97806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:16.311 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.311+0000 7fc97ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9780d5150 0x7fc9780b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:16.311 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.311+0000 7fc97ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc97815e900 0x7fc9780b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:16.311 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.311+0000 7fc97ee00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc9780d1c60 con 0x7fc9780d3c50 2024-04-20T21:19:16.311 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.311+0000 7fc97ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9780b6a40 con 0x7fc97815e900 2024-04-20T21:19:16.311 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.311+0000 7fc97ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc9780d1de0 con 0x7fc9780d5150 2024-04-20T21:19:16.311 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.312+0000 7fc977e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9780d3c50 0x7fc97806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:16.311 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.312+0000 7fc977e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9780d3c50 0x7fc97806d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59692/0 (socket says 172.21.15.71:59692) 2024-04-20T21:19:16.311 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.312+0000 7fc977e00640 1 -- 172.21.15.71:0/298085422 learned_addr learned my addr 172.21.15.71:0/298085422 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:16.311 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.312+0000 7fc977400640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9780d5150 0x7fc9780b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:16.312 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.312+0000 7fc97ce00640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc97815e900 0x7fc9780b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:16.312 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.312+0000 7fc977e00640 1 -- 172.21.15.71:0/298085422 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9780d5150 msgr2=0x7fc9780b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:16.312 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.312+0000 7fc977e00640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9780d5150 0x7fc9780b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:16.312 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.312+0000 7fc977e00640 1 -- 172.21.15.71:0/298085422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc97815e900 msgr2=0x7fc9780b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:16.312 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.312+0000 7fc977e00640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc97815e900 0x7fc9780b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:16.312 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.312+0000 7fc977e00640 1 -- 172.21.15.71:0/298085422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97815eed0 con 0x7fc9780d3c50 2024-04-20T21:19:16.312 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.312+0000 7fc977e00640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9780d3c50 0x7fc97806d4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc96800d800 tx=0x7fc96800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:16.313 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.313+0000 7fc96fe00640 1 -- 172.21.15.71:0/298085422 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968004030 con 0x7fc9780d3c50 2024-04-20T21:19:16.313 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.313+0000 7fc96fe00640 1 -- 172.21.15.71:0/298085422 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9680041d0 con 0x7fc9780d3c50 2024-04-20T21:19:16.313 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.313+0000 7fc96fe00640 1 -- 172.21.15.71:0/298085422 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9680096a0 con 0x7fc9780d3c50 2024-04-20T21:19:16.313 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.313+0000 7fc97ee00640 1 -- 172.21.15.71:0/298085422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97815f1b0 con 0x7fc9780d3c50 2024-04-20T21:19:16.313 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.313+0000 7fc97ee00640 1 -- 172.21.15.71:0/298085422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97815f770 con 0x7fc9780d3c50 2024-04-20T21:19:16.313 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.314+0000 7fc97ee00640 1 -- 172.21.15.71:0/298085422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc978069430 con 0x7fc9780d3c50 2024-04-20T21:19:16.315 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.316+0000 7fc96fe00640 1 -- 172.21.15.71:0/298085422 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fc968009840 con 0x7fc9780d3c50 2024-04-20T21:19:16.316 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.317+0000 7fc96fe00640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc95806c860 0x7fc95806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:16.316 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.317+0000 7fc96fe00640 1 -- 172.21.15.71:0/298085422 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fc96808aea0 con 0x7fc9780d3c50 2024-04-20T21:19:16.316 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.317+0000 7fc977400640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc95806c860 0x7fc95806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:16.316 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.318+0000 7fc977400640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc95806c860 0x7fc95806ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc9780b34d0 tx=0x7fc964009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:16.321 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.323+0000 7fc96fe00640 1 -- 172.21.15.71:0/298085422 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc968059a90 con 0x7fc9780d3c50 2024-04-20T21:19:16.348 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-20T21:19:16.349+0000 7f7781800640 -1 osd.0 0 waiting for initial osdmap 2024-04-20T21:19:16.354 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-20T21:19:16.356+0000 7f7777800640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:19:16.514 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.515+0000 7fc97ee00640 1 -- 172.21.15.71:0/298085422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9780b4780 con 0x7fc9780d3c50 2024-04-20T21:19:16.515 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.516+0000 7fc96fe00640 1 -- 172.21.15.71:0/298085422 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fc96805dd90 con 0x7fc9780d3c50 2024-04-20T21:19:16.515 INFO:teuthology.misc.health.smithi071.stdout: 2024-04-20T21:19:16.515 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":12,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:13.815052+0000","last_up_change":"0.000000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:16.518 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 -- 172.21.15.71:0/298085422 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc95806c860 msgr2=0x7fc95806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:16.518 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc95806c860 0x7fc95806ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc9780b34d0 tx=0x7fc964009040 comp rx=0 tx=0).stop 2024-04-20T21:19:16.518 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 -- 172.21.15.71:0/298085422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9780d3c50 msgr2=0x7fc97806d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:16.518 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9780d3c50 0x7fc97806d4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc96800d800 tx=0x7fc96800dcc0 comp rx=0 tx=0).stop 2024-04-20T21:19:16.518 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 -- 172.21.15.71:0/298085422 shutdown_connections 2024-04-20T21:19:16.518 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc95806c860 0x7fc95806ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:16.518 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc97815e900 0x7fc9780b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:16.518 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9780d5150 0x7fc9780b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:16.518 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 --2- 172.21.15.71:0/298085422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9780d3c50 0x7fc97806d4d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:16.518 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 -- 172.21.15.71:0/298085422 >> 172.21.15.71:0/298085422 conn(0x7fc9780b9720 msgr2=0x7fc9780b4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:16.519 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 -- 172.21.15.71:0/298085422 shutdown_connections 2024-04-20T21:19:16.519 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:16.519+0000 7fc97ee00640 1 -- 172.21.15.71:0/298085422 wait complete. 2024-04-20T21:19:16.531 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-20T21:19:22.281 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:19:22.289 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:19:23.337 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:23.519 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.520+0000 7f8307e00640 1 Processor -- start 2024-04-20T21:19:23.519 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.520+0000 7f8307e00640 1 -- start start 2024-04-20T21:19:23.520 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f8307e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f830815e780 0x7f83080d42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:23.521 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f8307e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f83080b6d00 0x7f83080d4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:23.521 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f8307e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83080d1ca0 con 0x7f83080d3cb0 2024-04-20T21:19:23.521 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f8307e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f83080d4d60 con 0x7f83080b6d00 2024-04-20T21:19:23.521 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f8307e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f83080b6240 con 0x7f830815e780 2024-04-20T21:19:23.521 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f82fe000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f83080b6d00 0x7f83080d4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:23.521 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f82fe000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f83080b6d00 0x7f83080d4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41452/0 (socket says 172.21.15.71:41452) 2024-04-20T21:19:23.521 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f82fe000640 1 -- 172.21.15.71:0/1733257449 learned_addr learned my addr 172.21.15.71:0/1733257449 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:23.521 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f82fe000640 1 -- 172.21.15.71:0/1733257449 >> v2:172.21.15.137:3300/0 conn(0x7f830815e780 msgr2=0x7f83080d42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:23.522 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f82fe000640 1 --2- 172.21.15.71:0/1733257449 >> v2:172.21.15.137:3300/0 conn(0x7f830815e780 0x7f83080d42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.522 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f82fe000640 1 -- 172.21.15.71:0/1733257449 >> v1:172.21.15.137:6789/0 conn(0x7f83080d3cb0 legacy=0x7f83080d21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:23.522 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.522+0000 7f82fe000640 1 -- 172.21.15.71:0/1733257449 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83080b6520 con 0x7f83080b6d00 2024-04-20T21:19:23.522 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.523+0000 7f82fe000640 1 --2- 172.21.15.71:0/1733257449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83080b6d00 0x7f83080d4820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f83080b9db0 tx=0x7f82f002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306426c0bcc86a14 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:23.522 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.524+0000 7f8306000640 1 -- 172.21.15.71:0/1733257449 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f002e070 con 0x7f83080b6d00 2024-04-20T21:19:23.523 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.524+0000 7f8306000640 1 -- 172.21.15.71:0/1733257449 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f0037070 con 0x7f83080b6d00 2024-04-20T21:19:23.523 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.524+0000 7f8306000640 1 -- 172.21.15.71:0/1733257449 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0031a00 con 0x7f83080b6d00 2024-04-20T21:19:23.523 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.524+0000 7f8307e00640 1 -- 172.21.15.71:0/1733257449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83080b6d00 msgr2=0x7f83080d4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:23.524 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.524+0000 7f8307e00640 1 --2- 172.21.15.71:0/1733257449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83080b6d00 0x7f83080d4820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f83080b9db0 tx=0x7f82f002b880 comp rx=0 tx=0).stop 2024-04-20T21:19:23.524 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.524+0000 7f8307e00640 1 -- 172.21.15.71:0/1733257449 shutdown_connections 2024-04-20T21:19:23.524 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.524+0000 7f8307e00640 1 --2- 172.21.15.71:0/1733257449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83080b6d00 0x7f83080d4820 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.524 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.524+0000 7f8307e00640 1 --2- 172.21.15.71:0/1733257449 >> v2:172.21.15.137:3300/0 conn(0x7f830815e780 0x7f83080d42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.524 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.524+0000 7f8307e00640 1 -- 172.21.15.71:0/1733257449 >> 172.21.15.71:0/1733257449 conn(0x7f830809d8f0 msgr2=0x7f83080b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:23.524 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.525+0000 7f8307e00640 1 -- 172.21.15.71:0/1733257449 shutdown_connections 2024-04-20T21:19:23.524 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.525+0000 7f8307e00640 1 -- 172.21.15.71:0/1733257449 wait complete. 2024-04-20T21:19:23.525 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.526+0000 7f8307e00640 1 Processor -- start 2024-04-20T21:19:23.525 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.526+0000 7f8307e00640 1 -- start start 2024-04-20T21:19:23.527 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.527+0000 7f8307e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83080b6d00 0x7f83080ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:23.527 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.527+0000 7f8307e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83080d3cb0 0x7f83080c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:23.527 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.527+0000 7f8307e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f830815e780 0x7f8308160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:23.527 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.527+0000 7f8307e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83080d1940 con 0x7f83080d3cb0 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.527+0000 7f8307e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83080d17c0 con 0x7f830815e780 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.527+0000 7f8307e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f830815eb60 con 0x7f83080b6d00 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f82fe000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83080d3cb0 0x7f83080c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f82fe000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83080d3cb0 0x7f83080c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41454/0 (socket says 172.21.15.71:41454) 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f82fe000640 1 -- 172.21.15.71:0/4148445362 learned_addr learned my addr 172.21.15.71:0/4148445362 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f8306a00640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83080b6d00 0x7f83080ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f8307400640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f830815e780 0x7f8308160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f82fe000640 1 -- 172.21.15.71:0/4148445362 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83080b6d00 msgr2=0x7f83080ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f82fe000640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83080b6d00 0x7f83080ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f82fe000640 1 -- 172.21.15.71:0/4148445362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f830815e780 msgr2=0x7f8308160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f82fe000640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f830815e780 0x7f8308160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f82fe000640 1 -- 172.21.15.71:0/4148445362 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83081e8fc0 con 0x7f83080d3cb0 2024-04-20T21:19:23.528 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f8306a00640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83080b6d00 0x7f83080ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:23.529 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.528+0000 7f82fe000640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83080d3cb0 0x7f83080c9630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f82f0000c00 tx=0x7f82f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:23.529 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.529+0000 7f82ff400640 1 -- 172.21.15.71:0/4148445362 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0032880 con 0x7f83080d3cb0 2024-04-20T21:19:23.529 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.529+0000 7f82ff400640 1 -- 172.21.15.71:0/4148445362 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f0032a20 con 0x7f83080d3cb0 2024-04-20T21:19:23.529 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.529+0000 7f82ff400640 1 -- 172.21.15.71:0/4148445362 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0032e10 con 0x7f83080d3cb0 2024-04-20T21:19:23.529 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.529+0000 7f8307e00640 1 -- 172.21.15.71:0/4148445362 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83080ca900 con 0x7f83080d3cb0 2024-04-20T21:19:23.529 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.529+0000 7f8307e00640 1 -- 172.21.15.71:0/4148445362 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83080c8b50 con 0x7f83080d3cb0 2024-04-20T21:19:23.529 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.530+0000 7f8307e00640 1 -- 172.21.15.71:0/4148445362 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83080692b0 con 0x7f83080d3cb0 2024-04-20T21:19:23.530 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.531+0000 7f82ff400640 1 -- 172.21.15.71:0/4148445362 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82f004c060 con 0x7f83080d3cb0 2024-04-20T21:19:23.531 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.532+0000 7f82ff400640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f82e406c8f0 0x7f82e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:23.531 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.532+0000 7f82ff400640 1 -- 172.21.15.71:0/4148445362 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f82f00ad270 con 0x7f83080d3cb0 2024-04-20T21:19:23.531 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.533+0000 7f8306a00640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f82e406c8f0 0x7f82e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:23.532 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.533+0000 7f8306a00640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f82e406c8f0 0x7f82e406edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83080b2110 tx=0x7f82f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:23.536 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.538+0000 7f82ff400640 1 -- 172.21.15.71:0/4148445362 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f82f0040070 con 0x7f83080d3cb0 2024-04-20T21:19:23.731 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.733+0000 7f8307e00640 1 -- 172.21.15.71:0/4148445362 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83080d5120 con 0x7f83080d3cb0 2024-04-20T21:19:23.733 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.734+0000 7f82ff400640 1 -- 172.21.15.71:0/4148445362 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f82f007b950 con 0x7f83080d3cb0 2024-04-20T21:19:23.733 INFO:teuthology.misc.health.smithi071.stdout: 2024-04-20T21:19:23.733 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":16,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:20.258230+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:23.737 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 -- 172.21.15.71:0/4148445362 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f82e406c8f0 msgr2=0x7f82e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:23.737 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f82e406c8f0 0x7f82e406edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83080b2110 tx=0x7f82f8008040 comp rx=0 tx=0).stop 2024-04-20T21:19:23.737 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 -- 172.21.15.71:0/4148445362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83080d3cb0 msgr2=0x7f83080c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:23.737 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83080d3cb0 0x7f83080c9630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f82f0000c00 tx=0x7f82f00046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.737 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 -- 172.21.15.71:0/4148445362 shutdown_connections 2024-04-20T21:19:23.737 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f82e406c8f0 0x7f82e406edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.737 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f830815e780 0x7f8308160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.737 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83080d3cb0 0x7f83080c9630 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.737 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 --2- 172.21.15.71:0/4148445362 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83080b6d00 0x7f83080ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.737 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 -- 172.21.15.71:0/4148445362 >> 172.21.15.71:0/4148445362 conn(0x7f830809d8f0 msgr2=0x7f83080d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:23.737 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 -- 172.21.15.71:0/4148445362 shutdown_connections 2024-04-20T21:19:23.738 INFO:teuthology.misc.health.smithi071.stderr:2024-04-20T21:19:23.738+0000 7f8307e00640 1 -- 172.21.15.71:0/4148445362 wait complete. 2024-04-20T21:19:23.750 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-20T21:19:23.750 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-20T21:19:23.750 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-20T21:19:23.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-20T21:19:23.758 INFO:tasks.ceph.mds.a:Started 2024-04-20T21:19:23.758 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-20T21:19:23.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-20T21:19:23.767 INFO:tasks.ceph.mds.c:Started 2024-04-20T21:19:23.767 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-20T21:19:23.767 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-20T21:19:23.775 INFO:tasks.ceph.mds.b:Started 2024-04-20T21:19:23.775 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-20T21:19:23.775 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-20T21:19:23.782 INFO:tasks.ceph.mds.d:Started 2024-04-20T21:19:23.782 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-20T21:19:23.782 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:23.901 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2024-04-20T21:19:23.903 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2024-04-20T21:19:23.931 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-04-20T21:19:23.933 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-04-20T21:19:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.950+0000 7f5a6c000640 1 Processor -- start 2024-04-20T21:19:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.951+0000 7f5a6c000640 1 -- start start 2024-04-20T21:19:23.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.952+0000 7f5a6c000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5a640d5040 0x7f5a640d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:23.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.952+0000 7f5a6c000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a640d23b0 con 0x7f5a6415e9c0 2024-04-20T21:19:23.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.952+0000 7f5a6c000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a640d2690 con 0x7f5a640b11c0 2024-04-20T21:19:23.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.952+0000 7f5a6c000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5a640d0f20 con 0x7f5a640d5040 2024-04-20T21:19:23.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.952+0000 7f5a6a000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5a640d5040 0x7f5a640d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:23.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.952+0000 7f5a69600640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5a6415e9c0 0x7f5a640d0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46556/0 (socket says 172.21.15.71:46556) 2024-04-20T21:19:23.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.952+0000 7f5a69600640 1 -- 172.21.15.71:0/920203894 learned_addr learned my addr 172.21.15.71:0/920203894 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:23.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.952+0000 7f5a6a000640 1 -- 172.21.15.71:0/920203894 >> v1:172.21.15.137:6789/0 conn(0x7f5a640b11c0 legacy=0x7f5a640d4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:23.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.952+0000 7f5a6a000640 1 -- 172.21.15.71:0/920203894 >> v1:172.21.15.71:6789/0 conn(0x7f5a6415e9c0 legacy=0x7f5a640d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:23.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.953+0000 7f5a6a000640 1 -- 172.21.15.71:0/920203894 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a640d2970 con 0x7f5a640d5040 2024-04-20T21:19:23.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.952+0000 7f5a63e00640 1 -- 172.21.15.71:0/920203894 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036290001 0 0) 0x7f5a640d23b0 con 0x7f5a6415e9c0 2024-04-20T21:19:23.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.954+0000 7f5a6a000640 1 --2- 172.21.15.71:0/920203894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640d5040 0x7f5a640d1ba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009d90 tx=0x7f5a5c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd51d4999976187f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:23.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.954+0000 7f5a63e00640 1 -- 172.21.15.71:0/920203894 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c039070 con 0x7f5a640d5040 2024-04-20T21:19:23.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.954+0000 7f5a63e00640 1 -- 172.21.15.71:0/920203894 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5c02cbd0 con 0x7f5a640d5040 2024-04-20T21:19:23.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.954+0000 7f5a63e00640 1 -- 172.21.15.71:0/920203894 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c034440 con 0x7f5a640d5040 2024-04-20T21:19:23.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.954+0000 7f5a6c000640 1 -- 172.21.15.71:0/920203894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640d5040 msgr2=0x7f5a640d1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:23.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.954+0000 7f5a6c000640 1 --2- 172.21.15.71:0/920203894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640d5040 0x7f5a640d1ba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009d90 tx=0x7f5a5c02be20 comp rx=0 tx=0).stop 2024-04-20T21:19:23.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.954+0000 7f5a6c000640 1 -- 172.21.15.71:0/920203894 shutdown_connections 2024-04-20T21:19:23.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.954+0000 7f5a6c000640 1 --2- 172.21.15.71:0/920203894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640d5040 0x7f5a640d1ba0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.954+0000 7f5a6c000640 1 -- 172.21.15.71:0/920203894 >> 172.21.15.71:0/920203894 conn(0x7f5a640b9600 msgr2=0x7f5a640b9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:23.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.954+0000 7f5a6c000640 1 -- 172.21.15.71:0/920203894 shutdown_connections 2024-04-20T21:19:23.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.954+0000 7f5a6c000640 1 -- 172.21.15.71:0/920203894 wait complete. 2024-04-20T21:19:23.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.956+0000 7f5a6c000640 1 Processor -- start 2024-04-20T21:19:23.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.956+0000 7f5a6c000640 1 -- start start 2024-04-20T21:19:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.957+0000 7f5a6c000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a640b11c0 0x7f5a640ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.957+0000 7f5a6c000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640d5040 0x7f5a640b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.957+0000 7f5a6c000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a6415e9c0 0x7f5a6415eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.957+0000 7f5a6c000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a64169600 con 0x7f5a640d5040 2024-04-20T21:19:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.957+0000 7f5a6c000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5a640d2ce0 con 0x7f5a640b11c0 2024-04-20T21:19:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.957+0000 7f5a6c000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5a64169780 con 0x7f5a6415e9c0 2024-04-20T21:19:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.957+0000 7f5a68c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640d5040 0x7f5a640b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.957+0000 7f5a69600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a640b11c0 0x7f5a640ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.957+0000 7f5a68c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640d5040 0x7f5a640b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41502/0 (socket says 172.21.15.71:41502) 2024-04-20T21:19:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.957+0000 7f5a68c00640 1 -- 172.21.15.71:0/2694965251 learned_addr learned my addr 172.21.15.71:0/2694965251 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.957+0000 7f5a6a000640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a6415e9c0 0x7f5a6415eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.958+0000 7f5a68c00640 1 -- 172.21.15.71:0/2694965251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a6415e9c0 msgr2=0x7f5a6415eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.958+0000 7f5a68c00640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a6415e9c0 0x7f5a6415eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.958+0000 7f5a68c00640 1 -- 172.21.15.71:0/2694965251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a640b11c0 msgr2=0x7f5a640ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.958+0000 7f5a68c00640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a640b11c0 0x7f5a640ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.958+0000 7f5a68c00640 1 -- 172.21.15.71:0/2694965251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a640ccb40 con 0x7f5a640d5040 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.958+0000 7f5a68c00640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640d5040 0x7f5a640b6010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000c430 tx=0x7f5a5000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.958+0000 7f5a61600640 1 -- 172.21.15.71:0/2694965251 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50011790 con 0x7f5a640d5040 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.958+0000 7f5a61600640 1 -- 172.21.15.71:0/2694965251 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a50017070 con 0x7f5a640d5040 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.958+0000 7f5a6c000640 1 -- 172.21.15.71:0/2694965251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a640cce20 con 0x7f5a640d5040 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.958+0000 7f5a61600640 1 -- 172.21.15.71:0/2694965251 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50011b70 con 0x7f5a640d5040 2024-04-20T21:19:23.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.958+0000 7f5a6c000640 1 -- 172.21.15.71:0/2694965251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a640cd3e0 con 0x7f5a640d5040 2024-04-20T21:19:23.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.960+0000 7f5a6c000640 1 -- 172.21.15.71:0/2694965251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a64068980 con 0x7f5a640d5040 2024-04-20T21:19:23.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.960+0000 7f5a61600640 1 -- 172.21.15.71:0/2694965251 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a50011d10 con 0x7f5a640d5040 2024-04-20T21:19:23.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.961+0000 7f5a61600640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4406c8f0 0x7f5a4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:23.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.961+0000 7f5a61600640 1 -- 172.21.15.71:0/2694965251 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5a5008b600 con 0x7f5a640d5040 2024-04-20T21:19:23.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.962+0000 7f5a69600640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4406c8f0 0x7f5a4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:23.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.962+0000 7f5a69600640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4406c8f0 0x7f5a4406edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007fd0 tx=0x7f5a58007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:23.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:23.966+0000 7f5a61600640 1 -- 172.21.15.71:0/2694965251 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5a50059690 con 0x7f5a640d5040 2024-04-20T21:19:24.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.165+0000 7f5a6c000640 1 -- 172.21.15.71:0/2694965251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a6406efb0 con 0x7f5a640d5040 2024-04-20T21:19:24.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.167+0000 7f5a61600640 1 -- 172.21.15.71:0/2694965251 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f5a5005d990 con 0x7f5a640d5040 2024-04-20T21:19:24.166 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:24.166 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":16,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:20.258230+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:24.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.170+0000 7f5a6c000640 1 -- 172.21.15.71:0/2694965251 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4406c8f0 msgr2=0x7f5a4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.170+0000 7f5a6c000640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4406c8f0 0x7f5a4406edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007fd0 tx=0x7f5a58007de0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.170+0000 7f5a6c000640 1 -- 172.21.15.71:0/2694965251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640d5040 msgr2=0x7f5a640b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.170+0000 7f5a6c000640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640d5040 0x7f5a640b6010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000c430 tx=0x7f5a5000c8f0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.170+0000 7f5a6c000640 1 -- 172.21.15.71:0/2694965251 shutdown_connections 2024-04-20T21:19:24.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.170+0000 7f5a6c000640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4406c8f0 0x7f5a4406edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.170+0000 7f5a6c000640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a6415e9c0 0x7f5a6415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.170+0000 7f5a6c000640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640d5040 0x7f5a640b6010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.170+0000 7f5a6c000640 1 --2- 172.21.15.71:0/2694965251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a640b11c0 0x7f5a640ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.170+0000 7f5a6c000640 1 -- 172.21.15.71:0/2694965251 >> 172.21.15.71:0/2694965251 conn(0x7f5a640b9600 msgr2=0x7f5a6406e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:24.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.170+0000 7f5a6c000640 1 -- 172.21.15.71:0/2694965251 shutdown_connections 2024-04-20T21:19:24.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.171+0000 7f5a6c000640 1 -- 172.21.15.71:0/2694965251 wait complete. 2024-04-20T21:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T21:19:24.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:19:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.390+0000 7f833a400640 1 Processor -- start 2024-04-20T21:19:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.390+0000 7f833a400640 1 -- start start 2024-04-20T21:19:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.391+0000 7f833a400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8334073b80 0x7f833406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.392+0000 7f833a400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833415cc20 con 0x7f8334071a60 2024-04-20T21:19:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.392+0000 7f833a400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833415cec0 con 0x7f833415a130 2024-04-20T21:19:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.392+0000 7f833a400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f833415d7f0 con 0x7f8334073b80 2024-04-20T21:19:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.392+0000 7f8339a00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8334071a60 0x7f833406b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46568/0 (socket says 172.21.15.71:46568) 2024-04-20T21:19:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.392+0000 7f8339a00640 1 -- 172.21.15.71:0/478748791 learned_addr learned my addr 172.21.15.71:0/478748791 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.392+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160501887 0 0) 0x7f833415cc20 con 0x7f8334071a60 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.392+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8318003520 con 0x7f8334071a60 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.392+0000 7f832be00640 1 --2- 172.21.15.71:0/478748791 >> v2:172.21.15.137:3300/0 conn(0x7f8334073b80 0x7f833406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3422411023 0 0) 0x7f8318003520 con 0x7f8334071a60 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 >> v2:172.21.15.137:3300/0 conn(0x7f8334073b80 msgr2=0x7f833406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 --2- 172.21.15.71:0/478748791 >> v2:172.21.15.137:3300/0 conn(0x7f8334073b80 0x7f833406f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 >> v1:172.21.15.137:6789/0 conn(0x7f833415a130 legacy=0x7f8334073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833415d1a0 con 0x7f8334071a60 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f832c0019f0 con 0x7f8334071a60 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f832be00640 1 --2- 172.21.15.71:0/478748791 >> v2:172.21.15.137:3300/0 conn(0x7f8334073b80 0x7f833406f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 >> v1:172.21.15.71:6789/0 conn(0x7f8334071a60 legacy=0x7f833406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83180039b0 0x7f8318003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8318004800 0x7f8318004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 0x7f831800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f833415d7f0 con 0x7f83180052e0 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f831800c1b0 con 0x7f8318004800 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f831800c3b0 con 0x7f83180039b0 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8339a00640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 0x7f831800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f832be00640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8318004800 0x7f8318004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.393+0000 7f8339000640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83180039b0 0x7f8318003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.394+0000 7f8339a00640 1 -- 172.21.15.71:0/478748791 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83180039b0 msgr2=0x7f8318003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.394+0000 7f8339a00640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83180039b0 0x7f8318003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.394+0000 7f8339a00640 1 -- 172.21.15.71:0/478748791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8318004800 msgr2=0x7f8318004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.394+0000 7f8339a00640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8318004800 0x7f8318004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.394+0000 7f8339a00640 1 -- 172.21.15.71:0/478748791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8318003520 con 0x7f83180052e0 2024-04-20T21:19:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.394+0000 7f832be00640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8318004800 0x7f8318004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:19:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.394+0000 7f8339a00640 1 -- 172.21.15.71:0/478748791 reap_dead start 2024-04-20T21:19:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.395+0000 7f8339a00640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 0x7f831800b9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f832c002230 tx=0x7f8318005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72784e8aa726f6a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.395+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c00a4a0 con 0x7f83180052e0 2024-04-20T21:19:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.395+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832c034650 con 0x7f83180052e0 2024-04-20T21:19:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.395+0000 7f8333e00640 1 -- 172.21.15.71:0/478748791 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c034a40 con 0x7f83180052e0 2024-04-20T21:19:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.395+0000 7f833a400640 1 -- 172.21.15.71:0/478748791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 msgr2=0x7f831800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.395+0000 7f833a400640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 0x7f831800b9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f832c002230 tx=0x7f8318005830 comp rx=0 tx=0).stop 2024-04-20T21:19:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.396+0000 7f833a400640 1 -- 172.21.15.71:0/478748791 shutdown_connections 2024-04-20T21:19:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.396+0000 7f833a400640 1 --2- 172.21.15.71:0/478748791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 0x7f831800b9c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.396+0000 7f833a400640 1 -- 172.21.15.71:0/478748791 >> 172.21.15.71:0/478748791 conn(0x7f83340cffa0 msgr2=0x7f83340d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.396+0000 7f833a400640 1 -- 172.21.15.71:0/478748791 shutdown_connections 2024-04-20T21:19:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.396+0000 7f833a400640 1 -- 172.21.15.71:0/478748791 wait complete. 2024-04-20T21:19:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.397+0000 7f833a400640 1 Processor -- start 2024-04-20T21:19:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.397+0000 7f833a400640 1 -- start start 2024-04-20T21:19:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.398+0000 7f833a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 0x7f833415b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.398+0000 7f833a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83341f34f0 0x7f833415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.398+0000 7f833a400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f833415c110 0x7f8334151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.398+0000 7f833a400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83340735f0 con 0x7f83180052e0 2024-04-20T21:19:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.398+0000 7f833a400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8334073470 con 0x7f83341f34f0 2024-04-20T21:19:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.398+0000 7f833a400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8334073770 con 0x7f833415c110 2024-04-20T21:19:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f8339000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 0x7f833415b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f8339000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 0x7f833415b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41520/0 (socket says 172.21.15.71:41520) 2024-04-20T21:19:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f8339000640 1 -- 172.21.15.71:0/1446522920 learned_addr learned my addr 172.21.15.71:0/1446522920 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f832be00640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83341f34f0 0x7f833415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f8339a00640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f833415c110 0x7f8334151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f8339000640 1 -- 172.21.15.71:0/1446522920 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f833415c110 msgr2=0x7f8334151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f8339000640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f833415c110 0x7f8334151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f8339000640 1 -- 172.21.15.71:0/1446522920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83341f34f0 msgr2=0x7f833415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f8339000640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83341f34f0 0x7f833415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f8339000640 1 -- 172.21.15.71:0/1446522920 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8334152170 con 0x7f83180052e0 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f832be00640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83341f34f0 0x7f833415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.399+0000 7f8339000640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 0x7f833415b190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f832400e4b0 tx=0x7f832400e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.400+0000 7f8331600640 1 -- 172.21.15.71:0/1446522920 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240052e0 con 0x7f83180052e0 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.400+0000 7f8331600640 1 -- 172.21.15.71:0/1446522920 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8324018070 con 0x7f83180052e0 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.400+0000 7f8331600640 1 -- 172.21.15.71:0/1446522920 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324003830 con 0x7f83180052e0 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.400+0000 7f833a400640 1 -- 172.21.15.71:0/1446522920 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833415a6b0 con 0x7f83180052e0 2024-04-20T21:19:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.400+0000 7f833a400640 1 -- 172.21.15.71:0/1446522920 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83341f3970 con 0x7f83180052e0 2024-04-20T21:19:24.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.401+0000 7f833a400640 1 -- 172.21.15.71:0/1446522920 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8334075b30 con 0x7f83180052e0 2024-04-20T21:19:24.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.402+0000 7f8331600640 1 -- 172.21.15.71:0/1446522920 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f83240039d0 con 0x7f83180052e0 2024-04-20T21:19:24.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.403+0000 7f8331600640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f831006c8f0 0x7f831006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.403+0000 7f8331600640 1 -- 172.21.15.71:0/1446522920 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f832408b3d0 con 0x7f83180052e0 2024-04-20T21:19:24.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.403+0000 7f832be00640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f831006c8f0 0x7f831006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.404+0000 7f832be00640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f831006c8f0 0x7f831006edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f83340ceed0 tx=0x7f831c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.408+0000 7f8331600640 1 -- 172.21.15.71:0/1446522920 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8324059be0 con 0x7f83180052e0 2024-04-20T21:19:24.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.592+0000 7f833a400640 1 -- 172.21.15.71:0/1446522920 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f833415c4f0 con 0x7f83180052e0 2024-04-20T21:19:24.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.593+0000 7f8331600640 1 -- 172.21.15.71:0/1446522920 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f83240594e0 con 0x7f83180052e0 2024-04-20T21:19:24.592 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:19:24.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.596+0000 7f833a400640 1 -- 172.21.15.71:0/1446522920 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f831006c8f0 msgr2=0x7f831006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.596+0000 7f833a400640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f831006c8f0 0x7f831006edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f83340ceed0 tx=0x7f831c008040 comp rx=0 tx=0).stop 2024-04-20T21:19:24.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.596+0000 7f833a400640 1 -- 172.21.15.71:0/1446522920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 msgr2=0x7f833415b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.596+0000 7f833a400640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 0x7f833415b190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f832400e4b0 tx=0x7f832400e970 comp rx=0 tx=0).stop 2024-04-20T21:19:24.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.596+0000 7f833a400640 1 -- 172.21.15.71:0/1446522920 shutdown_connections 2024-04-20T21:19:24.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.596+0000 7f833a400640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f831006c8f0 0x7f831006edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.596+0000 7f833a400640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f833415c110 0x7f8334151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.596+0000 7f833a400640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83341f34f0 0x7f833415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.596+0000 7f833a400640 1 --2- 172.21.15.71:0/1446522920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83180052e0 0x7f833415b190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.596+0000 7f833a400640 1 -- 172.21.15.71:0/1446522920 >> 172.21.15.71:0/1446522920 conn(0x7f83340cffa0 msgr2=0x7f833406b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:24.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.596+0000 7f833a400640 1 -- 172.21.15.71:0/1446522920 shutdown_connections 2024-04-20T21:19:24.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.597+0000 7f833a400640 1 -- 172.21.15.71:0/1446522920 wait complete. 2024-04-20T21:19:24.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:19:24.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.803+0000 7faa12a00640 1 Processor -- start 2024-04-20T21:19:24.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.803+0000 7faa12a00640 1 -- start start 2024-04-20T21:19:24.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.804+0000 7faa12a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa0c0d0360 0x7faa0c0d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.804+0000 7faa12a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0c0ade40 con 0x7faa0c06dcb0 2024-04-20T21:19:24.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.804+0000 7faa12a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0c0ae0e0 con 0x7faa0c15b3b0 2024-04-20T21:19:24.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.804+0000 7faa12a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7faa0c06f1b0 con 0x7faa0c0d0360 2024-04-20T21:19:24.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.805+0000 7faa10a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa0c0d0360 0x7faa0c0d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.805+0000 7faa0b400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7faa0c06dcb0 0x7faa0c071b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46580/0 (socket says 172.21.15.71:46580) 2024-04-20T21:19:24.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.805+0000 7faa0b400640 1 -- 172.21.15.71:0/677265505 learned_addr learned my addr 172.21.15.71:0/677265505 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:24.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.805+0000 7faa10a00640 1 -- 172.21.15.71:0/677265505 >> v1:172.21.15.137:6789/0 conn(0x7faa0c15b3b0 legacy=0x7faa0c06eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.805+0000 7faa10a00640 1 -- 172.21.15.71:0/677265505 >> v1:172.21.15.71:6789/0 conn(0x7faa0c06dcb0 legacy=0x7faa0c071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.805+0000 7faa10a00640 1 -- 172.21.15.71:0/677265505 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c15b790 con 0x7faa0c0d0360 2024-04-20T21:19:24.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.805+0000 7faa0aa00640 1 -- 172.21.15.71:0/677265505 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577893126 0 0) 0x7faa0c0ade40 con 0x7faa0c06dcb0 2024-04-20T21:19:24.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.806+0000 7faa10a00640 1 --2- 172.21.15.71:0/677265505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0c0d0360 0x7faa0c0d0770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa04009d90 tx=0x7faa0402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5d18a14c879728 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:24.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.806+0000 7faa0aa00640 1 -- 172.21.15.71:0/677265505 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04039070 con 0x7faa0c0d0360 2024-04-20T21:19:24.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.807+0000 7faa0aa00640 1 -- 172.21.15.71:0/677265505 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa0402cd00 con 0x7faa0c0d0360 2024-04-20T21:19:24.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.807+0000 7faa0aa00640 1 -- 172.21.15.71:0/677265505 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04034660 con 0x7faa0c0d0360 2024-04-20T21:19:24.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.807+0000 7faa12a00640 1 -- 172.21.15.71:0/677265505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0c0d0360 msgr2=0x7faa0c0d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.807+0000 7faa12a00640 1 --2- 172.21.15.71:0/677265505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0c0d0360 0x7faa0c0d0770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa04009d90 tx=0x7faa0402bf50 comp rx=0 tx=0).stop 2024-04-20T21:19:24.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.807+0000 7faa12a00640 1 -- 172.21.15.71:0/677265505 shutdown_connections 2024-04-20T21:19:24.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.807+0000 7faa12a00640 1 --2- 172.21.15.71:0/677265505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0c0d0360 0x7faa0c0d0770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.807+0000 7faa12a00640 1 -- 172.21.15.71:0/677265505 >> 172.21.15.71:0/677265505 conn(0x7faa0c0b3350 msgr2=0x7faa0c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:24.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.807+0000 7faa12a00640 1 -- 172.21.15.71:0/677265505 shutdown_connections 2024-04-20T21:19:24.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.807+0000 7faa12a00640 1 -- 172.21.15.71:0/677265505 wait complete. 2024-04-20T21:19:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.809+0000 7faa12a00640 1 Processor -- start 2024-04-20T21:19:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.809+0000 7faa12a00640 1 -- start start 2024-04-20T21:19:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.810+0000 7faa12a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0c06dcb0 0x7faa0c15d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.810+0000 7faa12a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa0c0d0360 0x7faa0c15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.810+0000 7faa12a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa0c15b3b0 0x7faa0c0af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.810+0000 7faa12a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0ae940 con 0x7faa0c06dcb0 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.810+0000 7faa12a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0ae660 con 0x7faa0c15b3b0 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.810+0000 7faa12a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faa0c0aec20 con 0x7faa0c0d0360 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.810+0000 7faa0be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0c06dcb0 0x7faa0c15d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa0be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0c06dcb0 0x7faa0c15d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41528/0 (socket says 172.21.15.71:41528) 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa0be00640 1 -- 172.21.15.71:0/3448635930 learned_addr learned my addr 172.21.15.71:0/3448635930 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa10a00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa0c15b3b0 0x7faa0c0af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa0b400640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa0c0d0360 0x7faa0c15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa0be00640 1 -- 172.21.15.71:0/3448635930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa0c0d0360 msgr2=0x7faa0c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa0be00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa0c0d0360 0x7faa0c15cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa0be00640 1 -- 172.21.15.71:0/3448635930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa0c15b3b0 msgr2=0x7faa0c0af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa0be00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa0c15b3b0 0x7faa0c0af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa0be00640 1 -- 172.21.15.71:0/3448635930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c152260 con 0x7faa0c06dcb0 2024-04-20T21:19:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa10a00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa0c15b3b0 0x7faa0c0af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa0be00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0c06dcb0 0x7faa0c15d7f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c390 tx=0x7fa9fc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa03e00640 1 -- 172.21.15.71:0/3448635930 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc017070 con 0x7faa0c06dcb0 2024-04-20T21:19:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa03e00640 1 -- 172.21.15.71:0/3448635930 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc0052d0 con 0x7faa0c06dcb0 2024-04-20T21:19:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.811+0000 7faa12a00640 1 -- 172.21.15.71:0/3448635930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c152540 con 0x7faa0c06dcb0 2024-04-20T21:19:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.812+0000 7faa03e00640 1 -- 172.21.15.71:0/3448635930 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc003830 con 0x7faa0c06dcb0 2024-04-20T21:19:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.812+0000 7faa12a00640 1 -- 172.21.15.71:0/3448635930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c152b00 con 0x7faa0c06dcb0 2024-04-20T21:19:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.813+0000 7faa12a00640 1 -- 172.21.15.71:0/3448635930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c068980 con 0x7faa0c06dcb0 2024-04-20T21:19:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.814+0000 7faa03e00640 1 -- 172.21.15.71:0/3448635930 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa9fc01a070 con 0x7faa0c06dcb0 2024-04-20T21:19:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.814+0000 7faa03e00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa9e806c8f0 0x7fa9e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.815+0000 7faa03e00640 1 -- 172.21.15.71:0/3448635930 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa9fc08ab40 con 0x7faa0c06dcb0 2024-04-20T21:19:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.815+0000 7faa0b400640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa9e806c8f0 0x7fa9e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.815+0000 7faa0b400640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa9e806c8f0 0x7fa9e806edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa0c1f7870 tx=0x7fa9f4007b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:24.820+0000 7faa03e00640 1 -- 172.21.15.71:0/3448635930 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa9fc0592b0 con 0x7faa0c06dcb0 2024-04-20T21:19:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.061+0000 7faa12a00640 1 -- 172.21.15.71:0/3448635930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa0c06e130 con 0x7faa0c06dcb0 2024-04-20T21:19:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.062+0000 7faa03e00640 1 -- 172.21.15.71:0/3448635930 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7fa9fc058bb0 con 0x7faa0c06dcb0 2024-04-20T21:19:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:25.061 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3502151495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3502151495},{"type":"v1","addr":"172.21.15.137:6833","nonce":3502151495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2603023903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2603023903},{"type":"v1","addr":"172.21.15.137:6835","nonce":2603023903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3246613850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3246613850},{"type":"v1","addr":"172.21.15.71:6835","nonce":3246613850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4085222328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":4085222328},{"type":"v1","addr":"172.21.15.71:6837","nonce":4085222328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-20T21:19:25.061 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 3 2024-04-20T21:19:25.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 -- 172.21.15.71:0/3448635930 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa9e806c8f0 msgr2=0x7fa9e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa9e806c8f0 0x7fa9e806edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa0c1f7870 tx=0x7fa9f4007b90 comp rx=0 tx=0).stop 2024-04-20T21:19:25.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 -- 172.21.15.71:0/3448635930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0c06dcb0 msgr2=0x7faa0c15d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0c06dcb0 0x7faa0c15d7f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c390 tx=0x7fa9fc00c850 comp rx=0 tx=0).stop 2024-04-20T21:19:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 -- 172.21.15.71:0/3448635930 shutdown_connections 2024-04-20T21:19:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa9e806c8f0 0x7fa9e806edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa0c15b3b0 0x7faa0c0af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa0c0d0360 0x7faa0c15cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 --2- 172.21.15.71:0/3448635930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0c06dcb0 0x7faa0c15d7f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 -- 172.21.15.71:0/3448635930 >> 172.21.15.71:0/3448635930 conn(0x7faa0c0b3350 msgr2=0x7faa0c1594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 -- 172.21.15.71:0/3448635930 shutdown_connections 2024-04-20T21:19:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.065+0000 7faa12a00640 1 -- 172.21.15.71:0/3448635930 wait complete. 2024-04-20T21:19:25.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:25.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.281+0000 7fd36d800640 1 Processor -- start 2024-04-20T21:19:25.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.281+0000 7fd36d800640 1 -- start start 2024-04-20T21:19:25.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.283+0000 7fd36d800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd368161d50 0x7fd3680d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.283+0000 7fd36d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3680b3330 0x7fd3680b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.283+0000 7fd36d800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36806c190 con 0x7fd36806c6d0 2024-04-20T21:19:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.283+0000 7fd36d800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd368162130 con 0x7fd368161d50 2024-04-20T21:19:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.283+0000 7fd36d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd36806c470 con 0x7fd3680b3330 2024-04-20T21:19:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.284+0000 7fd367400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3680b3330 0x7fd3680b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.284+0000 7fd367400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3680b3330 0x7fd3680b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:42662/0 (socket says 172.21.15.71:42662) 2024-04-20T21:19:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.284+0000 7fd367400640 1 -- 172.21.15.71:0/651666195 learned_addr learned my addr 172.21.15.71:0/651666195 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.284+0000 7fd367e00640 1 --2- 172.21.15.71:0/651666195 >> v2:172.21.15.137:3300/0 conn(0x7fd368161d50 0x7fd3680d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.284+0000 7fd367400640 1 -- 172.21.15.71:0/651666195 >> v2:172.21.15.137:3300/0 conn(0x7fd368161d50 msgr2=0x7fd3680d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.284+0000 7fd367400640 1 --2- 172.21.15.71:0/651666195 >> v2:172.21.15.137:3300/0 conn(0x7fd368161d50 0x7fd3680d38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.284+0000 7fd367400640 1 -- 172.21.15.71:0/651666195 >> v1:172.21.15.137:6789/0 conn(0x7fd36806c6d0 legacy=0x7fd3680cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.284+0000 7fd367400640 1 -- 172.21.15.71:0/651666195 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3680d2e00 con 0x7fd3680b3330 2024-04-20T21:19:25.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.286+0000 7fd367400640 1 --2- 172.21.15.71:0/651666195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3680b3330 0x7fd3680b3880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd350009e50 tx=0x7fd35002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b7eee8c26c39a71 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.286+0000 7fd366a00640 1 -- 172.21.15.71:0/651666195 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35002cb00 con 0x7fd3680b3330 2024-04-20T21:19:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.286+0000 7fd366a00640 1 -- 172.21.15.71:0/651666195 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35002cca0 con 0x7fd3680b3330 2024-04-20T21:19:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.286+0000 7fd366a00640 1 -- 172.21.15.71:0/651666195 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350034610 con 0x7fd3680b3330 2024-04-20T21:19:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.287+0000 7fd36d800640 1 -- 172.21.15.71:0/651666195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3680b3330 msgr2=0x7fd3680b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.287+0000 7fd36d800640 1 --2- 172.21.15.71:0/651666195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3680b3330 0x7fd3680b3880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd350009e50 tx=0x7fd35002bf60 comp rx=0 tx=0).stop 2024-04-20T21:19:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.287+0000 7fd36d800640 1 -- 172.21.15.71:0/651666195 shutdown_connections 2024-04-20T21:19:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.287+0000 7fd36d800640 1 --2- 172.21.15.71:0/651666195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3680b3330 0x7fd3680b3880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.287+0000 7fd36d800640 1 --2- 172.21.15.71:0/651666195 >> v2:172.21.15.137:3300/0 conn(0x7fd368161d50 0x7fd3680d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.287+0000 7fd36d800640 1 -- 172.21.15.71:0/651666195 >> 172.21.15.71:0/651666195 conn(0x7fd3680d4450 msgr2=0x7fd3680d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.287+0000 7fd36d800640 1 -- 172.21.15.71:0/651666195 shutdown_connections 2024-04-20T21:19:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.287+0000 7fd36d800640 1 -- 172.21.15.71:0/651666195 wait complete. 2024-04-20T21:19:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.288+0000 7fd36d800640 1 Processor -- start 2024-04-20T21:19:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.289+0000 7fd36d800640 1 -- start start 2024-04-20T21:19:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd36806c6d0 0x7fd3680c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3680b3330 0x7fd3680cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368161d50 0x7fd368150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36d800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd36806cb60 con 0x7fd368161d50 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36d800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3680d33c0 con 0x7fd3680b3330 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd36806cce0 con 0x7fd36806c6d0 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368161d50 0x7fd368150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368161d50 0x7fd368150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41532/0 (socket says 172.21.15.71:41532) 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36ce00640 1 -- 172.21.15.71:0/4222615659 learned_addr learned my addr 172.21.15.71:0/4222615659 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd367e00640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd36806c6d0 0x7fd3680c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd367400640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3680b3330 0x7fd3680cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36ce00640 1 -- 172.21.15.71:0/4222615659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd36806c6d0 msgr2=0x7fd3680c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36ce00640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd36806c6d0 0x7fd3680c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36ce00640 1 -- 172.21.15.71:0/4222615659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3680b3330 msgr2=0x7fd3680cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36ce00640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3680b3330 0x7fd3680cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd36ce00640 1 -- 172.21.15.71:0/4222615659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3680c7f60 con 0x7fd368161d50 2024-04-20T21:19:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.290+0000 7fd367400640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3680b3330 0x7fd3680cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.291+0000 7fd36ce00640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368161d50 0x7fd368150840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd360001eb0 tx=0x7fd36000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.291+0000 7fd35fe00640 1 -- 172.21.15.71:0/4222615659 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360017070 con 0x7fd368161d50 2024-04-20T21:19:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.291+0000 7fd35fe00640 1 -- 172.21.15.71:0/4222615659 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3600052d0 con 0x7fd368161d50 2024-04-20T21:19:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.291+0000 7fd35fe00640 1 -- 172.21.15.71:0/4222615659 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360003810 con 0x7fd368161d50 2024-04-20T21:19:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.291+0000 7fd36d800640 1 -- 172.21.15.71:0/4222615659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3680c8240 con 0x7fd368161d50 2024-04-20T21:19:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.291+0000 7fd36d800640 1 -- 172.21.15.71:0/4222615659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3680c8800 con 0x7fd368161d50 2024-04-20T21:19:25.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.292+0000 7fd36d800640 1 -- 172.21.15.71:0/4222615659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3680cb2e0 con 0x7fd368161d50 2024-04-20T21:19:25.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.293+0000 7fd35fe00640 1 -- 172.21.15.71:0/4222615659 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd36001a070 con 0x7fd368161d50 2024-04-20T21:19:25.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.294+0000 7fd35fe00640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd34406c920 0x7fd34406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.294+0000 7fd35fe00640 1 -- 172.21.15.71:0/4222615659 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd36008ab70 con 0x7fd368161d50 2024-04-20T21:19:25.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.295+0000 7fd367e00640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd34406c920 0x7fd34406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.295+0000 7fd367e00640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd34406c920 0x7fd34406ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd358006fd0 tx=0x7fd358008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:25.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.300+0000 7fd35fe00640 1 -- 172.21.15.71:0/4222615659 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd3600592e0 con 0x7fd368161d50 2024-04-20T21:19:25.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.500+0000 7fd36d800640 1 -- 172.21.15.71:0/4222615659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd368075b30 con 0x7fd368161d50 2024-04-20T21:19:25.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.501+0000 7fd35fe00640 1 -- 172.21.15.71:0/4222615659 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7fd360058be0 con 0x7fd368161d50 2024-04-20T21:19:25.500 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:25.500 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":16,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:20.258230+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 -- 172.21.15.71:0/4222615659 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd34406c920 msgr2=0x7fd34406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd34406c920 0x7fd34406ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd358006fd0 tx=0x7fd358008040 comp rx=0 tx=0).stop 2024-04-20T21:19:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 -- 172.21.15.71:0/4222615659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368161d50 msgr2=0x7fd368150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368161d50 0x7fd368150840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd360001eb0 tx=0x7fd36000c890 comp rx=0 tx=0).stop 2024-04-20T21:19:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 -- 172.21.15.71:0/4222615659 shutdown_connections 2024-04-20T21:19:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd34406c920 0x7fd34406ede0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368161d50 0x7fd368150840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3680b3330 0x7fd3680cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 --2- 172.21.15.71:0/4222615659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd36806c6d0 0x7fd3680c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 -- 172.21.15.71:0/4222615659 >> 172.21.15.71:0/4222615659 conn(0x7fd3680d4450 msgr2=0x7fd3680b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:25.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 -- 172.21.15.71:0/4222615659 shutdown_connections 2024-04-20T21:19:25.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.504+0000 7fd36d800640 1 -- 172.21.15.71:0/4222615659 wait complete. 2024-04-20T21:19:25.522 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T21:19:25.522 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:19:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.726+0000 7fec1ca00640 1 Processor -- start 2024-04-20T21:19:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.726+0000 7fec1ca00640 1 -- start start 2024-04-20T21:19:25.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.728+0000 7fec1ca00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fec1815a130 0x7fec18073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.728+0000 7fec1ca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec1806f870 0x7fec180739b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.728+0000 7fec1ca00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1815cc20 con 0x7fec18071a60 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.728+0000 7fec1ca00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fec1815d7f0 con 0x7fec1815a130 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.728+0000 7fec1ca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fec1815cec0 con 0x7fec1806f870 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.728+0000 7fec17400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fec1815a130 0x7fec18073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.728+0000 7fec16a00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fec18071a60 0x7fec1806f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46596/0 (socket says 172.21.15.71:46596) 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.728+0000 7fec16a00640 1 -- 172.21.15.71:0/2554661070 learned_addr learned my addr 172.21.15.71:0/2554661070 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.728+0000 7fec17400640 1 --2- 172.21.15.71:0/2554661070 >> v2:172.21.15.71:3300/0 conn(0x7fec1815a130 0x7fec18073470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41536/0 (socket says 172.21.15.71:41536) 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.729+0000 7fec17e00640 1 --2- 172.21.15.71:0/2554661070 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec1806f870 0x7fec180739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.729+0000 7fec17400640 1 -- 172.21.15.71:0/2554661070 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec1806f870 msgr2=0x7fec180739b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.729+0000 7fec17400640 1 --2- 172.21.15.71:0/2554661070 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec1806f870 0x7fec180739b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.729+0000 7fec17400640 1 -- 172.21.15.71:0/2554661070 >> v1:172.21.15.71:6789/0 conn(0x7fec18071a60 legacy=0x7fec1806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.729+0000 7fec17400640 1 -- 172.21.15.71:0/2554661070 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1815d1a0 con 0x7fec1815a130 2024-04-20T21:19:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.729+0000 7fec16000640 1 -- 172.21.15.71:0/2554661070 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 46805717 0 0) 0x7fec1815cc20 con 0x7fec18071a60 2024-04-20T21:19:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.730+0000 7fec17400640 1 --2- 172.21.15.71:0/2554661070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec1815a130 0x7fec18073470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec080097a0 tx=0x7fec0802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad376bdd6e4e046 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.730+0000 7fec16000640 1 -- 172.21.15.71:0/2554661070 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec08038070 con 0x7fec1815a130 2024-04-20T21:19:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.730+0000 7fec16000640 1 -- 172.21.15.71:0/2554661070 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec08031700 con 0x7fec1815a130 2024-04-20T21:19:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.730+0000 7fec16000640 1 -- 172.21.15.71:0/2554661070 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec08031ad0 con 0x7fec1815a130 2024-04-20T21:19:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.731+0000 7fec1ca00640 1 -- 172.21.15.71:0/2554661070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec1815a130 msgr2=0x7fec18073470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.731+0000 7fec1ca00640 1 --2- 172.21.15.71:0/2554661070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec1815a130 0x7fec18073470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec080097a0 tx=0x7fec0802b7a0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.731+0000 7fec1ca00640 1 -- 172.21.15.71:0/2554661070 shutdown_connections 2024-04-20T21:19:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.731+0000 7fec1ca00640 1 --2- 172.21.15.71:0/2554661070 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec1806f870 0x7fec180739b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.731+0000 7fec1ca00640 1 --2- 172.21.15.71:0/2554661070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec1815a130 0x7fec18073470 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.731+0000 7fec1ca00640 1 -- 172.21.15.71:0/2554661070 >> 172.21.15.71:0/2554661070 conn(0x7fec180cffa0 msgr2=0x7fec180d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.731+0000 7fec1ca00640 1 -- 172.21.15.71:0/2554661070 shutdown_connections 2024-04-20T21:19:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.731+0000 7fec1ca00640 1 -- 172.21.15.71:0/2554661070 wait complete. 2024-04-20T21:19:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.733+0000 7fec1ca00640 1 Processor -- start 2024-04-20T21:19:25.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.733+0000 7fec1ca00640 1 -- start start 2024-04-20T21:19:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.734+0000 7fec1ca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec1806f870 0x7fec181f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.734+0000 7fec1ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec18071a60 0x7fec18072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.734+0000 7fec1ca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec1815a130 0x7fec18158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.734+0000 7fec1ca00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec1806ba80 con 0x7fec1815a130 2024-04-20T21:19:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.734+0000 7fec1ca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fec1806b900 con 0x7fec18071a60 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.734+0000 7fec1ca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fec1806bc00 con 0x7fec1806f870 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.734+0000 7fec17e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec1815a130 0x7fec18158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.734+0000 7fec17e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec1815a130 0x7fec18158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41538/0 (socket says 172.21.15.71:41538) 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.734+0000 7fec17e00640 1 -- 172.21.15.71:0/779163766 learned_addr learned my addr 172.21.15.71:0/779163766 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec17400640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec1806f870 0x7fec181f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec16a00640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec18071a60 0x7fec18072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec17e00640 1 -- 172.21.15.71:0/779163766 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec1806f870 msgr2=0x7fec181f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec17e00640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec1806f870 0x7fec181f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec17e00640 1 -- 172.21.15.71:0/779163766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec18071a60 msgr2=0x7fec18072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec17e00640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec18071a60 0x7fec18072110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec17e00640 1 -- 172.21.15.71:0/779163766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec180cc1c0 con 0x7fec1815a130 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec16a00640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec18071a60 0x7fec18072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec17e00640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec1815a130 0x7fec18158a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec10007e40 tx=0x7fec1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec0f400640 1 -- 172.21.15.71:0/779163766 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10014620 con 0x7fec1815a130 2024-04-20T21:19:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec0f400640 1 -- 172.21.15.71:0/779163766 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec10019070 con 0x7fec1815a130 2024-04-20T21:19:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec0f400640 1 -- 172.21.15.71:0/779163766 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10014a20 con 0x7fec1815a130 2024-04-20T21:19:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.735+0000 7fec1ca00640 1 -- 172.21.15.71:0/779163766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec180b2fb0 con 0x7fec1815a130 2024-04-20T21:19:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.736+0000 7fec1ca00640 1 -- 172.21.15.71:0/779163766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec180b3570 con 0x7fec1815a130 2024-04-20T21:19:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.737+0000 7fec1ca00640 1 -- 172.21.15.71:0/779163766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec18075b30 con 0x7fec1815a130 2024-04-20T21:19:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.738+0000 7fec0f400640 1 -- 172.21.15.71:0/779163766 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec10014bc0 con 0x7fec1815a130 2024-04-20T21:19:25.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.738+0000 7fec0f400640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7febf806c8f0 0x7febf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:25.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.738+0000 7fec0f400640 1 -- 172.21.15.71:0/779163766 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fec1008c170 con 0x7fec1815a130 2024-04-20T21:19:25.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.739+0000 7fec17400640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7febf806c8f0 0x7febf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.739+0000 7fec17400640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7febf806c8f0 0x7febf806edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec08035000 tx=0x7fec08008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:25.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.743+0000 7fec0f400640 1 -- 172.21.15.71:0/779163766 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fec1005a8e0 con 0x7fec1815a130 2024-04-20T21:19:25.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.942+0000 7fec1ca00640 1 -- 172.21.15.71:0/779163766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec1806d010 con 0x7fec1815a130 2024-04-20T21:19:25.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.943+0000 7fec0f400640 1 -- 172.21.15.71:0/779163766 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fec1005a1e0 con 0x7fec1815a130 2024-04-20T21:19:25.942 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:19:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 -- 172.21.15.71:0/779163766 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7febf806c8f0 msgr2=0x7febf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7febf806c8f0 0x7febf806edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec08035000 tx=0x7fec08008030 comp rx=0 tx=0).stop 2024-04-20T21:19:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 -- 172.21.15.71:0/779163766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec1815a130 msgr2=0x7fec18158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec1815a130 0x7fec18158a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec10007e40 tx=0x7fec1000e4b0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 -- 172.21.15.71:0/779163766 shutdown_connections 2024-04-20T21:19:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7febf806c8f0 0x7febf806edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec1815a130 0x7fec18158a60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec18071a60 0x7fec18072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 --2- 172.21.15.71:0/779163766 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec1806f870 0x7fec181f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 -- 172.21.15.71:0/779163766 >> 172.21.15.71:0/779163766 conn(0x7fec180cffa0 msgr2=0x7fec180ad420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 -- 172.21.15.71:0/779163766 shutdown_connections 2024-04-20T21:19:25.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:25.946+0000 7fec1ca00640 1 -- 172.21.15.71:0/779163766 wait complete. 2024-04-20T21:19:25.964 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-20T21:19:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.169+0000 7f05dbe00640 1 Processor -- start 2024-04-20T21:19:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.169+0000 7f05dbe00640 1 -- start start 2024-04-20T21:19:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.171+0000 7f05dbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f05dc15b400 0x7f05dc072d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.171+0000 7f05dbe00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05dc15c7f0 con 0x7f05dc15eec0 2024-04-20T21:19:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.171+0000 7f05dbe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05dc06ccc0 con 0x7f05dc15fa40 2024-04-20T21:19:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.171+0000 7f05dbe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f05dc06d280 con 0x7f05dc15b400 2024-04-20T21:19:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.171+0000 7f05da000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f05dc15eec0 0x7f05dc15f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46598/0 (socket says 172.21.15.71:46598) 2024-04-20T21:19:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.171+0000 7f05da000640 1 -- 172.21.15.71:0/1590260281 learned_addr learned my addr 172.21.15.71:0/1590260281 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:26.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.171+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3270650730 0 0) 0x7f05dc15c7f0 con 0x7f05dc15eec0 2024-04-20T21:19:26.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c0005730 con 0x7f05dc15eec0 2024-04-20T21:19:26.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05daa00640 1 --2- 172.21.15.71:0/1590260281 >> v2:172.21.15.137:3300/0 conn(0x7f05dc15b400 0x7f05dc072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1981926186 0 0) 0x7f05c0005730 con 0x7f05dc15eec0 2024-04-20T21:19:26.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 >> v2:172.21.15.137:3300/0 conn(0x7f05dc15b400 msgr2=0x7f05dc072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:26.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 --2- 172.21.15.71:0/1590260281 >> v2:172.21.15.137:3300/0 conn(0x7f05dc15b400 0x7f05dc072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 >> v1:172.21.15.137:6789/0 conn(0x7f05dc15fa40 legacy=0x7f05dc06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc06cfa0 con 0x7f05dc15eec0 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f05c8001670 con 0x7f05dc15eec0 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 >> v1:172.21.15.71:6789/0 conn(0x7f05dc15eec0 legacy=0x7f05dc15f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 --2- 172.21.15.71:0/1590260281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c0005bc0 0x7f05c0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 --2- 172.21.15.71:0/1590260281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05c0006a10 0x7f05c0006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 --2- 172.21.15.71:0/1590260281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c00073d0 0x7f05c000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc06d280 con 0x7f05c0006a10 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05c000e320 con 0x7f05c0005bc0 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05c000e520 con 0x7f05c00073d0 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05da000640 1 --2- 172.21.15.71:0/1590260281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05c0006a10 0x7f05c0006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.172+0000 7f05daa00640 1 --2- 172.21.15.71:0/1590260281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c0005bc0 0x7f05c0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.173+0000 7f05db400640 1 --2- 172.21.15.71:0/1590260281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c00073d0 0x7f05c000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.173+0000 7f05da000640 1 -- 172.21.15.71:0/1590260281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c00073d0 msgr2=0x7f05c000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.173+0000 7f05da000640 1 --2- 172.21.15.71:0/1590260281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c00073d0 0x7f05c000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.173+0000 7f05da000640 1 -- 172.21.15.71:0/1590260281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c0005bc0 msgr2=0x7f05c0005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.173+0000 7f05da000640 1 --2- 172.21.15.71:0/1590260281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c0005bc0 0x7f05c0005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.173+0000 7f05db400640 1 -- 172.21.15.71:0/1590260281 reap_dead start 2024-04-20T21:19:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.173+0000 7f05da000640 1 -- 172.21.15.71:0/1590260281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c0005730 con 0x7f05c0006a10 2024-04-20T21:19:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.174+0000 7f05da000640 1 --2- 172.21.15.71:0/1590260281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05c0006a10 0x7f05c0006e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c240 tx=0x7f05c0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22668bec6b3edccd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.175+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8007d10 con 0x7f05c0006a10 2024-04-20T21:19:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.175+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c8030070 con 0x7f05c0006a10 2024-04-20T21:19:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.175+0000 7f05d9600640 1 -- 172.21.15.71:0/1590260281 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c802cda0 con 0x7f05c0006a10 2024-04-20T21:19:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.175+0000 7f05dbe00640 1 -- 172.21.15.71:0/1590260281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05c0006a10 msgr2=0x7f05c0006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.175+0000 7f05dbe00640 1 --2- 172.21.15.71:0/1590260281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05c0006a10 0x7f05c0006e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c240 tx=0x7f05c0007a40 comp rx=0 tx=0).stop 2024-04-20T21:19:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.175+0000 7f05dbe00640 1 -- 172.21.15.71:0/1590260281 shutdown_connections 2024-04-20T21:19:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.175+0000 7f05dbe00640 1 --2- 172.21.15.71:0/1590260281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05c0006a10 0x7f05c0006e90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.175+0000 7f05dbe00640 1 -- 172.21.15.71:0/1590260281 >> 172.21.15.71:0/1590260281 conn(0x7f05dc0d0040 msgr2=0x7f05dc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.175+0000 7f05dbe00640 1 -- 172.21.15.71:0/1590260281 shutdown_connections 2024-04-20T21:19:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.175+0000 7f05dbe00640 1 -- 172.21.15.71:0/1590260281 wait complete. 2024-04-20T21:19:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.177+0000 7f05dbe00640 1 Processor -- start 2024-04-20T21:19:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.177+0000 7f05dbe00640 1 -- start start 2024-04-20T21:19:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.178+0000 7f05dbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c0006a10 0x7f05dc155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.178+0000 7f05dbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1575a0 0x7f05dc159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.178+0000 7f05dbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05dc156460 0x7f05dc15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.178+0000 7f05dbe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc15f330 con 0x7f05dc1575a0 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.178+0000 7f05dbe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc06e720 con 0x7f05dc156460 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.178+0000 7f05dbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05dc15f4b0 con 0x7f05c0006a10 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.178+0000 7f05da000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1575a0 0x7f05dc159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.178+0000 7f05da000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1575a0 0x7f05dc159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41558/0 (socket says 172.21.15.71:41558) 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.178+0000 7f05da000640 1 -- 172.21.15.71:0/2525655292 learned_addr learned my addr 172.21.15.71:0/2525655292 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05db400640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05dc156460 0x7f05dc15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05daa00640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c0006a10 0x7f05dc155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05da000640 1 -- 172.21.15.71:0/2525655292 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c0006a10 msgr2=0x7f05dc155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05da000640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c0006a10 0x7f05dc155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05da000640 1 -- 172.21.15.71:0/2525655292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05dc156460 msgr2=0x7f05dc15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05da000640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05dc156460 0x7f05dc15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05da000640 1 -- 172.21.15.71:0/2525655292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc157aa0 con 0x7f05dc1575a0 2024-04-20T21:19:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05da000640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1575a0 0x7f05dc159f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001970 tx=0x7f05c802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05d3400640 1 -- 172.21.15.71:0/2525655292 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8007d10 con 0x7f05dc1575a0 2024-04-20T21:19:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05d3400640 1 -- 172.21.15.71:0/2525655292 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c8004bf0 con 0x7f05dc1575a0 2024-04-20T21:19:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05d3400640 1 -- 172.21.15.71:0/2525655292 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8007070 con 0x7f05dc1575a0 2024-04-20T21:19:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.179+0000 7f05dbe00640 1 -- 172.21.15.71:0/2525655292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05dc157d80 con 0x7f05dc1575a0 2024-04-20T21:19:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.180+0000 7f05dbe00640 1 -- 172.21.15.71:0/2525655292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05dc158340 con 0x7f05dc1575a0 2024-04-20T21:19:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.181+0000 7f05dbe00640 1 -- 172.21.15.71:0/2525655292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05dc075b60 con 0x7f05dc1575a0 2024-04-20T21:19:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.182+0000 7f05d3400640 1 -- 172.21.15.71:0/2525655292 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05c8007210 con 0x7f05dc1575a0 2024-04-20T21:19:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.182+0000 7f05d3400640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05bc06c8f0 0x7f05bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.183+0000 7f05d3400640 1 -- 172.21.15.71:0/2525655292 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f05c80acb50 con 0x7f05dc1575a0 2024-04-20T21:19:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.183+0000 7f05daa00640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05bc06c8f0 0x7f05bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.183+0000 7f05daa00640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05bc06c8f0 0x7f05bc06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05dc09d9f0 tx=0x7f05cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:26.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.187+0000 7f05d3400640 1 -- 172.21.15.71:0/2525655292 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f05c807b230 con 0x7f05dc1575a0 2024-04-20T21:19:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.393+0000 7f05dbe00640 1 -- 172.21.15.71:0/2525655292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f05dc0cfdb0 con 0x7f05dc1575a0 2024-04-20T21:19:26.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.394+0000 7f05d3400640 1 -- 172.21.15.71:0/2525655292 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f05c807ab30 con 0x7f05dc1575a0 2024-04-20T21:19:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:26.393 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2024-04-20T21:19:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:19:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2024-04-20T21:19:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2024-04-20T21:19:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:19:26.393 INFO:teuthology.orchestra.run.smithi071.stdout:] 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 -- 172.21.15.71:0/2525655292 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05bc06c8f0 msgr2=0x7f05bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05bc06c8f0 0x7f05bc06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05dc09d9f0 tx=0x7f05cc008040 comp rx=0 tx=0).stop 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 -- 172.21.15.71:0/2525655292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1575a0 msgr2=0x7f05dc159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1575a0 0x7f05dc159f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001970 tx=0x7f05c802e070 comp rx=0 tx=0).stop 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 -- 172.21.15.71:0/2525655292 shutdown_connections 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05bc06c8f0 0x7f05bc06edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05dc156460 0x7f05dc15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1575a0 0x7f05dc159f50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 --2- 172.21.15.71:0/2525655292 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c0006a10 0x7f05dc155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 -- 172.21.15.71:0/2525655292 >> 172.21.15.71:0/2525655292 conn(0x7f05dc0d0040 msgr2=0x7f05dc06f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 -- 172.21.15.71:0/2525655292 shutdown_connections 2024-04-20T21:19:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.397+0000 7f05dbe00640 1 -- 172.21.15.71:0/2525655292 wait complete. 2024-04-20T21:19:26.414 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-20T21:19:26.414 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-20T21:19:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.622+0000 7fa24f200640 1 Processor -- start 2024-04-20T21:19:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.622+0000 7fa24f200640 1 -- start start 2024-04-20T21:19:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa25006c910 0x7fa25006cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24f200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa2500ad980 0x7fa2500ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24f200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2500af510 con 0x7fa25015e440 2024-04-20T21:19:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24f200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa25006d2b0 con 0x7fa2500ad980 2024-04-20T21:19:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa250162df0 con 0x7fa25006c910 2024-04-20T21:19:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24de00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa25015e440 0x7fa250161fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46610/0 (socket says 172.21.15.71:46610) 2024-04-20T21:19:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24de00640 1 -- 172.21.15.71:0/204423396 learned_addr learned my addr 172.21.15.71:0/204423396 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24e800640 1 --2- 172.21.15.71:0/204423396 >> v2:172.21.15.71:3300/0 conn(0x7fa2500ad980 0x7fa2500ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24d400640 1 --2- 172.21.15.71:0/204423396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa25006c910 0x7fa25006cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24ca00640 1 -- 172.21.15.71:0/204423396 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2391643408 0 0) 0x7fa2500af510 con 0x7fa25015e440 2024-04-20T21:19:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24ca00640 1 -- 172.21.15.71:0/204423396 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa234003520 con 0x7fa25015e440 2024-04-20T21:19:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24e800640 1 -- 172.21.15.71:0/204423396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa25006c910 msgr2=0x7fa25006cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24e800640 1 --2- 172.21.15.71:0/204423396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa25006c910 0x7fa25006cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.624+0000 7fa24e800640 1 -- 172.21.15.71:0/204423396 >> v1:172.21.15.71:6789/0 conn(0x7fa25015e440 legacy=0x7fa250161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.625+0000 7fa24e800640 1 -- 172.21.15.71:0/204423396 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa250162b10 con 0x7fa2500ad980 2024-04-20T21:19:26.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.626+0000 7fa24e800640 1 --2- 172.21.15.71:0/204423396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2500ad980 0x7fa2500ade10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa248009d90 tx=0x7fa24802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd75d4944fdae414 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:26.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.626+0000 7fa24ca00640 1 -- 172.21.15.71:0/204423396 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248039070 con 0x7fa2500ad980 2024-04-20T21:19:26.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.626+0000 7fa24ca00640 1 -- 172.21.15.71:0/204423396 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24802cb30 con 0x7fa2500ad980 2024-04-20T21:19:26.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.626+0000 7fa24ca00640 1 -- 172.21.15.71:0/204423396 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248034440 con 0x7fa2500ad980 2024-04-20T21:19:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.627+0000 7fa24f200640 1 -- 172.21.15.71:0/204423396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2500ad980 msgr2=0x7fa2500ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.627+0000 7fa24f200640 1 --2- 172.21.15.71:0/204423396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2500ad980 0x7fa2500ade10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa248009d90 tx=0x7fa24802bd80 comp rx=0 tx=0).stop 2024-04-20T21:19:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.627+0000 7fa24f200640 1 -- 172.21.15.71:0/204423396 shutdown_connections 2024-04-20T21:19:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.627+0000 7fa24f200640 1 --2- 172.21.15.71:0/204423396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2500ad980 0x7fa2500ade10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.627+0000 7fa24f200640 1 --2- 172.21.15.71:0/204423396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa25006c910 0x7fa25006cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.627+0000 7fa24f200640 1 -- 172.21.15.71:0/204423396 >> 172.21.15.71:0/204423396 conn(0x7fa2500cc9b0 msgr2=0x7fa2500ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.627+0000 7fa24f200640 1 -- 172.21.15.71:0/204423396 shutdown_connections 2024-04-20T21:19:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.627+0000 7fa24f200640 1 -- 172.21.15.71:0/204423396 wait complete. 2024-04-20T21:19:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.628+0000 7fa24f200640 1 Processor -- start 2024-04-20T21:19:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.629+0000 7fa24f200640 1 -- start start 2024-04-20T21:19:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.629+0000 7fa24f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa25006c910 0x7fa2500b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.629+0000 7fa24f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2500ad980 0x7fa2501e8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa25015e440 0x7fa2501e87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa2500ad460 con 0x7fa2500ad980 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2500ad180 con 0x7fa25015e440 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa25015e820 con 0x7fa25006c910 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2500ad980 0x7fa2501e8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2500ad980 0x7fa2501e8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41574/0 (socket says 172.21.15.71:41574) 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24d400640 1 -- 172.21.15.71:0/3719370597 learned_addr learned my addr 172.21.15.71:0/3719370597 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24de00640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa25006c910 0x7fa2500b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24e800640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa25015e440 0x7fa2501e87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24d400640 1 -- 172.21.15.71:0/3719370597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa25006c910 msgr2=0x7fa2500b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24d400640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa25006c910 0x7fa2500b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24d400640 1 -- 172.21.15.71:0/3719370597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa25015e440 msgr2=0x7fa2501e87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24d400640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa25015e440 0x7fa2501e87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24d400640 1 -- 172.21.15.71:0/3719370597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2500c5b50 con 0x7fa2500ad980 2024-04-20T21:19:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.630+0000 7fa24e800640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa25015e440 0x7fa2501e87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.631+0000 7fa24d400640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2500ad980 0x7fa2501e8290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00d620 tx=0x7fa23c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.631+0000 7fa246000640 1 -- 172.21.15.71:0/3719370597 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00b620 con 0x7fa2500ad980 2024-04-20T21:19:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.631+0000 7fa246000640 1 -- 172.21.15.71:0/3719370597 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23c019070 con 0x7fa2500ad980 2024-04-20T21:19:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.631+0000 7fa246000640 1 -- 172.21.15.71:0/3719370597 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00ba00 con 0x7fa2500ad980 2024-04-20T21:19:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.631+0000 7fa24f200640 1 -- 172.21.15.71:0/3719370597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2500c5e30 con 0x7fa2500ad980 2024-04-20T21:19:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.631+0000 7fa24f200640 1 -- 172.21.15.71:0/3719370597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2500c63f0 con 0x7fa2500ad980 2024-04-20T21:19:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.632+0000 7fa24f200640 1 -- 172.21.15.71:0/3719370597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa250075b30 con 0x7fa2500ad980 2024-04-20T21:19:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.633+0000 7fa246000640 1 -- 172.21.15.71:0/3719370597 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa23c00bba0 con 0x7fa2500ad980 2024-04-20T21:19:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.634+0000 7fa246000640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa23006c8f0 0x7fa23006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.634+0000 7fa246000640 1 -- 172.21.15.71:0/3719370597 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa23c08bcb0 con 0x7fa2500ad980 2024-04-20T21:19:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.634+0000 7fa24de00640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa23006c8f0 0x7fa23006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.635+0000 7fa24de00640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa23006c8f0 0x7fa23006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa240000f60 tx=0x7fa240009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.638+0000 7fa246000640 1 -- 172.21.15.71:0/3719370597 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa23c05a390 con 0x7fa2500ad980 2024-04-20T21:19:26.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:26.834+0000 7fa24f200640 1 -- 172.21.15.71:0/3719370597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa250161c70 con 0x7fa2500ad980 2024-04-20T21:19:27.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.309+0000 7fa246000640 1 -- 172.21.15.71:0/3719370597 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fa23c059c90 con 0x7fa2500ad980 2024-04-20T21:19:27.308 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2024-04-20T21:19:27.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.313+0000 7fa24f200640 1 -- 172.21.15.71:0/3719370597 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa23006c8f0 msgr2=0x7fa23006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.313+0000 7fa24f200640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa23006c8f0 0x7fa23006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa240000f60 tx=0x7fa240009040 comp rx=0 tx=0).stop 2024-04-20T21:19:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.313+0000 7fa24f200640 1 -- 172.21.15.71:0/3719370597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2500ad980 msgr2=0x7fa2501e8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.313+0000 7fa24f200640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2500ad980 0x7fa2501e8290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00d620 tx=0x7fa23c00dae0 comp rx=0 tx=0).stop 2024-04-20T21:19:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.314+0000 7fa24f200640 1 -- 172.21.15.71:0/3719370597 shutdown_connections 2024-04-20T21:19:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.314+0000 7fa24f200640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa23006c8f0 0x7fa23006edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.314+0000 7fa24f200640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa25015e440 0x7fa2501e87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.314+0000 7fa24f200640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2500ad980 0x7fa2501e8290 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.314+0000 7fa24f200640 1 --2- 172.21.15.71:0/3719370597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa25006c910 0x7fa2500b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.314+0000 7fa24f200640 1 -- 172.21.15.71:0/3719370597 >> 172.21.15.71:0/3719370597 conn(0x7fa2500cc9b0 msgr2=0x7fa2500add60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.314+0000 7fa24f200640 1 -- 172.21.15.71:0/3719370597 shutdown_connections 2024-04-20T21:19:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.314+0000 7fa24f200640 1 -- 172.21.15.71:0/3719370597 wait complete. 2024-04-20T21:19:27.344 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-20T21:19:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.533+0000 7f5555a00640 1 Processor -- start 2024-04-20T21:19:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.533+0000 7f5555a00640 1 -- start start 2024-04-20T21:19:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.534+0000 7f5555a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f555006cde0 0x7f55500d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.534+0000 7f5555a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55500b3330 0x7f55500b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f5555a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f555006c190 con 0x7f5550161d50 2024-04-20T21:19:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f5555a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5550162130 con 0x7f555006cde0 2024-04-20T21:19:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f5555a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f555006c470 con 0x7f55500b3330 2024-04-20T21:19:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f554f400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f555006cde0 0x7f55500d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f554f400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f555006cde0 0x7f55500d38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41576/0 (socket says 172.21.15.71:41576) 2024-04-20T21:19:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f554f400640 1 -- 172.21.15.71:0/143166899 learned_addr learned my addr 172.21.15.71:0/143166899 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f5555000640 1 --2- 172.21.15.71:0/143166899 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55500b3330 0x7f55500b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f554f400640 1 -- 172.21.15.71:0/143166899 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55500b3330 msgr2=0x7f55500b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f554f400640 1 --2- 172.21.15.71:0/143166899 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55500b3330 0x7f55500b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f554f400640 1 -- 172.21.15.71:0/143166899 >> v1:172.21.15.137:6789/0 conn(0x7f5550161d50 legacy=0x7f555006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f554f400640 1 -- 172.21.15.71:0/143166899 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55500d2e00 con 0x7f555006cde0 2024-04-20T21:19:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.535+0000 7f5555000640 1 --2- 172.21.15.71:0/143166899 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55500b3330 0x7f55500b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.536+0000 7f554f400640 1 --2- 172.21.15.71:0/143166899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f555006cde0 0x7f55500d38e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f55500d1f00 tx=0x7f553c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590a6edc93c0432b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.537+0000 7f554ea00640 1 -- 172.21.15.71:0/143166899 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c035020 con 0x7f555006cde0 2024-04-20T21:19:27.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.537+0000 7f554ea00640 1 -- 172.21.15.71:0/143166899 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553c031830 con 0x7f555006cde0 2024-04-20T21:19:27.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.537+0000 7f554ea00640 1 -- 172.21.15.71:0/143166899 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c031c00 con 0x7f555006cde0 2024-04-20T21:19:27.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.537+0000 7f5555a00640 1 -- 172.21.15.71:0/143166899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f555006cde0 msgr2=0x7f55500d38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.537+0000 7f5555a00640 1 --2- 172.21.15.71:0/143166899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f555006cde0 0x7f55500d38e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f55500d1f00 tx=0x7f553c02b8d0 comp rx=0 tx=0).stop 2024-04-20T21:19:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.538+0000 7f5555a00640 1 -- 172.21.15.71:0/143166899 shutdown_connections 2024-04-20T21:19:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.538+0000 7f5555a00640 1 --2- 172.21.15.71:0/143166899 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55500b3330 0x7f55500b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.538+0000 7f5555a00640 1 --2- 172.21.15.71:0/143166899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f555006cde0 0x7f55500d38e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.538+0000 7f5555a00640 1 -- 172.21.15.71:0/143166899 >> 172.21.15.71:0/143166899 conn(0x7f55500d4450 msgr2=0x7f55500d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.538+0000 7f5555a00640 1 -- 172.21.15.71:0/143166899 shutdown_connections 2024-04-20T21:19:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.538+0000 7f5555a00640 1 -- 172.21.15.71:0/143166899 wait complete. 2024-04-20T21:19:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.539+0000 7f5555a00640 1 Processor -- start 2024-04-20T21:19:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.539+0000 7f5555a00640 1 -- start start 2024-04-20T21:19:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.540+0000 7f5555a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f555006cde0 0x7f55500ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.540+0000 7f5555a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55500b3330 0x7f55501f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.540+0000 7f5555a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5550161d50 0x7f55501f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.540+0000 7f5555a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55500b7660 con 0x7f5550161d50 2024-04-20T21:19:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.540+0000 7f5555a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55500d33c0 con 0x7f555006cde0 2024-04-20T21:19:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.540+0000 7f5555a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55500b77e0 con 0x7f55500b3330 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f5555000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5550161d50 0x7f55501f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f5555000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5550161d50 0x7f55501f4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41578/0 (socket says 172.21.15.71:41578) 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f5555000640 1 -- 172.21.15.71:0/672005300 learned_addr learned my addr 172.21.15.71:0/672005300 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f554f400640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55500b3330 0x7f55501f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f554fe00640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f555006cde0 0x7f55500ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f5555000640 1 -- 172.21.15.71:0/672005300 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55500b3330 msgr2=0x7f55501f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f5555000640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55500b3330 0x7f55501f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f5555000640 1 -- 172.21.15.71:0/672005300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f555006cde0 msgr2=0x7f55500ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f5555000640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f555006cde0 0x7f55500ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f5555000640 1 -- 172.21.15.71:0/672005300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55501f5830 con 0x7f5550161d50 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f554fe00640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f555006cde0 0x7f55500ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.541+0000 7f5555000640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5550161d50 0x7f55501f4ed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f554800cef0 tx=0x7f554800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.542+0000 7f5547e00640 1 -- 172.21.15.71:0/672005300 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554801a070 con 0x7f5550161d50 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.542+0000 7f5547e00640 1 -- 172.21.15.71:0/672005300 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f554800d860 con 0x7f5550161d50 2024-04-20T21:19:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.542+0000 7f5547e00640 1 -- 172.21.15.71:0/672005300 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554800dc50 con 0x7f5550161d50 2024-04-20T21:19:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.542+0000 7f5555a00640 1 -- 172.21.15.71:0/672005300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55501f5550 con 0x7f5550161d50 2024-04-20T21:19:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.542+0000 7f5555a00640 1 -- 172.21.15.71:0/672005300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55500b3da0 con 0x7f5550161d50 2024-04-20T21:19:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.543+0000 7f5555a00640 1 -- 172.21.15.71:0/672005300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55500cb2e0 con 0x7f5550161d50 2024-04-20T21:19:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.544+0000 7f5547e00640 1 -- 172.21.15.71:0/672005300 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f554801d070 con 0x7f5550161d50 2024-04-20T21:19:27.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.545+0000 7f5547e00640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f553006c8f0 0x7f553006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:27.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.545+0000 7f5547e00640 1 -- 172.21.15.71:0/672005300 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f554808c2a0 con 0x7f5550161d50 2024-04-20T21:19:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.545+0000 7f554fe00640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f553006c8f0 0x7f553006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.546+0000 7f554fe00640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f553006c8f0 0x7f553006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f554000a830 tx=0x7f5540008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.550+0000 7f5547e00640 1 -- 172.21.15.71:0/672005300 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f554805a8d0 con 0x7f5550161d50 2024-04-20T21:19:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:27.736+0000 7f5555a00640 1 -- 172.21.15.71:0/672005300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f55500b9c10 con 0x7f5550161d50 2024-04-20T21:19:28.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.315+0000 7f5547e00640 1 -- 172.21.15.71:0/672005300 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f554805a1d0 con 0x7f5550161d50 2024-04-20T21:19:28.314 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2024-04-20T21:19:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.319+0000 7f5555a00640 1 -- 172.21.15.71:0/672005300 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f553006c8f0 msgr2=0x7f553006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.319+0000 7f5555a00640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f553006c8f0 0x7f553006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f554000a830 tx=0x7f5540008040 comp rx=0 tx=0).stop 2024-04-20T21:19:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.319+0000 7f5555a00640 1 -- 172.21.15.71:0/672005300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5550161d50 msgr2=0x7f55501f4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.319+0000 7f5555a00640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5550161d50 0x7f55501f4ed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f554800cef0 tx=0x7f554800a710 comp rx=0 tx=0).stop 2024-04-20T21:19:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.319+0000 7f5555a00640 1 -- 172.21.15.71:0/672005300 shutdown_connections 2024-04-20T21:19:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.319+0000 7f5555a00640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f553006c8f0 0x7f553006edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.319+0000 7f5555a00640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5550161d50 0x7f55501f4ed0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.319+0000 7f5555a00640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55500b3330 0x7f55501f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.319+0000 7f5555a00640 1 --2- 172.21.15.71:0/672005300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f555006cde0 0x7f55500ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.319+0000 7f5555a00640 1 -- 172.21.15.71:0/672005300 >> 172.21.15.71:0/672005300 conn(0x7f55500d4450 msgr2=0x7f55500b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.320+0000 7f5555a00640 1 -- 172.21.15.71:0/672005300 shutdown_connections 2024-04-20T21:19:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.320+0000 7f5555a00640 1 -- 172.21.15.71:0/672005300 wait complete. 2024-04-20T21:19:28.350 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-20T21:19:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.526+0000 7f9339400640 1 Processor -- start 2024-04-20T21:19:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.526+0000 7f9339400640 1 -- start start 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.527+0000 7f9339400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93340d0010 0x7f93340adc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.527+0000 7f9339400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93340ae140 0x7f933406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.527+0000 7f9339400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f933415b5d0 con 0x7f933415b1f0 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.527+0000 7f9339400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f933406e730 con 0x7f93340ae140 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.527+0000 7f9339400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f93340d05d0 con 0x7f93340d0010 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.528+0000 7f9338a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93340ae140 0x7f933406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.528+0000 7f9338a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93340ae140 0x7f933406ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41592/0 (socket says 172.21.15.71:41592) 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.528+0000 7f9338a00640 1 -- 172.21.15.71:0/2485849585 learned_addr learned my addr 172.21.15.71:0/2485849585 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.528+0000 7f932b400640 1 --2- 172.21.15.71:0/2485849585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93340d0010 0x7f93340adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.528+0000 7f9338a00640 1 -- 172.21.15.71:0/2485849585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93340d0010 msgr2=0x7f93340adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.528+0000 7f9338a00640 1 --2- 172.21.15.71:0/2485849585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93340d0010 0x7f93340adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.528+0000 7f9338a00640 1 -- 172.21.15.71:0/2485849585 >> v1:172.21.15.137:6789/0 conn(0x7f933415b1f0 legacy=0x7f933415f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:28.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.528+0000 7f9338a00640 1 -- 172.21.15.71:0/2485849585 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93340d08b0 con 0x7f93340ae140 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.529+0000 7f9338a00640 1 --2- 172.21.15.71:0/2485849585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93340ae140 0x7f933406ca10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f932c009870 tx=0x7f932c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7443e56e5b753f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.529+0000 7f9333400640 1 -- 172.21.15.71:0/2485849585 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c035020 con 0x7f93340ae140 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.529+0000 7f9333400640 1 -- 172.21.15.71:0/2485849585 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f932c031640 con 0x7f93340ae140 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.529+0000 7f9333400640 1 -- 172.21.15.71:0/2485849585 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c02d040 con 0x7f93340ae140 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.530+0000 7f9339400640 1 -- 172.21.15.71:0/2485849585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93340ae140 msgr2=0x7f933406ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.530+0000 7f9339400640 1 --2- 172.21.15.71:0/2485849585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93340ae140 0x7f933406ca10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f932c009870 tx=0x7f932c02b8f0 comp rx=0 tx=0).stop 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.530+0000 7f9339400640 1 -- 172.21.15.71:0/2485849585 shutdown_connections 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.530+0000 7f9339400640 1 --2- 172.21.15.71:0/2485849585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93340d0010 0x7f93340adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.530+0000 7f9339400640 1 --2- 172.21.15.71:0/2485849585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93340ae140 0x7f933406ca10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.530+0000 7f9339400640 1 -- 172.21.15.71:0/2485849585 >> 172.21.15.71:0/2485849585 conn(0x7f93340b5270 msgr2=0x7f93340b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.530+0000 7f9339400640 1 -- 172.21.15.71:0/2485849585 shutdown_connections 2024-04-20T21:19:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.530+0000 7f9339400640 1 -- 172.21.15.71:0/2485849585 wait complete. 2024-04-20T21:19:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.532+0000 7f9339400640 1 Processor -- start 2024-04-20T21:19:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.532+0000 7f9339400640 1 -- start start 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9339400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93340ae140 0x7f933414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9339400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93340d0010 0x7f9334150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9339400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f933415b1f0 0x7f93341505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9339400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f933406cf50 con 0x7f93340ae140 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9339400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f93340d0e70 con 0x7f933415b1f0 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9339400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f933406d0d0 con 0x7f93340d0010 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9333e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93340ae140 0x7f933414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9333e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93340ae140 0x7f933414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41606/0 (socket says 172.21.15.71:41606) 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9333e00640 1 -- 172.21.15.71:0/672328564 learned_addr learned my addr 172.21.15.71:0/672328564 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9333e00640 1 -- 172.21.15.71:0/672328564 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93340d0010 msgr2=0x7f9334150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9333e00640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93340d0010 0x7f9334150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9333e00640 1 -- 172.21.15.71:0/672328564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f933415b1f0 msgr2=0x7f93341505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9333e00640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f933415b1f0 0x7f93341505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.533+0000 7f9333e00640 1 -- 172.21.15.71:0/672328564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9334156cd0 con 0x7f93340ae140 2024-04-20T21:19:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.534+0000 7f9333e00640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93340ae140 0x7f933414d950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f932400ba50 tx=0x7f932400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.534+0000 7f9330c00640 1 -- 172.21.15.71:0/672328564 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324019070 con 0x7f93340ae140 2024-04-20T21:19:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.534+0000 7f9330c00640 1 -- 172.21.15.71:0/672328564 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f932400cc20 con 0x7f93340ae140 2024-04-20T21:19:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.534+0000 7f9330c00640 1 -- 172.21.15.71:0/672328564 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324014680 con 0x7f93340ae140 2024-04-20T21:19:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.534+0000 7f9339400640 1 -- 172.21.15.71:0/672328564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9334156fb0 con 0x7f93340ae140 2024-04-20T21:19:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.534+0000 7f9339400640 1 -- 172.21.15.71:0/672328564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9334157570 con 0x7f93340ae140 2024-04-20T21:19:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.535+0000 7f9339400640 1 -- 172.21.15.71:0/672328564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933406cc10 con 0x7f93340ae140 2024-04-20T21:19:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.536+0000 7f9330c00640 1 -- 172.21.15.71:0/672328564 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f932401c070 con 0x7f93340ae140 2024-04-20T21:19:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.537+0000 7f9330c00640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f931006c8f0 0x7f931006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.537+0000 7f9330c00640 1 -- 172.21.15.71:0/672328564 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f932408b780 con 0x7f93340ae140 2024-04-20T21:19:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.537+0000 7f932b400640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f931006c8f0 0x7f931006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.538+0000 7f932b400640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f931006c8f0 0x7f931006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9334155970 tx=0x7f931c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:28.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.542+0000 7f9330c00640 1 -- 172.21.15.71:0/672328564 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f933406cc10 con 0x7f93340ae140 2024-04-20T21:19:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:28.762+0000 7f9339400640 1 -- 172.21.15.71:0/672328564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9334075b30 con 0x7f93340ae140 2024-04-20T21:19:29.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.361+0000 7f9330c00640 1 -- 172.21.15.71:0/672328564 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f93240595b0 con 0x7f93340ae140 2024-04-20T21:19:29.365 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 2 and data pool 3 2024-04-20T21:19:29.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.369+0000 7f9339400640 1 -- 172.21.15.71:0/672328564 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f931006c8f0 msgr2=0x7f931006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:29.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.369+0000 7f9339400640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f931006c8f0 0x7f931006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9334155970 tx=0x7f931c008040 comp rx=0 tx=0).stop 2024-04-20T21:19:29.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.369+0000 7f9339400640 1 -- 172.21.15.71:0/672328564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93340ae140 msgr2=0x7f933414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:29.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.369+0000 7f9339400640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93340ae140 0x7f933414d950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f932400ba50 tx=0x7f932400bf10 comp rx=0 tx=0).stop 2024-04-20T21:19:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.371+0000 7f9339400640 1 -- 172.21.15.71:0/672328564 shutdown_connections 2024-04-20T21:19:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.371+0000 7f9339400640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f931006c8f0 0x7f931006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.371+0000 7f9339400640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f933415b1f0 0x7f93341505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.371+0000 7f9339400640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93340d0010 0x7f9334150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.371+0000 7f9339400640 1 --2- 172.21.15.71:0/672328564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93340ae140 0x7f933414d950 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.371+0000 7f9339400640 1 -- 172.21.15.71:0/672328564 >> 172.21.15.71:0/672328564 conn(0x7f93340b5270 msgr2=0x7f93340afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.372+0000 7f9339400640 1 -- 172.21.15.71:0/672328564 shutdown_connections 2024-04-20T21:19:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.373+0000 7f9339400640 1 -- 172.21.15.71:0/672328564 wait complete. 2024-04-20T21:19:29.411 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-20T21:19:29.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-20T21:19:29.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.581+0000 7fddd3200640 1 Processor -- start 2024-04-20T21:19:29.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.582+0000 7fddd3200640 1 -- start start 2024-04-20T21:19:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddd3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddcc0cfa00 0x7fddcc15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddd3200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fddcc0cfde0 0x7fddcc0cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddd3200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fddcc158780 0x7fddcc158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddd3200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fddcc0d0680 con 0x7fddcc0cfde0 2024-04-20T21:19:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddd3200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fddcc159130 con 0x7fddcc158780 2024-04-20T21:19:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddd3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fddcc0ce200 con 0x7fddcc0cfa00 2024-04-20T21:19:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddc3400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fddcc0cfde0 0x7fddcc0cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddc3400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fddcc0cfde0 0x7fddcc0cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41618/0 (socket says 172.21.15.71:41618) 2024-04-20T21:19:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddc3400640 1 -- 172.21.15.71:0/3776357763 learned_addr learned my addr 172.21.15.71:0/3776357763 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddc3400640 1 -- 172.21.15.71:0/3776357763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddcc0cfa00 msgr2=0x7fddcc15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddc3400640 1 --2- 172.21.15.71:0/3776357763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddcc0cfa00 0x7fddcc15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddc3400640 1 -- 172.21.15.71:0/3776357763 >> v2:172.21.15.137:3300/0 conn(0x7fddcc158780 msgr2=0x7fddcc158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddc3400640 1 --2- 172.21.15.71:0/3776357763 >> v2:172.21.15.137:3300/0 conn(0x7fddcc158780 0x7fddcc158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.583+0000 7fddc3400640 1 -- 172.21.15.71:0/3776357763 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddcc0ce4a0 con 0x7fddcc0cfde0 2024-04-20T21:19:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.584+0000 7fddc3400640 1 --2- 172.21.15.71:0/3776357763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc0cfde0 0x7fddcc0cdcc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fddcc071860 tx=0x7fddb402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a91149dcbaf5f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.585+0000 7fddcb400640 1 -- 172.21.15.71:0/3776357763 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb402e070 con 0x7fddcc0cfde0 2024-04-20T21:19:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.585+0000 7fddcb400640 1 -- 172.21.15.71:0/3776357763 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb4037070 con 0x7fddcc0cfde0 2024-04-20T21:19:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.585+0000 7fddcb400640 1 -- 172.21.15.71:0/3776357763 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4031a00 con 0x7fddcc0cfde0 2024-04-20T21:19:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.585+0000 7fddd3200640 1 -- 172.21.15.71:0/3776357763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc0cfde0 msgr2=0x7fddcc0cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.585+0000 7fddd3200640 1 --2- 172.21.15.71:0/3776357763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc0cfde0 0x7fddcc0cdcc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fddcc071860 tx=0x7fddb402b880 comp rx=0 tx=0).stop 2024-04-20T21:19:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.585+0000 7fddd3200640 1 -- 172.21.15.71:0/3776357763 shutdown_connections 2024-04-20T21:19:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.585+0000 7fddd3200640 1 --2- 172.21.15.71:0/3776357763 >> v2:172.21.15.137:3300/0 conn(0x7fddcc158780 0x7fddcc158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.585+0000 7fddd3200640 1 --2- 172.21.15.71:0/3776357763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc0cfde0 0x7fddcc0cdcc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.585+0000 7fddd3200640 1 --2- 172.21.15.71:0/3776357763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddcc0cfa00 0x7fddcc15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.585+0000 7fddd3200640 1 -- 172.21.15.71:0/3776357763 >> 172.21.15.71:0/3776357763 conn(0x7fddcc070450 msgr2=0x7fddcc070860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.586+0000 7fddd3200640 1 -- 172.21.15.71:0/3776357763 shutdown_connections 2024-04-20T21:19:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.586+0000 7fddd3200640 1 -- 172.21.15.71:0/3776357763 wait complete. 2024-04-20T21:19:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.587+0000 7fddd3200640 1 Processor -- start 2024-04-20T21:19:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.587+0000 7fddd3200640 1 -- start start 2024-04-20T21:19:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.588+0000 7fddd3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddcc0cfa00 0x7fddcc153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.588+0000 7fddd3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc0cfde0 0x7fddcc1f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.588+0000 7fddd3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddcc158780 0x7fddcc0b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.588+0000 7fddd3200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc0ced40 con 0x7fddcc0cfde0 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.588+0000 7fddd3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc0cea60 con 0x7fddcc158780 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.588+0000 7fddd3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fddcc0b4350 con 0x7fddcc0cfa00 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.588+0000 7fddc3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc0cfde0 0x7fddcc1f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.588+0000 7fddc3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc0cfde0 0x7fddcc1f5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41620/0 (socket says 172.21.15.71:41620) 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.589+0000 7fddc3400640 1 -- 172.21.15.71:0/4131052853 learned_addr learned my addr 172.21.15.71:0/4131052853 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.589+0000 7fddc3400640 1 -- 172.21.15.71:0/4131052853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddcc0cfa00 msgr2=0x7fddcc153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.589+0000 7fddc3400640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddcc0cfa00 0x7fddcc153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.589+0000 7fddc3400640 1 -- 172.21.15.71:0/4131052853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddcc158780 msgr2=0x7fddcc0b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.589+0000 7fddc3400640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddcc158780 0x7fddcc0b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.589+0000 7fddc3400640 1 -- 172.21.15.71:0/4131052853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddcc0aeef0 con 0x7fddcc0cfde0 2024-04-20T21:19:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.589+0000 7fddc3400640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc0cfde0 0x7fddcc1f5940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddb4000c00 tx=0x7fddb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.589+0000 7fddc8c00640 1 -- 172.21.15.71:0/4131052853 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4032880 con 0x7fddcc0cfde0 2024-04-20T21:19:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.589+0000 7fddc8c00640 1 -- 172.21.15.71:0/4131052853 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb4032a20 con 0x7fddcc0cfde0 2024-04-20T21:19:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.589+0000 7fddc8c00640 1 -- 172.21.15.71:0/4131052853 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4032e10 con 0x7fddcc0cfde0 2024-04-20T21:19:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.589+0000 7fddd3200640 1 -- 172.21.15.71:0/4131052853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddcc0af1d0 con 0x7fddcc0cfde0 2024-04-20T21:19:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.590+0000 7fddd3200640 1 -- 172.21.15.71:0/4131052853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddcc0af790 con 0x7fddcc0cfde0 2024-04-20T21:19:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.591+0000 7fddd3200640 1 -- 172.21.15.71:0/4131052853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddcc068980 con 0x7fddcc0cfde0 2024-04-20T21:19:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.592+0000 7fddc8c00640 1 -- 172.21.15.71:0/4131052853 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fddb404c060 con 0x7fddcc0cfde0 2024-04-20T21:19:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.592+0000 7fddc8c00640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdda806c8f0 0x7fdda806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.592+0000 7fddc8c00640 1 -- 172.21.15.71:0/4131052853 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fddb40ad990 con 0x7fddcc0cfde0 2024-04-20T21:19:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.593+0000 7fddcbe00640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdda806c8f0 0x7fdda806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.593+0000 7fddcbe00640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdda806c8f0 0x7fdda806edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fddcc161ec0 tx=0x7fddbc009250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:29.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.597+0000 7fddc8c00640 1 -- 172.21.15.71:0/4131052853 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fddb4040070 con 0x7fddcc0cfde0 2024-04-20T21:19:29.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:29.791+0000 7fddd3200640 1 -- 172.21.15.71:0/4131052853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fddcc06c190 con 0x7fddcc0cfde0 2024-04-20T21:19:29.928 INFO:tasks.ceph.mds.a.smithi071.stderr:2024-04-20T21:19:29.929+0000 7f71d2000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T21:19:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.363+0000 7fddc8c00640 1 -- 172.21.15.71:0/4131052853 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7fddb4039310 con 0x7fddcc0cfde0 2024-04-20T21:19:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.367+0000 7fddd3200640 1 -- 172.21.15.71:0/4131052853 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdda806c8f0 msgr2=0x7fdda806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.367+0000 7fddd3200640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdda806c8f0 0x7fdda806edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fddcc161ec0 tx=0x7fddbc009250 comp rx=0 tx=0).stop 2024-04-20T21:19:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.367+0000 7fddd3200640 1 -- 172.21.15.71:0/4131052853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc0cfde0 msgr2=0x7fddcc1f5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.367+0000 7fddd3200640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc0cfde0 0x7fddcc1f5940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddb4000c00 tx=0x7fddb40046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.368+0000 7fddd3200640 1 -- 172.21.15.71:0/4131052853 shutdown_connections 2024-04-20T21:19:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.368+0000 7fddd3200640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdda806c8f0 0x7fdda806edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.368+0000 7fddd3200640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddcc158780 0x7fddcc0b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.368+0000 7fddd3200640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc0cfde0 0x7fddcc1f5940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.368+0000 7fddd3200640 1 --2- 172.21.15.71:0/4131052853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddcc0cfa00 0x7fddcc153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.368+0000 7fddd3200640 1 -- 172.21.15.71:0/4131052853 >> 172.21.15.71:0/4131052853 conn(0x7fddcc070450 msgr2=0x7fddcc070830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.368+0000 7fddd3200640 1 -- 172.21.15.71:0/4131052853 shutdown_connections 2024-04-20T21:19:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.368+0000 7fddd3200640 1 -- 172.21.15.71:0/4131052853 wait complete. 2024-04-20T21:19:30.387 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-20T21:19:30.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.592+0000 7f7c81600640 1 Processor -- start 2024-04-20T21:19:30.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.593+0000 7f7c81600640 1 -- start start 2024-04-20T21:19:30.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.594+0000 7f7c81600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7c7c15e630 0x7f7c7c0ae100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:30.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.594+0000 7f7c81600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c7c15ea10 0x7f7c7c0b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:30.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.594+0000 7f7c81600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c7c0cf1d0 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.594+0000 7f7c81600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7c7c0cf4b0 con 0x7f7c7c15e630 2024-04-20T21:19:30.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.594+0000 7f7c81600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7c7c0cf790 con 0x7f7c7c15ea10 2024-04-20T21:19:30.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.595+0000 7f7c7aa00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7c7c15e630 0x7f7c7c0ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:30.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.595+0000 7f7c7aa00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7c7c15e630 0x7f7c7c0ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41624/0 (socket says 172.21.15.71:41624) 2024-04-20T21:19:30.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.595+0000 7f7c7aa00640 1 -- 172.21.15.71:0/3435033698 learned_addr learned my addr 172.21.15.71:0/3435033698 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:30.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.595+0000 7f7c7a000640 1 --2- 172.21.15.71:0/3435033698 >> v2:172.21.15.137:3300/0 conn(0x7f7c7c15ea10 0x7f7c7c0b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:30.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.595+0000 7f7c7aa00640 1 -- 172.21.15.71:0/3435033698 >> v2:172.21.15.137:3300/0 conn(0x7f7c7c15ea10 msgr2=0x7f7c7c0b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:30.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.595+0000 7f7c7aa00640 1 --2- 172.21.15.71:0/3435033698 >> v2:172.21.15.137:3300/0 conn(0x7f7c7c15ea10 0x7f7c7c0b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:30.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.595+0000 7f7c7aa00640 1 -- 172.21.15.71:0/3435033698 >> v1:172.21.15.137:6789/0 conn(0x7f7c7c0b5b90 legacy=0x7f7c7c072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:30.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.595+0000 7f7c7aa00640 1 -- 172.21.15.71:0/3435033698 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7c0cfa70 con 0x7f7c7c15e630 2024-04-20T21:19:30.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.597+0000 7f7c7aa00640 1 --2- 172.21.15.71:0/3435033698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c15e630 0x7f7c7c0ae100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c162310 tx=0x7f7c6c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5c90d90ee3aacb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:30.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.597+0000 7f7c79600640 1 -- 172.21.15.71:0/3435033698 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c034070 con 0x7f7c7c15e630 2024-04-20T21:19:30.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.597+0000 7f7c79600640 1 -- 172.21.15.71:0/3435033698 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c6c030860 con 0x7f7c7c15e630 2024-04-20T21:19:30.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.597+0000 7f7c79600640 1 -- 172.21.15.71:0/3435033698 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c030c30 con 0x7f7c7c15e630 2024-04-20T21:19:30.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.598+0000 7f7c81600640 1 -- 172.21.15.71:0/3435033698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c15e630 msgr2=0x7f7c7c0ae100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:30.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.598+0000 7f7c81600640 1 --2- 172.21.15.71:0/3435033698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c15e630 0x7f7c7c0ae100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c162310 tx=0x7f7c6c02b9a0 comp rx=0 tx=0).stop 2024-04-20T21:19:30.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.598+0000 7f7c81600640 1 -- 172.21.15.71:0/3435033698 shutdown_connections 2024-04-20T21:19:30.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.598+0000 7f7c81600640 1 --2- 172.21.15.71:0/3435033698 >> v2:172.21.15.137:3300/0 conn(0x7f7c7c15ea10 0x7f7c7c0b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:30.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.598+0000 7f7c81600640 1 --2- 172.21.15.71:0/3435033698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c15e630 0x7f7c7c0ae100 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:30.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.598+0000 7f7c81600640 1 -- 172.21.15.71:0/3435033698 >> 172.21.15.71:0/3435033698 conn(0x7f7c7c0cdd50 msgr2=0x7f7c7c0ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:30.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.598+0000 7f7c81600640 1 -- 172.21.15.71:0/3435033698 shutdown_connections 2024-04-20T21:19:30.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.598+0000 7f7c81600640 1 -- 172.21.15.71:0/3435033698 wait complete. 2024-04-20T21:19:30.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.600+0000 7f7c81600640 1 Processor -- start 2024-04-20T21:19:30.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.600+0000 7f7c81600640 1 -- start start 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c81600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c0b5b90 0x7f7c7c14a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c81600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c7c15e630 0x7f7c7c146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c81600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c7c15ea10 0x7f7c7c147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c81600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c0ae640 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c81600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c0d0030 con 0x7f7c7c15ea10 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c81600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7c7c0ae7c0 con 0x7f7c7c15e630 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c7aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c0b5b90 0x7f7c7c14a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c7aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c0b5b90 0x7f7c7c14a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41632/0 (socket says 172.21.15.71:41632) 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c7aa00640 1 -- 172.21.15.71:0/1324730749 learned_addr learned my addr 172.21.15.71:0/1324730749 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c7aa00640 1 -- 172.21.15.71:0/1324730749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c7c15e630 msgr2=0x7f7c7c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c7aa00640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c7c15e630 0x7f7c7c146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c7aa00640 1 -- 172.21.15.71:0/1324730749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c7c15ea10 msgr2=0x7f7c7c147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:30.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c7aa00640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c7c15ea10 0x7f7c7c147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:30.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.601+0000 7f7c7aa00640 1 -- 172.21.15.71:0/1324730749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7c1e90e0 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.602+0000 7f7c7aa00640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c0b5b90 0x7f7c7c14a960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c02b9e0 tx=0x7f7c6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:30.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.602+0000 7f7c72a00640 1 -- 172.21.15.71:0/1324730749 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c048070 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.602+0000 7f7c72a00640 1 -- 172.21.15.71:0/1324730749 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c6c030660 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.602+0000 7f7c81600640 1 -- 172.21.15.71:0/1324730749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7c1e93c0 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.602+0000 7f7c72a00640 1 -- 172.21.15.71:0/1324730749 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c034040 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.602+0000 7f7c81600640 1 -- 172.21.15.71:0/1324730749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7c1e9980 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.603+0000 7f7c81600640 1 -- 172.21.15.71:0/1324730749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c7c069090 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.604+0000 7f7c72a00640 1 -- 172.21.15.71:0/1324730749 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c6c04b070 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.605+0000 7f7c72a00640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7c5c06c8f0 0x7f7c5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:30.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.605+0000 7f7c72a00640 1 -- 172.21.15.71:0/1324730749 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f7c6c0add60 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.605+0000 7f7c7a000640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7c5c06c8f0 0x7f7c5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:30.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.606+0000 7f7c7a000640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7c5c06c8f0 0x7f7c5c06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c68006fd0 tx=0x7f7c68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:30.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.609+0000 7f7c72a00640 1 -- 172.21.15.71:0/1324730749 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7c6c07bfc0 con 0x7f7c7c0b5b90 2024-04-20T21:19:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:30.813+0000 7f7c81600640 1 -- 172.21.15.71:0/1324730749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7c7c06fbd0 con 0x7f7c7c0b5b90 2024-04-20T21:19:32.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.585+0000 7f7c72a00640 1 -- 172.21.15.71:0/1324730749 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f7c6c07b8c0 con 0x7f7c7c0b5b90 2024-04-20T21:19:32.585 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data_ec' created 2024-04-20T21:19:32.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.588+0000 7f7c81600640 1 -- 172.21.15.71:0/1324730749 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7c5c06c8f0 msgr2=0x7f7c5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:32.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.588+0000 7f7c81600640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7c5c06c8f0 0x7f7c5c06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c68006fd0 tx=0x7f7c68008040 comp rx=0 tx=0).stop 2024-04-20T21:19:32.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.589+0000 7f7c81600640 1 -- 172.21.15.71:0/1324730749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c0b5b90 msgr2=0x7f7c7c14a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:32.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.589+0000 7f7c81600640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c0b5b90 0x7f7c7c14a960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c02b9e0 tx=0x7f7c6c004730 comp rx=0 tx=0).stop 2024-04-20T21:19:32.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.589+0000 7f7c81600640 1 -- 172.21.15.71:0/1324730749 shutdown_connections 2024-04-20T21:19:32.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.589+0000 7f7c81600640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7c5c06c8f0 0x7f7c5c06edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:32.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.589+0000 7f7c81600640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c7c15ea10 0x7f7c7c147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:32.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.589+0000 7f7c81600640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c7c15e630 0x7f7c7c146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:32.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.589+0000 7f7c81600640 1 --2- 172.21.15.71:0/1324730749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c0b5b90 0x7f7c7c14a960 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:32.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.589+0000 7f7c81600640 1 -- 172.21.15.71:0/1324730749 >> 172.21.15.71:0/1324730749 conn(0x7f7c7c0cdd50 msgr2=0x7f7c7c15a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:32.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.589+0000 7f7c81600640 1 -- 172.21.15.71:0/1324730749 shutdown_connections 2024-04-20T21:19:32.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.589+0000 7f7c81600640 1 -- 172.21.15.71:0/1324730749 wait complete. 2024-04-20T21:19:32.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-20T21:19:32.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.798+0000 7f1323800640 1 Processor -- start 2024-04-20T21:19:32.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.799+0000 7f1323800640 1 -- start start 2024-04-20T21:19:32.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.800+0000 7f1323800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f131c161c50 0x7f131c0d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:32.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.800+0000 7f1323800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c0d4e70 0x7f131c0d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:32.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.800+0000 7f1323800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f131c0d0130 con 0x7f131c0b61e0 2024-04-20T21:19:32.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.800+0000 7f1323800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f131c0b6e60 con 0x7f131c161c50 2024-04-20T21:19:32.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.800+0000 7f1323800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f131c0d0410 con 0x7f131c0d4e70 2024-04-20T21:19:32.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.801+0000 7f1321800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c0d4e70 0x7f131c0d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:32.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.801+0000 7f1321800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c0d4e70 0x7f131c0d3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:42798/0 (socket says 172.21.15.71:42798) 2024-04-20T21:19:32.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.801+0000 7f1321800640 1 -- 172.21.15.71:0/935361119 learned_addr learned my addr 172.21.15.71:0/935361119 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:32.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.801+0000 7f1320e00640 1 --2- 172.21.15.71:0/935361119 >> v2:172.21.15.137:3300/0 conn(0x7f131c161c50 0x7f131c0d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:32.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.802+0000 7f1321800640 1 -- 172.21.15.71:0/935361119 >> v2:172.21.15.137:3300/0 conn(0x7f131c161c50 msgr2=0x7f131c0d0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:32.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.802+0000 7f1321800640 1 --2- 172.21.15.71:0/935361119 >> v2:172.21.15.137:3300/0 conn(0x7f131c161c50 0x7f131c0d0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:32.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.802+0000 7f131b400640 1 -- 172.21.15.71:0/935361119 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227117321 0 0) 0x7f131c0d0130 con 0x7f131c0b61e0 2024-04-20T21:19:32.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.802+0000 7f1321800640 1 -- 172.21.15.71:0/935361119 >> v1:172.21.15.137:6789/0 conn(0x7f131c0b61e0 legacy=0x7f131c0d4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:32.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.802+0000 7f1321800640 1 -- 172.21.15.71:0/935361119 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c0d06f0 con 0x7f131c0d4e70 2024-04-20T21:19:32.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.803+0000 7f1321800640 1 --2- 172.21.15.71:0/935361119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c0d4e70 0x7f131c0d3770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1314009e50 tx=0x7f131402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a59ff0843851c93c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:32.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.803+0000 7f131b400640 1 -- 172.21.15.71:0/935361119 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131402ca70 con 0x7f131c0d4e70 2024-04-20T21:19:32.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.804+0000 7f131b400640 1 -- 172.21.15.71:0/935361119 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131402cc10 con 0x7f131c0d4e70 2024-04-20T21:19:32.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.804+0000 7f131b400640 1 -- 172.21.15.71:0/935361119 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13140343f0 con 0x7f131c0d4e70 2024-04-20T21:19:32.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.804+0000 7f1323800640 1 -- 172.21.15.71:0/935361119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c0d4e70 msgr2=0x7f131c0d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:32.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.804+0000 7f1323800640 1 --2- 172.21.15.71:0/935361119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c0d4e70 0x7f131c0d3770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1314009e50 tx=0x7f131402bed0 comp rx=0 tx=0).stop 2024-04-20T21:19:32.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.804+0000 7f1323800640 1 -- 172.21.15.71:0/935361119 shutdown_connections 2024-04-20T21:19:32.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.804+0000 7f1323800640 1 --2- 172.21.15.71:0/935361119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c0d4e70 0x7f131c0d3770 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:32.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.804+0000 7f1323800640 1 --2- 172.21.15.71:0/935361119 >> v2:172.21.15.137:3300/0 conn(0x7f131c161c50 0x7f131c0d0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:32.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.804+0000 7f1323800640 1 -- 172.21.15.71:0/935361119 >> 172.21.15.71:0/935361119 conn(0x7f131c0b9510 msgr2=0x7f131c0b9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:32.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.804+0000 7f1323800640 1 -- 172.21.15.71:0/935361119 shutdown_connections 2024-04-20T21:19:32.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.805+0000 7f1323800640 1 -- 172.21.15.71:0/935361119 wait complete. 2024-04-20T21:19:32.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.806+0000 7f1323800640 1 Processor -- start 2024-04-20T21:19:32.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.807+0000 7f1323800640 1 -- start start 2024-04-20T21:19:32.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f1323800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f131c0b61e0 0x7f131c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:32.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f1323800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f131c0d4e70 0x7f131c09e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:32.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f1323800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c161c50 0x7f131c09eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:32.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f1323800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f131c0cfdc0 con 0x7f131c0d4e70 2024-04-20T21:19:32.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f1323800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f131c0d3250 con 0x7f131c0b61e0 2024-04-20T21:19:32.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f1323800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f131c162030 con 0x7f131c161c50 2024-04-20T21:19:32.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f131be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f131c0d4e70 0x7f131c09e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:32.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f131be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f131c0d4e70 0x7f131c09e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41640/0 (socket says 172.21.15.71:41640) 2024-04-20T21:19:32.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f131be00640 1 -- 172.21.15.71:0/2532938012 learned_addr learned my addr 172.21.15.71:0/2532938012 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:32.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f1320e00640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f131c0b61e0 0x7f131c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:32.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f1321800640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c161c50 0x7f131c09eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f131be00640 1 -- 172.21.15.71:0/2532938012 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c161c50 msgr2=0x7f131c09eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f131be00640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c161c50 0x7f131c09eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f131be00640 1 -- 172.21.15.71:0/2532938012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f131c0b61e0 msgr2=0x7f131c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.808+0000 7f131be00640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f131c0b61e0 0x7f131c15eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.809+0000 7f131be00640 1 -- 172.21.15.71:0/2532938012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c15d070 con 0x7f131c0d4e70 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.809+0000 7f1320e00640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f131c0b61e0 0x7f131c15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.809+0000 7f131be00640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f131c0d4e70 0x7f131c09e5f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f130400c460 tx=0x7f130400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.809+0000 7f1318c00640 1 -- 172.21.15.71:0/2532938012 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304005480 con 0x7f131c0d4e70 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.809+0000 7f1318c00640 1 -- 172.21.15.71:0/2532938012 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13040035f0 con 0x7f131c0d4e70 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.809+0000 7f1323800640 1 -- 172.21.15.71:0/2532938012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131c15d350 con 0x7f131c0d4e70 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.809+0000 7f1318c00640 1 -- 172.21.15.71:0/2532938012 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304003a00 con 0x7f131c0d4e70 2024-04-20T21:19:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.809+0000 7f1323800640 1 -- 172.21.15.71:0/2532938012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131c15d910 con 0x7f131c0d4e70 2024-04-20T21:19:32.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.810+0000 7f1323800640 1 -- 172.21.15.71:0/2532938012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131c068980 con 0x7f131c0d4e70 2024-04-20T21:19:32.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.811+0000 7f1318c00640 1 -- 172.21.15.71:0/2532938012 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1304003ba0 con 0x7f131c0d4e70 2024-04-20T21:19:32.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.812+0000 7f1318c00640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f12f806ca90 0x7f12f806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:32.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.812+0000 7f1318c00640 1 -- 172.21.15.71:0/2532938012 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f130408bc70 con 0x7f131c0d4e70 2024-04-20T21:19:32.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.813+0000 7f1320e00640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f12f806ca90 0x7f12f806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:32.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.813+0000 7f1320e00640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f12f806ca90 0x7f12f806ef50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f130c009af0 tx=0x7f130c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:32.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:32.818+0000 7f1318c00640 1 -- 172.21.15.71:0/2532938012 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1304059c50 con 0x7f131c0d4e70 2024-04-20T21:19:33.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.014+0000 7f1323800640 1 -- 172.21.15.71:0/2532938012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f131c0d2130 con 0x7f131c0d4e70 2024-04-20T21:19:33.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.589+0000 7f1318c00640 1 -- 172.21.15.71:0/2532938012 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f1304059550 con 0x7f131c0d4e70 2024-04-20T21:19:33.590 INFO:teuthology.orchestra.run.smithi071.stderr:set pool 4 allow_ec_overwrites to true 2024-04-20T21:19:33.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.594+0000 7f1323800640 1 -- 172.21.15.71:0/2532938012 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f12f806ca90 msgr2=0x7f12f806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:33.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.594+0000 7f1323800640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f12f806ca90 0x7f12f806ef50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f130c009af0 tx=0x7f130c008040 comp rx=0 tx=0).stop 2024-04-20T21:19:33.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.594+0000 7f1323800640 1 -- 172.21.15.71:0/2532938012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f131c0d4e70 msgr2=0x7f131c09e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:33.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.594+0000 7f1323800640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f131c0d4e70 0x7f131c09e5f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f130400c460 tx=0x7f130400c920 comp rx=0 tx=0).stop 2024-04-20T21:19:33.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.594+0000 7f1323800640 1 -- 172.21.15.71:0/2532938012 shutdown_connections 2024-04-20T21:19:33.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.594+0000 7f1323800640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f12f806ca90 0x7f12f806ef50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.594+0000 7f1323800640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f131c161c50 0x7f131c09eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.594+0000 7f1323800640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f131c0d4e70 0x7f131c09e5f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.594+0000 7f1323800640 1 --2- 172.21.15.71:0/2532938012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f131c0b61e0 0x7f131c15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.594+0000 7f1323800640 1 -- 172.21.15.71:0/2532938012 >> 172.21.15.71:0/2532938012 conn(0x7f131c0b9510 msgr2=0x7f131c0b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.595+0000 7f1323800640 1 -- 172.21.15.71:0/2532938012 shutdown_connections 2024-04-20T21:19:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.595+0000 7f1323800640 1 -- 172.21.15.71:0/2532938012 wait complete. 2024-04-20T21:19:33.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-20T21:19:33.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.811+0000 7f24e8a00640 1 Processor -- start 2024-04-20T21:19:33.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.811+0000 7f24e8a00640 1 -- start start 2024-04-20T21:19:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.813+0000 7f24e8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24e415b310 0x7f24e40cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.813+0000 7f24e8a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f24e40cfc90 0x7f24e415ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.813+0000 7f24e8a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f24e415f3d0 0x7f24e415b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.813+0000 7f24e8a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f24e40d0a40 con 0x7f24e40cfc90 2024-04-20T21:19:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.813+0000 7f24e8a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f24e40d01a0 con 0x7f24e415f3d0 2024-04-20T21:19:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.813+0000 7f24e8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24e40d0480 con 0x7f24e415b310 2024-04-20T21:19:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.813+0000 7f24dbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f24e40cfc90 0x7f24e415ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.813+0000 7f24dbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f24e40cfc90 0x7f24e415ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38150/0 (socket says 172.21.15.71:38150) 2024-04-20T21:19:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.813+0000 7f24dbe00640 1 -- 172.21.15.71:0/1092854456 learned_addr learned my addr 172.21.15.71:0/1092854456 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:33.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.814+0000 7f24e3e00640 1 --2- 172.21.15.71:0/1092854456 >> v2:172.21.15.137:3300/0 conn(0x7f24e415f3d0 0x7f24e415b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:33.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.814+0000 7f24dbe00640 1 -- 172.21.15.71:0/1092854456 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24e415b310 msgr2=0x7f24e40cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:33.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.814+0000 7f24dbe00640 1 --2- 172.21.15.71:0/1092854456 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24e415b310 0x7f24e40cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:33.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.814+0000 7f24dbe00640 1 -- 172.21.15.71:0/1092854456 >> v2:172.21.15.137:3300/0 conn(0x7f24e415f3d0 msgr2=0x7f24e415b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:33.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.814+0000 7f24dbe00640 1 --2- 172.21.15.71:0/1092854456 >> v2:172.21.15.137:3300/0 conn(0x7f24e415f3d0 0x7f24e415b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:33.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.814+0000 7f24dbe00640 1 -- 172.21.15.71:0/1092854456 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e40d0760 con 0x7f24e40cfc90 2024-04-20T21:19:33.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.814+0000 7f24e3e00640 1 --2- 172.21.15.71:0/1092854456 >> v2:172.21.15.137:3300/0 conn(0x7f24e415f3d0 0x7f24e415b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:33.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.815+0000 7f24dbe00640 1 --2- 172.21.15.71:0/1092854456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24e40cfc90 0x7f24e415ee90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24e40cdb20 tx=0x7f24cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37282c7d00618f02 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.815+0000 7f24e2a00640 1 -- 172.21.15.71:0/1092854456 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc035020 con 0x7f24e40cfc90 2024-04-20T21:19:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.815+0000 7f24e2a00640 1 -- 172.21.15.71:0/1092854456 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24cc031870 con 0x7f24e40cfc90 2024-04-20T21:19:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.815+0000 7f24e2a00640 1 -- 172.21.15.71:0/1092854456 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc031c40 con 0x7f24e40cfc90 2024-04-20T21:19:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.816+0000 7f24e8a00640 1 -- 172.21.15.71:0/1092854456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24e40cfc90 msgr2=0x7f24e415ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.816+0000 7f24e8a00640 1 --2- 172.21.15.71:0/1092854456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24e40cfc90 0x7f24e415ee90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24e40cdb20 tx=0x7f24cc02b910 comp rx=0 tx=0).stop 2024-04-20T21:19:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.816+0000 7f24e8a00640 1 -- 172.21.15.71:0/1092854456 shutdown_connections 2024-04-20T21:19:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.816+0000 7f24e8a00640 1 --2- 172.21.15.71:0/1092854456 >> v2:172.21.15.137:3300/0 conn(0x7f24e415f3d0 0x7f24e415b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.816+0000 7f24e8a00640 1 --2- 172.21.15.71:0/1092854456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24e40cfc90 0x7f24e415ee90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.816+0000 7f24e8a00640 1 --2- 172.21.15.71:0/1092854456 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24e415b310 0x7f24e40cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.816+0000 7f24e8a00640 1 -- 172.21.15.71:0/1092854456 >> 172.21.15.71:0/1092854456 conn(0x7f24e4070090 msgr2=0x7f24e40704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:33.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.816+0000 7f24e8a00640 1 -- 172.21.15.71:0/1092854456 shutdown_connections 2024-04-20T21:19:33.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.816+0000 7f24e8a00640 1 -- 172.21.15.71:0/1092854456 wait complete. 2024-04-20T21:19:33.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.818+0000 7f24e8a00640 1 Processor -- start 2024-04-20T21:19:33.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.818+0000 7f24e8a00640 1 -- start start 2024-04-20T21:19:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24e8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24e40cfc90 0x7f24e41429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24e8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24e415b310 0x7f24e41e4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24e8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24e415f3d0 0x7f24e413f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24e8a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f24e415fd20 con 0x7f24e415b310 2024-04-20T21:19:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24e8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24e415fba0 con 0x7f24e415f3d0 2024-04-20T21:19:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24e8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24e415bc30 con 0x7f24e40cfc90 2024-04-20T21:19:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24dbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24e415b310 0x7f24e41e4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24dbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24e415b310 0x7f24e41e4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38164/0 (socket says 172.21.15.71:38164) 2024-04-20T21:19:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24dbe00640 1 -- 172.21.15.71:0/105056001 learned_addr learned my addr 172.21.15.71:0/105056001 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24e3e00640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24e415f3d0 0x7f24e413f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24dbe00640 1 -- 172.21.15.71:0/105056001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24e40cfc90 msgr2=0x7f24e41429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24dbe00640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24e40cfc90 0x7f24e41429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24dbe00640 1 -- 172.21.15.71:0/105056001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24e415f3d0 msgr2=0x7f24e413f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24dbe00640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24e415f3d0 0x7f24e413f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.819+0000 7f24dbe00640 1 -- 172.21.15.71:0/105056001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e413ff80 con 0x7f24e415b310 2024-04-20T21:19:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.820+0000 7f24dbe00640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24e415b310 0x7f24e41e4be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f24cc000c00 tx=0x7f24cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.820+0000 7f24db400640 1 -- 172.21.15.71:0/105056001 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc035040 con 0x7f24e415b310 2024-04-20T21:19:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.820+0000 7f24db400640 1 -- 172.21.15.71:0/105056001 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24cc045480 con 0x7f24e415b310 2024-04-20T21:19:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.820+0000 7f24e8a00640 1 -- 172.21.15.71:0/105056001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e4140260 con 0x7f24e415b310 2024-04-20T21:19:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.820+0000 7f24db400640 1 -- 172.21.15.71:0/105056001 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc045870 con 0x7f24e415b310 2024-04-20T21:19:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.820+0000 7f24e8a00640 1 -- 172.21.15.71:0/105056001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e4140820 con 0x7f24e415b310 2024-04-20T21:19:33.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.821+0000 7f24e8a00640 1 -- 172.21.15.71:0/105056001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e4075b30 con 0x7f24e415b310 2024-04-20T21:19:33.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.822+0000 7f24db400640 1 -- 172.21.15.71:0/105056001 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24cc038020 con 0x7f24e415b310 2024-04-20T21:19:33.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.823+0000 7f24db400640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f24c006c8f0 0x7f24c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:33.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.823+0000 7f24db400640 1 -- 172.21.15.71:0/105056001 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f24cc0ae390 con 0x7f24e415b310 2024-04-20T21:19:33.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.823+0000 7f24e3400640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f24c006c8f0 0x7f24c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:33.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.824+0000 7f24e3400640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f24c006c8f0 0x7f24c006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009710 tx=0x7f24d4006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:33.827+0000 7f24db400640 1 -- 172.21.15.71:0/105056001 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f24cc07c490 con 0x7f24e415b310 2024-04-20T21:19:34.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.064+0000 7f24e8a00640 1 -- 172.21.15.71:0/105056001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f24e406f250 con 0x7f24e415b310 2024-04-20T21:19:34.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.630+0000 7f24db400640 1 -- 172.21.15.71:0/105056001 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f24cc07bd90 con 0x7f24e415b310 2024-04-20T21:19:34.630 INFO:teuthology.orchestra.run.smithi071.stderr:added data pool 4 to fsmap 2024-04-20T21:19:34.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.634+0000 7f24e8a00640 1 -- 172.21.15.71:0/105056001 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f24c006c8f0 msgr2=0x7f24c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:34.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.634+0000 7f24e8a00640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f24c006c8f0 0x7f24c006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009710 tx=0x7f24d4006c90 comp rx=0 tx=0).stop 2024-04-20T21:19:34.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.634+0000 7f24e8a00640 1 -- 172.21.15.71:0/105056001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24e415b310 msgr2=0x7f24e41e4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:34.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.634+0000 7f24e8a00640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24e415b310 0x7f24e41e4be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f24cc000c00 tx=0x7f24cc0046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.634+0000 7f24e8a00640 1 -- 172.21.15.71:0/105056001 shutdown_connections 2024-04-20T21:19:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.634+0000 7f24e8a00640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f24c006c8f0 0x7f24c006edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.634+0000 7f24e8a00640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24e415f3d0 0x7f24e413f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.634+0000 7f24e8a00640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24e415b310 0x7f24e41e4be0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.634+0000 7f24e8a00640 1 --2- 172.21.15.71:0/105056001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24e40cfc90 0x7f24e41429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.634+0000 7f24e8a00640 1 -- 172.21.15.71:0/105056001 >> 172.21.15.71:0/105056001 conn(0x7f24e4070090 msgr2=0x7f24e415c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.634+0000 7f24e8a00640 1 -- 172.21.15.71:0/105056001 shutdown_connections 2024-04-20T21:19:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.635+0000 7f24e8a00640 1 -- 172.21.15.71:0/105056001 wait complete. 2024-04-20T21:19:34.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:19:34.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.854+0000 7f09b8a00640 1 Processor -- start 2024-04-20T21:19:34.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.854+0000 7f09b8a00640 1 -- start start 2024-04-20T21:19:34.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.856+0000 7f09b8a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09b40d4270 0x7f09b40d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:34.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.856+0000 7f09b8a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f09b40d4650 0x7f09b40b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:34.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.856+0000 7f09b8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b40b17d0 0x7f09b40d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:34.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.856+0000 7f09b8a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f09b40d40c0 con 0x7f09b40d4650 2024-04-20T21:19:34.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.856+0000 7f09b8a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f09b40d3820 con 0x7f09b40d4270 2024-04-20T21:19:34.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.856+0000 7f09b8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f09b40d3b00 con 0x7f09b40b17d0 2024-04-20T21:19:34.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.856+0000 7f09b1400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f09b40d4650 0x7f09b40b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:34.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.856+0000 7f09b1400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f09b40d4650 0x7f09b40b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38170/0 (socket says 172.21.15.71:38170) 2024-04-20T21:19:34.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.856+0000 7f09b1400640 1 -- 172.21.15.71:0/3043650986 learned_addr learned my addr 172.21.15.71:0/3043650986 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:34.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.857+0000 7f09b2800640 1 --2- 172.21.15.71:0/3043650986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b40b17d0 0x7f09b40d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:34.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.857+0000 7f09b1e00640 1 --2- 172.21.15.71:0/3043650986 >> v2:172.21.15.137:3300/0 conn(0x7f09b40d4270 0x7f09b40d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:34.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.857+0000 7f09b1400640 1 -- 172.21.15.71:0/3043650986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b40b17d0 msgr2=0x7f09b40d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:34.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.857+0000 7f09b1400640 1 --2- 172.21.15.71:0/3043650986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b40b17d0 0x7f09b40d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.857+0000 7f09b1400640 1 -- 172.21.15.71:0/3043650986 >> v2:172.21.15.137:3300/0 conn(0x7f09b40d4270 msgr2=0x7f09b40d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:34.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.857+0000 7f09b1400640 1 --2- 172.21.15.71:0/3043650986 >> v2:172.21.15.137:3300/0 conn(0x7f09b40d4270 0x7f09b40d1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.857+0000 7f09b1400640 1 -- 172.21.15.71:0/3043650986 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b40d3de0 con 0x7f09b40d4650 2024-04-20T21:19:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.858+0000 7f09b1400640 1 --2- 172.21.15.71:0/3043650986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40d4650 0x7f09b40b1290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09b408e820 tx=0x7f09a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b71d8e450ecfa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.858+0000 7f09b0a00640 1 -- 172.21.15.71:0/3043650986 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0035020 con 0x7f09b40d4650 2024-04-20T21:19:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.858+0000 7f09b0a00640 1 -- 172.21.15.71:0/3043650986 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a0031870 con 0x7f09b40d4650 2024-04-20T21:19:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.858+0000 7f09b0a00640 1 -- 172.21.15.71:0/3043650986 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0031c40 con 0x7f09b40d4650 2024-04-20T21:19:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.859+0000 7f09b8a00640 1 -- 172.21.15.71:0/3043650986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40d4650 msgr2=0x7f09b40b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.859+0000 7f09b8a00640 1 --2- 172.21.15.71:0/3043650986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40d4650 0x7f09b40b1290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09b408e820 tx=0x7f09a002b910 comp rx=0 tx=0).stop 2024-04-20T21:19:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.859+0000 7f09b8a00640 1 -- 172.21.15.71:0/3043650986 shutdown_connections 2024-04-20T21:19:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.859+0000 7f09b8a00640 1 --2- 172.21.15.71:0/3043650986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b40b17d0 0x7f09b40d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.859+0000 7f09b8a00640 1 --2- 172.21.15.71:0/3043650986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40d4650 0x7f09b40b1290 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.859+0000 7f09b8a00640 1 --2- 172.21.15.71:0/3043650986 >> v2:172.21.15.137:3300/0 conn(0x7f09b40d4270 0x7f09b40d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.859+0000 7f09b8a00640 1 -- 172.21.15.71:0/3043650986 >> 172.21.15.71:0/3043650986 conn(0x7f09b40b99c0 msgr2=0x7f09b40b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.859+0000 7f09b8a00640 1 -- 172.21.15.71:0/3043650986 shutdown_connections 2024-04-20T21:19:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.859+0000 7f09b8a00640 1 -- 172.21.15.71:0/3043650986 wait complete. 2024-04-20T21:19:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.861+0000 7f09b8a00640 1 Processor -- start 2024-04-20T21:19:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.862+0000 7f09b8a00640 1 -- start start 2024-04-20T21:19:34.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.863+0000 7f09b8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b40b17d0 0x7f09b415dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:34.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.863+0000 7f09b8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40d4270 0x7f09b406e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.863+0000 7f09b8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09b40d4650 0x7f09b40c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.863+0000 7f09b8a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09b40d4ae0 con 0x7f09b40d4270 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.863+0000 7f09b8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09b40d53b0 con 0x7f09b40d4650 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.863+0000 7f09b8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f09b40d4c60 con 0x7f09b40b17d0 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.863+0000 7f09b1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40d4270 0x7f09b406e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.863+0000 7f09b1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40d4270 0x7f09b406e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38180/0 (socket says 172.21.15.71:38180) 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.863+0000 7f09b1400640 1 -- 172.21.15.71:0/2893274783 learned_addr learned my addr 172.21.15.71:0/2893274783 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.863+0000 7f09b1e00640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b40b17d0 0x7f09b415dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.863+0000 7f09b2800640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09b40d4650 0x7f09b40c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.864+0000 7f09b1400640 1 -- 172.21.15.71:0/2893274783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b40b17d0 msgr2=0x7f09b415dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.864+0000 7f09b1400640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b40b17d0 0x7f09b415dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.864+0000 7f09b1400640 1 -- 172.21.15.71:0/2893274783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09b40d4650 msgr2=0x7f09b40c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:34.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.864+0000 7f09b1400640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09b40d4650 0x7f09b40c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:34.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.864+0000 7f09b1400640 1 -- 172.21.15.71:0/2893274783 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b415e3e0 con 0x7f09b40d4270 2024-04-20T21:19:34.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.864+0000 7f09b1400640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40d4270 0x7f09b406e9d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f09a002b950 tx=0x7f09a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:34.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.864+0000 7f09aa000640 1 -- 172.21.15.71:0/2893274783 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0041070 con 0x7f09b40d4270 2024-04-20T21:19:34.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.864+0000 7f09aa000640 1 -- 172.21.15.71:0/2893274783 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a003ac80 con 0x7f09b40d4270 2024-04-20T21:19:34.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.864+0000 7f09aa000640 1 -- 172.21.15.71:0/2893274783 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0035040 con 0x7f09b40d4270 2024-04-20T21:19:34.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.864+0000 7f09b8a00640 1 -- 172.21.15.71:0/2893274783 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b406bde0 con 0x7f09b40d4270 2024-04-20T21:19:34.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.864+0000 7f09b8a00640 1 -- 172.21.15.71:0/2893274783 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b406c3a0 con 0x7f09b40d4270 2024-04-20T21:19:34.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.866+0000 7f09b8a00640 1 -- 172.21.15.71:0/2893274783 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b4068980 con 0x7f09b40d4270 2024-04-20T21:19:34.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.866+0000 7f09aa000640 1 -- 172.21.15.71:0/2893274783 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f09a0038020 con 0x7f09b40d4270 2024-04-20T21:19:34.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.867+0000 7f09aa000640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f099406c8f0 0x7f099406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:34.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.868+0000 7f09aa000640 1 -- 172.21.15.71:0/2893274783 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f09a00addd0 con 0x7f09b40d4270 2024-04-20T21:19:34.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.868+0000 7f09b1e00640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f099406c8f0 0x7f099406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:34.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.868+0000 7f09b1e00640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f099406c8f0 0x7f099406edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f09a4007130 tx=0x7f09a4007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:34.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:34.872+0000 7f09aa000640 1 -- 172.21.15.71:0/2893274783 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f09a007be20 con 0x7f09b40d4270 2024-04-20T21:19:35.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.113+0000 7f09b8a00640 1 -- 172.21.15.71:0/2893274783 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09b40b6c40 con 0x7f09b40d4270 2024-04-20T21:19:35.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.114+0000 7f09aa000640 1 -- 172.21.15.71:0/2893274783 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5201 (secure 0 0 0) 0x7f09a007b720 con 0x7f09b40d4270 2024-04-20T21:19:35.114 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:35.114 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3502151495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3502151495},{"type":"v1","addr":"172.21.15.137:6833","nonce":3502151495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2603023903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2603023903},{"type":"v1","addr":"172.21.15.137:6835","nonce":2603023903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3246613850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3246613850},{"type":"v1","addr":"172.21.15.71:6835","nonce":3246613850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:19:28.763862+0000","modified":"2024-04-20T21:19:34.067101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/4085222328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":4085222328},{"type":"v1","addr":"172.21.15.71:6837","nonce":4085222328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-20T21:19:35.115 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 6 2024-04-20T21:19:35.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.117+0000 7f09b8a00640 1 -- 172.21.15.71:0/2893274783 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f099406c8f0 msgr2=0x7f099406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.117+0000 7f09b8a00640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f099406c8f0 0x7f099406edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f09a4007130 tx=0x7f09a4007040 comp rx=0 tx=0).stop 2024-04-20T21:19:35.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.117+0000 7f09b8a00640 1 -- 172.21.15.71:0/2893274783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40d4270 msgr2=0x7f09b406e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.117+0000 7f09b8a00640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40d4270 0x7f09b406e9d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f09a002b950 tx=0x7f09a00046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.117+0000 7f09b8a00640 1 -- 172.21.15.71:0/2893274783 shutdown_connections 2024-04-20T21:19:35.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.117+0000 7f09b8a00640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f099406c8f0 0x7f099406edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.117+0000 7f09b8a00640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09b40d4650 0x7f09b40c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.117+0000 7f09b8a00640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40d4270 0x7f09b406e9d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.117+0000 7f09b8a00640 1 --2- 172.21.15.71:0/2893274783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b40b17d0 0x7f09b415dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.117+0000 7f09b8a00640 1 -- 172.21.15.71:0/2893274783 >> 172.21.15.71:0/2893274783 conn(0x7f09b40b99c0 msgr2=0x7f09b40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:35.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.117+0000 7f09b8a00640 1 -- 172.21.15.71:0/2893274783 shutdown_connections 2024-04-20T21:19:35.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.118+0000 7f09b8a00640 1 -- 172.21.15.71:0/2893274783 wait complete. 2024-04-20T21:19:35.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:35.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.332+0000 7fdff9400640 1 Processor -- start 2024-04-20T21:19:35.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.332+0000 7fdff9400640 1 -- start start 2024-04-20T21:19:35.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.334+0000 7fdff9400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdff4161d50 0x7fdff40d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.334+0000 7fdff9400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff406c190 con 0x7fdff406cde0 2024-04-20T21:19:35.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.334+0000 7fdff9400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff406c470 con 0x7fdff40b3330 2024-04-20T21:19:35.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.334+0000 7fdff9400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdff4162130 con 0x7fdff4161d50 2024-04-20T21:19:35.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.334+0000 7fdff8a00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdff406cde0 0x7fdff40b7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45616/0 (socket says 172.21.15.71:45616) 2024-04-20T21:19:35.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.334+0000 7fdff8a00640 1 -- 172.21.15.71:0/2986127754 learned_addr learned my addr 172.21.15.71:0/2986127754 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:35.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.334+0000 7fdff3e00640 1 --2- 172.21.15.71:0/2986127754 >> v2:172.21.15.137:3300/0 conn(0x7fdff4161d50 0x7fdff40d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.334+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082223504 0 0) 0x7fdff406c190 con 0x7fdff406cde0 2024-04-20T21:19:35.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfd8003520 con 0x7fdff406cde0 2024-04-20T21:19:35.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3431352398 0 0) 0x7fdfd8003520 con 0x7fdff406cde0 2024-04-20T21:19:35.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 >> v2:172.21.15.137:3300/0 conn(0x7fdff4161d50 msgr2=0x7fdff40d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:35.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 --2- 172.21.15.71:0/2986127754 >> v2:172.21.15.137:3300/0 conn(0x7fdff4161d50 0x7fdff40d38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 >> v1:172.21.15.137:6789/0 conn(0x7fdff40b3330 legacy=0x7fdff406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff40d2e00 con 0x7fdff406cde0 2024-04-20T21:19:35.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fdfe4001670 con 0x7fdff406cde0 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 >> v1:172.21.15.71:6789/0 conn(0x7fdff406cde0 legacy=0x7fdff40b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 --2- 172.21.15.71:0/2986127754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd80039b0 0x7fdfd8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 --2- 172.21.15.71:0/2986127754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfd8004800 0x7fdfd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 --2- 172.21.15.71:0/2986127754 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdfd80051c0 0x7fdfd800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd800c030 con 0x7fdfd8004800 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd800c1e0 con 0x7fdfd80039b0 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd800c3e0 con 0x7fdfd80051c0 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.335+0000 7fdff3400640 1 --2- 172.21.15.71:0/2986127754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfd8004800 0x7fdfd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.336+0000 7fdff3400640 1 -- 172.21.15.71:0/2986127754 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdfd80051c0 msgr2=0x7fdfd800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.336+0000 7fdff3400640 1 --2- 172.21.15.71:0/2986127754 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdfd80051c0 0x7fdfd800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.336+0000 7fdff3e00640 1 --2- 172.21.15.71:0/2986127754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd80039b0 0x7fdfd8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.336+0000 7fdff3400640 1 -- 172.21.15.71:0/2986127754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd80039b0 msgr2=0x7fdfd8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.336+0000 7fdff3400640 1 --2- 172.21.15.71:0/2986127754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd80039b0 0x7fdfd8003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.336+0000 7fdff3400640 1 -- 172.21.15.71:0/2986127754 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd8003520 con 0x7fdfd8004800 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.336+0000 7fdff8a00640 1 -- 172.21.15.71:0/2986127754 reap_dead start 2024-04-20T21:19:35.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.337+0000 7fdff3400640 1 --2- 172.21.15.71:0/2986127754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfd8004800 0x7fdfd8004c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc001750 tx=0x7fdfd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ebda39a6da31e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:35.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.337+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc001370 con 0x7fdfd8004800 2024-04-20T21:19:35.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.337+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfdc0052d0 con 0x7fdfd8004800 2024-04-20T21:19:35.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.337+0000 7fdff2a00640 1 -- 172.21.15.71:0/2986127754 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc003830 con 0x7fdfd8004800 2024-04-20T21:19:35.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.337+0000 7fdff9400640 1 -- 172.21.15.71:0/2986127754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfd8004800 msgr2=0x7fdfd8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.337+0000 7fdff9400640 1 --2- 172.21.15.71:0/2986127754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfd8004800 0x7fdfd8004c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc001750 tx=0x7fdfd8005830 comp rx=0 tx=0).stop 2024-04-20T21:19:35.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.338+0000 7fdff9400640 1 -- 172.21.15.71:0/2986127754 shutdown_connections 2024-04-20T21:19:35.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.338+0000 7fdff9400640 1 --2- 172.21.15.71:0/2986127754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfd8004800 0x7fdfd8004c80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.338+0000 7fdff9400640 1 -- 172.21.15.71:0/2986127754 >> 172.21.15.71:0/2986127754 conn(0x7fdff40d4450 msgr2=0x7fdff40d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:35.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.338+0000 7fdff9400640 1 -- 172.21.15.71:0/2986127754 shutdown_connections 2024-04-20T21:19:35.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.338+0000 7fdff9400640 1 -- 172.21.15.71:0/2986127754 wait complete. 2024-04-20T21:19:35.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.339+0000 7fdff9400640 1 Processor -- start 2024-04-20T21:19:35.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.339+0000 7fdff9400640 1 -- start start 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.340+0000 7fdff9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd8004800 0x7fdff414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.340+0000 7fdff9400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ca960 0x7fdff40cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.340+0000 7fdff9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff40b93a0 0x7fdff40b9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.340+0000 7fdff9400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdff40d38e0 con 0x7fdff40b93a0 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.340+0000 7fdff9400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdff40d33c0 con 0x7fdfd8004800 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.340+0000 7fdff9400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdff40d3a60 con 0x7fdff40ca960 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.340+0000 7fdff8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff40b93a0 0x7fdff40b9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff40b93a0 0x7fdff40b9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38200/0 (socket says 172.21.15.71:38200) 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff8a00640 1 -- 172.21.15.71:0/3408090419 learned_addr learned my addr 172.21.15.71:0/3408090419 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff3400640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ca960 0x7fdff40cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff3e00640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd8004800 0x7fdff414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff8a00640 1 -- 172.21.15.71:0/3408090419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ca960 msgr2=0x7fdff40cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff8a00640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ca960 0x7fdff40cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff8a00640 1 -- 172.21.15.71:0/3408090419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd8004800 msgr2=0x7fdff414dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff8a00640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd8004800 0x7fdff414dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff8a00640 1 -- 172.21.15.71:0/3408090419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff414e0e0 con 0x7fdff40b93a0 2024-04-20T21:19:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff3400640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ca960 0x7fdff40cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff3e00640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd8004800 0x7fdff414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdff8a00640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff40b93a0 0x7fdff40b9820 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdff40c7f30 tx=0x7fdfe400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdfebe00640 1 -- 172.21.15.71:0/3408090419 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4004bf0 con 0x7fdff40b93a0 2024-04-20T21:19:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdfebe00640 1 -- 172.21.15.71:0/3408090419 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe4004dd0 con 0x7fdff40b93a0 2024-04-20T21:19:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.341+0000 7fdfebe00640 1 -- 172.21.15.71:0/3408090419 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4007270 con 0x7fdff40b93a0 2024-04-20T21:19:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.342+0000 7fdff9400640 1 -- 172.21.15.71:0/3408090419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff40cc830 con 0x7fdff40b93a0 2024-04-20T21:19:35.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.342+0000 7fdff9400640 1 -- 172.21.15.71:0/3408090419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff40ccdf0 con 0x7fdff40b93a0 2024-04-20T21:19:35.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.343+0000 7fdff9400640 1 -- 172.21.15.71:0/3408090419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff4075b60 con 0x7fdff40b93a0 2024-04-20T21:19:35.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.343+0000 7fdfebe00640 1 -- 172.21.15.71:0/3408090419 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfe4007410 con 0x7fdff40b93a0 2024-04-20T21:19:35.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.344+0000 7fdfebe00640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c920 0x7fdfd006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.344+0000 7fdfebe00640 1 -- 172.21.15.71:0/3408090419 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdfe408adc0 con 0x7fdff40b93a0 2024-04-20T21:19:35.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.345+0000 7fdff3e00640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c920 0x7fdfd006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.345+0000 7fdff3e00640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c920 0x7fdfd006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdff4069030 tx=0x7fdfec00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:35.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.349+0000 7fdfebe00640 1 -- 172.21.15.71:0/3408090419 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fdfe401a070 con 0x7fdff40b93a0 2024-04-20T21:19:35.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.553+0000 7fdff9400640 1 -- 172.21.15.71:0/3408090419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdff40cb2e0 con 0x7fdff40b93a0 2024-04-20T21:19:35.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.555+0000 7fdfebe00640 1 -- 172.21.15.71:0/3408090419 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18503 (secure 0 0 0) 0x7fdfe4058e10 con 0x7fdff40b93a0 2024-04-20T21:19:35.555 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:35.555 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":24,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:34.066765+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 -- 172.21.15.71:0/3408090419 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c920 msgr2=0x7fdfd006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c920 0x7fdfd006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdff4069030 tx=0x7fdfec00b040 comp rx=0 tx=0).stop 2024-04-20T21:19:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 -- 172.21.15.71:0/3408090419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff40b93a0 msgr2=0x7fdff40b9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff40b93a0 0x7fdff40b9820 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdff40c7f30 tx=0x7fdfe400c890 comp rx=0 tx=0).stop 2024-04-20T21:19:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 -- 172.21.15.71:0/3408090419 shutdown_connections 2024-04-20T21:19:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c920 0x7fdfd006ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff40b93a0 0x7fdff40b9820 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ca960 0x7fdff40cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 --2- 172.21.15.71:0/3408090419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd8004800 0x7fdff414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 -- 172.21.15.71:0/3408090419 >> 172.21.15.71:0/3408090419 conn(0x7fdff40d4450 msgr2=0x7fdff40d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 -- 172.21.15.71:0/3408090419 shutdown_connections 2024-04-20T21:19:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.558+0000 7fdff9400640 1 -- 172.21.15.71:0/3408090419 wait complete. 2024-04-20T21:19:35.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:35.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.777+0000 7ff815c00640 1 Processor -- start 2024-04-20T21:19:35.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.777+0000 7ff815c00640 1 -- start start 2024-04-20T21:19:35.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.778+0000 7ff815c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff810159e10 0x7ff810071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.779+0000 7ff815c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff81015a1f0 0x7ff810071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.779+0000 7ff815c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81015cc90 con 0x7ff81006da90 2024-04-20T21:19:35.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.779+0000 7ff815c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff810072900 con 0x7ff810159e10 2024-04-20T21:19:35.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.779+0000 7ff815c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff81015ca40 con 0x7ff81015a1f0 2024-04-20T21:19:35.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.779+0000 7ff80fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff810159e10 0x7ff810071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.779+0000 7ff80fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff810159e10 0x7ff810071a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38204/0 (socket says 172.21.15.71:38204) 2024-04-20T21:19:35.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.779+0000 7ff80fe00640 1 -- 172.21.15.71:0/3150532436 learned_addr learned my addr 172.21.15.71:0/3150532436 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:35.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.779+0000 7ff80fe00640 1 -- 172.21.15.71:0/3150532436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff81015a1f0 msgr2=0x7ff810071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:35.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.779+0000 7ff80fe00640 1 --2- 172.21.15.71:0/3150532436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff81015a1f0 0x7ff810071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.779+0000 7ff80fe00640 1 -- 172.21.15.71:0/3150532436 >> v1:172.21.15.137:6789/0 conn(0x7ff81006da90 legacy=0x7ff810160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:35.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.779+0000 7ff80fe00640 1 -- 172.21.15.71:0/3150532436 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81015cf70 con 0x7ff810159e10 2024-04-20T21:19:35.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.780+0000 7ff80fe00640 1 --2- 172.21.15.71:0/3150532436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff810159e10 0x7ff810071a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff81015cbc0 tx=0x7ff80002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57de9ab8cf86c535 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:35.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.781+0000 7ff80f400640 1 -- 172.21.15.71:0/3150532436 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff800035020 con 0x7ff810159e10 2024-04-20T21:19:35.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.781+0000 7ff80f400640 1 -- 172.21.15.71:0/3150532436 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff800031640 con 0x7ff810159e10 2024-04-20T21:19:35.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.781+0000 7ff80f400640 1 -- 172.21.15.71:0/3150532436 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80002d040 con 0x7ff810159e10 2024-04-20T21:19:35.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.781+0000 7ff815c00640 1 -- 172.21.15.71:0/3150532436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff810159e10 msgr2=0x7ff810071a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.781+0000 7ff815c00640 1 --2- 172.21.15.71:0/3150532436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff810159e10 0x7ff810071a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff81015cbc0 tx=0x7ff80002b8f0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.781+0000 7ff815c00640 1 -- 172.21.15.71:0/3150532436 shutdown_connections 2024-04-20T21:19:35.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.781+0000 7ff815c00640 1 --2- 172.21.15.71:0/3150532436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff81015a1f0 0x7ff810071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.781+0000 7ff815c00640 1 --2- 172.21.15.71:0/3150532436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff810159e10 0x7ff810071a80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.781+0000 7ff815c00640 1 -- 172.21.15.71:0/3150532436 >> 172.21.15.71:0/3150532436 conn(0x7ff8100d0040 msgr2=0x7ff8100d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:35.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.781+0000 7ff815c00640 1 -- 172.21.15.71:0/3150532436 shutdown_connections 2024-04-20T21:19:35.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.781+0000 7ff815c00640 1 -- 172.21.15.71:0/3150532436 wait complete. 2024-04-20T21:19:35.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.783+0000 7ff815c00640 1 Processor -- start 2024-04-20T21:19:35.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.783+0000 7ff815c00640 1 -- start start 2024-04-20T21:19:35.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.784+0000 7ff815c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff81006da90 0x7ff81014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.784+0000 7ff815c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff810159e10 0x7ff8100acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.784+0000 7ff815c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff81015a1f0 0x7ff8100ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.784+0000 7ff815c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff81015d810 con 0x7ff81015a1f0 2024-04-20T21:19:35.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.784+0000 7ff815c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff81015d530 con 0x7ff810159e10 2024-04-20T21:19:35.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.784+0000 7ff815c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff81006b900 con 0x7ff81006da90 2024-04-20T21:19:35.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.784+0000 7ff815200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff81015a1f0 0x7ff8100ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.784+0000 7ff815200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff81015a1f0 0x7ff8100ad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38220/0 (socket says 172.21.15.71:38220) 2024-04-20T21:19:35.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.784+0000 7ff815200640 1 -- 172.21.15.71:0/1790206113 learned_addr learned my addr 172.21.15.71:0/1790206113 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.785+0000 7ff80fe00640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff81006da90 0x7ff81014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.785+0000 7ff807400640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff810159e10 0x7ff8100acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.785+0000 7ff815200640 1 -- 172.21.15.71:0/1790206113 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff81006da90 msgr2=0x7ff81014a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.785+0000 7ff815200640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff81006da90 0x7ff81014a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.785+0000 7ff815200640 1 -- 172.21.15.71:0/1790206113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff810159e10 msgr2=0x7ff8100acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.785+0000 7ff815200640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff810159e10 0x7ff8100acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.785+0000 7ff815200640 1 -- 172.21.15.71:0/1790206113 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8100ccc20 con 0x7ff81015a1f0 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.785+0000 7ff807400640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff810159e10 0x7ff8100acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.785+0000 7ff815200640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff81015a1f0 0x7ff8100ad490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff80800c390 tx=0x7ff80800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.785+0000 7ff80cc00640 1 -- 172.21.15.71:0/1790206113 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808017070 con 0x7ff81015a1f0 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.786+0000 7ff80cc00640 1 -- 172.21.15.71:0/1790206113 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8080035f0 con 0x7ff81015a1f0 2024-04-20T21:19:35.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.786+0000 7ff80cc00640 1 -- 172.21.15.71:0/1790206113 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8080039e0 con 0x7ff81015a1f0 2024-04-20T21:19:35.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.786+0000 7ff815c00640 1 -- 172.21.15.71:0/1790206113 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8100ccf00 con 0x7ff81015a1f0 2024-04-20T21:19:35.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.786+0000 7ff815c00640 1 -- 172.21.15.71:0/1790206113 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8100cd4c0 con 0x7ff81015a1f0 2024-04-20T21:19:35.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.787+0000 7ff815c00640 1 -- 172.21.15.71:0/1790206113 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff810075b60 con 0x7ff81015a1f0 2024-04-20T21:19:35.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.788+0000 7ff80cc00640 1 -- 172.21.15.71:0/1790206113 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff808003b80 con 0x7ff81015a1f0 2024-04-20T21:19:35.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.789+0000 7ff80cc00640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff7ec06c8f0 0x7ff7ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:35.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.789+0000 7ff80cc00640 1 -- 172.21.15.71:0/1790206113 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff80808b240 con 0x7ff81015a1f0 2024-04-20T21:19:35.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.789+0000 7ff80fe00640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff7ec06c8f0 0x7ff7ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:35.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.790+0000 7ff80fe00640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff7ec06c8f0 0x7ff7ec06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff800036000 tx=0x7ff80003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:35.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.793+0000 7ff80cc00640 1 -- 172.21.15.71:0/1790206113 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff808059320 con 0x7ff81015a1f0 2024-04-20T21:19:35.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:35.997+0000 7ff815c00640 1 -- 172.21.15.71:0/1790206113 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff810158830 con 0x7ff81015a1f0 2024-04-20T21:19:35.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.000+0000 7ff80cc00640 1 -- 172.21.15.71:0/1790206113 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7ff808058c20 con 0x7ff81015a1f0 2024-04-20T21:19:36.000 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:36.000 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.002+0000 7ff815c00640 1 -- 172.21.15.71:0/1790206113 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff7ec06c8f0 msgr2=0x7ff7ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.002+0000 7ff815c00640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff7ec06c8f0 0x7ff7ec06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff800036000 tx=0x7ff80003c040 comp rx=0 tx=0).stop 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.002+0000 7ff815c00640 1 -- 172.21.15.71:0/1790206113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff81015a1f0 msgr2=0x7ff8100ad490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.002+0000 7ff815c00640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff81015a1f0 0x7ff8100ad490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff80800c390 tx=0x7ff80800c850 comp rx=0 tx=0).stop 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.003+0000 7ff815c00640 1 -- 172.21.15.71:0/1790206113 shutdown_connections 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.003+0000 7ff815c00640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff7ec06c8f0 0x7ff7ec06edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.003+0000 7ff815c00640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff81015a1f0 0x7ff8100ad490 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.003+0000 7ff815c00640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff810159e10 0x7ff8100acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.003+0000 7ff815c00640 1 --2- 172.21.15.71:0/1790206113 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff81006da90 0x7ff81014a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.003+0000 7ff815c00640 1 -- 172.21.15.71:0/1790206113 >> 172.21.15.71:0/1790206113 conn(0x7ff8100d0040 msgr2=0x7ff8100afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.003+0000 7ff815c00640 1 -- 172.21.15.71:0/1790206113 shutdown_connections 2024-04-20T21:19:36.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.003+0000 7ff815c00640 1 -- 172.21.15.71:0/1790206113 wait complete. 2024-04-20T21:19:36.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:19:36.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.236+0000 7fd6d8a00640 1 Processor -- start 2024-04-20T21:19:36.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.236+0000 7fd6d8a00640 1 -- start start 2024-04-20T21:19:36.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.237+0000 7fd6d8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6d415a7b0 0x7fd6d406da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.237+0000 7fd6d8a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6d406dfd0 0x7fd6d406c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.237+0000 7fd6d8a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6d406b900 con 0x7fd6d406cea0 2024-04-20T21:19:36.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.237+0000 7fd6d8a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d40b50a0 con 0x7fd6d406dfd0 2024-04-20T21:19:36.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.237+0000 7fd6d8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d406bba0 con 0x7fd6d415a7b0 2024-04-20T21:19:36.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.238+0000 7fd6cbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6d406dfd0 0x7fd6d406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.238+0000 7fd6cbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6d406dfd0 0x7fd6d406c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38234/0 (socket says 172.21.15.71:38234) 2024-04-20T21:19:36.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.238+0000 7fd6cbe00640 1 -- 172.21.15.71:0/847228138 learned_addr learned my addr 172.21.15.71:0/847228138 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:36.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.238+0000 7fd6d2800640 1 --2- 172.21.15.71:0/847228138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6d415a7b0 0x7fd6d406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.238+0000 7fd6cbe00640 1 -- 172.21.15.71:0/847228138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6d415a7b0 msgr2=0x7fd6d406da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:36.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.238+0000 7fd6cbe00640 1 --2- 172.21.15.71:0/847228138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6d415a7b0 0x7fd6d406da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.238+0000 7fd6cbe00640 1 -- 172.21.15.71:0/847228138 >> v1:172.21.15.137:6789/0 conn(0x7fd6d406cea0 legacy=0x7fd6d4071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:36.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.238+0000 7fd6cbe00640 1 -- 172.21.15.71:0/847228138 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d406be80 con 0x7fd6d406dfd0 2024-04-20T21:19:36.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.239+0000 7fd6cbe00640 1 --2- 172.21.15.71:0/847228138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6d406dfd0 0x7fd6d406c960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009870 tx=0x7fd6bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd14f034ff0f6e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:36.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.240+0000 7fd6d1e00640 1 -- 172.21.15.71:0/847228138 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc035020 con 0x7fd6d406dfd0 2024-04-20T21:19:36.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.240+0000 7fd6d1e00640 1 -- 172.21.15.71:0/847228138 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6bc031640 con 0x7fd6d406dfd0 2024-04-20T21:19:36.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.240+0000 7fd6d1e00640 1 -- 172.21.15.71:0/847228138 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc02d040 con 0x7fd6d406dfd0 2024-04-20T21:19:36.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.240+0000 7fd6d8a00640 1 -- 172.21.15.71:0/847228138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6d406dfd0 msgr2=0x7fd6d406c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.240+0000 7fd6d8a00640 1 --2- 172.21.15.71:0/847228138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6d406dfd0 0x7fd6d406c960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009870 tx=0x7fd6bc02b8f0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.240+0000 7fd6d8a00640 1 -- 172.21.15.71:0/847228138 shutdown_connections 2024-04-20T21:19:36.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.240+0000 7fd6d8a00640 1 --2- 172.21.15.71:0/847228138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6d406dfd0 0x7fd6d406c960 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.240+0000 7fd6d8a00640 1 --2- 172.21.15.71:0/847228138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6d415a7b0 0x7fd6d406da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.240+0000 7fd6d8a00640 1 -- 172.21.15.71:0/847228138 >> 172.21.15.71:0/847228138 conn(0x7fd6d40d0040 msgr2=0x7fd6d40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:36.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.240+0000 7fd6d8a00640 1 -- 172.21.15.71:0/847228138 shutdown_connections 2024-04-20T21:19:36.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.240+0000 7fd6d8a00640 1 -- 172.21.15.71:0/847228138 wait complete. 2024-04-20T21:19:36.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.242+0000 7fd6d8a00640 1 Processor -- start 2024-04-20T21:19:36.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.242+0000 7fd6d8a00640 1 -- start start 2024-04-20T21:19:36.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.243+0000 7fd6d8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6d406cea0 0x7fd6d41430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.243+0000 7fd6d8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6d406dfd0 0x7fd6d414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.243+0000 7fd6d8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6d415a7b0 0x7fd6d4143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.243+0000 7fd6d8a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d415ab90 con 0x7fd6d415a7b0 2024-04-20T21:19:36.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.243+0000 7fd6d8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d406c440 con 0x7fd6d406dfd0 2024-04-20T21:19:36.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.243+0000 7fd6d8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d415ad10 con 0x7fd6d406cea0 2024-04-20T21:19:36.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.244+0000 7fd6d3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6d415a7b0 0x7fd6d4143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.244+0000 7fd6d3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6d415a7b0 0x7fd6d4143cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38242/0 (socket says 172.21.15.71:38242) 2024-04-20T21:19:36.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.244+0000 7fd6d3200640 1 -- 172.21.15.71:0/456219359 learned_addr learned my addr 172.21.15.71:0/456219359 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:36.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.244+0000 7fd6d2800640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6d406cea0 0x7fd6d41430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.244+0000 7fd6cbe00640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6d406dfd0 0x7fd6d414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.244+0000 7fd6d3200640 1 -- 172.21.15.71:0/456219359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6d406cea0 msgr2=0x7fd6d41430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.244+0000 7fd6d3200640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6d406cea0 0x7fd6d41430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.244+0000 7fd6d3200640 1 -- 172.21.15.71:0/456219359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6d406dfd0 msgr2=0x7fd6d414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.244+0000 7fd6d3200640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6d406dfd0 0x7fd6d414fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.244+0000 7fd6d3200640 1 -- 172.21.15.71:0/456219359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d40cf450 con 0x7fd6d415a7b0 2024-04-20T21:19:36.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.245+0000 7fd6d3200640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6d415a7b0 0x7fd6d4143cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00c780 tx=0x7fd6cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:36.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.245+0000 7fd6caa00640 1 -- 172.21.15.71:0/456219359 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc004b60 con 0x7fd6d415a7b0 2024-04-20T21:19:36.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.245+0000 7fd6caa00640 1 -- 172.21.15.71:0/456219359 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6cc004d00 con 0x7fd6d415a7b0 2024-04-20T21:19:36.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.245+0000 7fd6caa00640 1 -- 172.21.15.71:0/456219359 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc00aa90 con 0x7fd6d415a7b0 2024-04-20T21:19:36.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.246+0000 7fd6d8a00640 1 -- 172.21.15.71:0/456219359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d409c9c0 con 0x7fd6d415a7b0 2024-04-20T21:19:36.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.246+0000 7fd6d8a00640 1 -- 172.21.15.71:0/456219359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d409cf80 con 0x7fd6d415a7b0 2024-04-20T21:19:36.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.248+0000 7fd6d8a00640 1 -- 172.21.15.71:0/456219359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d40ae670 con 0x7fd6d415a7b0 2024-04-20T21:19:36.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.251+0000 7fd6caa00640 1 -- 172.21.15.71:0/456219359 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6cc00ac30 con 0x7fd6d415a7b0 2024-04-20T21:19:36.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.251+0000 7fd6caa00640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6b006c8f0 0x7fd6b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.251+0000 7fd6caa00640 1 -- 172.21.15.71:0/456219359 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd6cc08cb30 con 0x7fd6d415a7b0 2024-04-20T21:19:36.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.252+0000 7fd6d2800640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6b006c8f0 0x7fd6b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.252+0000 7fd6d2800640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6b006c8f0 0x7fd6b006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400aa20 tx=0x7fd6c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:36.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.255+0000 7fd6caa00640 1 -- 172.21.15.71:0/456219359 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd6d40ae670 con 0x7fd6d415a7b0 2024-04-20T21:19:36.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.493+0000 7fd6d8a00640 1 -- 172.21.15.71:0/456219359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6d4072ea0 con 0x7fd6d415a7b0 2024-04-20T21:19:36.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.494+0000 7fd6caa00640 1 -- 172.21.15.71:0/456219359 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5201 (secure 0 0 0) 0x7fd6d4072ea0 con 0x7fd6d415a7b0 2024-04-20T21:19:36.494 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:36.494 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3502151495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3502151495},{"type":"v1","addr":"172.21.15.137:6833","nonce":3502151495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2603023903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2603023903},{"type":"v1","addr":"172.21.15.137:6835","nonce":2603023903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3246613850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3246613850},{"type":"v1","addr":"172.21.15.71:6835","nonce":3246613850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:19:28.763862+0000","modified":"2024-04-20T21:19:34.067101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/4085222328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":4085222328},{"type":"v1","addr":"172.21.15.71:6837","nonce":4085222328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-20T21:19:36.494 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 6 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.496+0000 7fd6d8a00640 1 -- 172.21.15.71:0/456219359 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6b006c8f0 msgr2=0x7fd6b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.496+0000 7fd6d8a00640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6b006c8f0 0x7fd6b006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400aa20 tx=0x7fd6c4008040 comp rx=0 tx=0).stop 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.496+0000 7fd6d8a00640 1 -- 172.21.15.71:0/456219359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6d415a7b0 msgr2=0x7fd6d4143cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.496+0000 7fd6d8a00640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6d415a7b0 0x7fd6d4143cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00c780 tx=0x7fd6cc00cc40 comp rx=0 tx=0).stop 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.497+0000 7fd6d8a00640 1 -- 172.21.15.71:0/456219359 shutdown_connections 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.497+0000 7fd6d8a00640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6b006c8f0 0x7fd6b006edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.497+0000 7fd6d8a00640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6d415a7b0 0x7fd6d4143cc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.497+0000 7fd6d8a00640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6d406dfd0 0x7fd6d414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.497+0000 7fd6d8a00640 1 --2- 172.21.15.71:0/456219359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6d406cea0 0x7fd6d41430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.497+0000 7fd6d8a00640 1 -- 172.21.15.71:0/456219359 >> 172.21.15.71:0/456219359 conn(0x7fd6d40d0040 msgr2=0x7fd6d4150eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.497+0000 7fd6d8a00640 1 -- 172.21.15.71:0/456219359 shutdown_connections 2024-04-20T21:19:36.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.497+0000 7fd6d8a00640 1 -- 172.21.15.71:0/456219359 wait complete. 2024-04-20T21:19:36.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.706+0000 7fd1c7e00640 1 Processor -- start 2024-04-20T21:19:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.706+0000 7fd1c7e00640 1 -- start start 2024-04-20T21:19:36.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.708+0000 7fd1c7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1c015e8a0 0x7fd1c006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.708+0000 7fd1c7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd1c00d0a70 0x7fd1c00ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.708+0000 7fd1c7e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1c006f060 con 0x7fd1c006dbb0 2024-04-20T21:19:36.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.708+0000 7fd1c7e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd1c006e7c0 con 0x7fd1c00d0a70 2024-04-20T21:19:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.708+0000 7fd1c7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c006eaa0 con 0x7fd1c015e8a0 2024-04-20T21:19:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.708+0000 7fd1c5e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd1c00d0a70 0x7fd1c00ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.709+0000 7fd1c4a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd1c006dbb0 0x7fd1c00d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:58250/0 (socket says 172.21.15.71:58250) 2024-04-20T21:19:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.709+0000 7fd1c4a00640 1 -- 172.21.15.71:0/531239802 learned_addr learned my addr 172.21.15.71:0/531239802 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.709+0000 7fd1c5400640 1 --2- 172.21.15.71:0/531239802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1c015e8a0 0x7fd1c006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.709+0000 7fd1bfe00640 1 -- 172.21.15.71:0/531239802 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599138798 0 0) 0x7fd1c006f060 con 0x7fd1c006dbb0 2024-04-20T21:19:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.709+0000 7fd1bfe00640 1 -- 172.21.15.71:0/531239802 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1a8003520 con 0x7fd1c006dbb0 2024-04-20T21:19:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.710+0000 7fd1c5e00640 1 -- 172.21.15.71:0/531239802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1c015e8a0 msgr2=0x7fd1c006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.710+0000 7fd1c5e00640 1 --2- 172.21.15.71:0/531239802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1c015e8a0 0x7fd1c006e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.710+0000 7fd1c5e00640 1 -- 172.21.15.71:0/531239802 >> v1:172.21.15.137:6789/0 conn(0x7fd1c006dbb0 legacy=0x7fd1c00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.710+0000 7fd1c5e00640 1 -- 172.21.15.71:0/531239802 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c006ed80 con 0x7fd1c00d0a70 2024-04-20T21:19:36.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.711+0000 7fd1c5e00640 1 --2- 172.21.15.71:0/531239802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1c00d0a70 0x7fd1c00ad680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009d90 tx=0x7fd1b802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9476a425a04d072b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:36.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.712+0000 7fd1bfe00640 1 -- 172.21.15.71:0/531239802 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8039070 con 0x7fd1c00d0a70 2024-04-20T21:19:36.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.712+0000 7fd1bfe00640 1 -- 172.21.15.71:0/531239802 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b802cc50 con 0x7fd1c00d0a70 2024-04-20T21:19:36.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.712+0000 7fd1bfe00640 1 -- 172.21.15.71:0/531239802 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8034440 con 0x7fd1c00d0a70 2024-04-20T21:19:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.712+0000 7fd1c7e00640 1 -- 172.21.15.71:0/531239802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1c00d0a70 msgr2=0x7fd1c00ad680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.712+0000 7fd1c7e00640 1 --2- 172.21.15.71:0/531239802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1c00d0a70 0x7fd1c00ad680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009d90 tx=0x7fd1b802bea0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.712+0000 7fd1c7e00640 1 -- 172.21.15.71:0/531239802 shutdown_connections 2024-04-20T21:19:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.712+0000 7fd1c7e00640 1 --2- 172.21.15.71:0/531239802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1c00d0a70 0x7fd1c00ad680 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.712+0000 7fd1c7e00640 1 --2- 172.21.15.71:0/531239802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1c015e8a0 0x7fd1c006e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.712+0000 7fd1c7e00640 1 -- 172.21.15.71:0/531239802 >> 172.21.15.71:0/531239802 conn(0x7fd1c00b3350 msgr2=0x7fd1c00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:36.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.713+0000 7fd1c7e00640 1 -- 172.21.15.71:0/531239802 shutdown_connections 2024-04-20T21:19:36.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.713+0000 7fd1c7e00640 1 -- 172.21.15.71:0/531239802 wait complete. 2024-04-20T21:19:36.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.714+0000 7fd1c7e00640 1 Processor -- start 2024-04-20T21:19:36.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.714+0000 7fd1c7e00640 1 -- start start 2024-04-20T21:19:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.715+0000 7fd1c7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1c006dbb0 0x7fd1c015fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.715+0000 7fd1c7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1c00d0a70 0x7fd1c0156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.715+0000 7fd1c7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1c015e8a0 0x7fd1c015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.715+0000 7fd1c7e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c006fef0 con 0x7fd1c00d0a70 2024-04-20T21:19:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.715+0000 7fd1c7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c006fd70 con 0x7fd1c006dbb0 2024-04-20T21:19:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.715+0000 7fd1c7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c00adbc0 con 0x7fd1c015e8a0 2024-04-20T21:19:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.716+0000 7fd1c4a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1c00d0a70 0x7fd1c0156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.716+0000 7fd1c4a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1c00d0a70 0x7fd1c0156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38252/0 (socket says 172.21.15.71:38252) 2024-04-20T21:19:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.716+0000 7fd1c4a00640 1 -- 172.21.15.71:0/2666798915 learned_addr learned my addr 172.21.15.71:0/2666798915 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.716+0000 7fd1c5e00640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1c015e8a0 0x7fd1c015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.716+0000 7fd1c5400640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1c006dbb0 0x7fd1c015fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.716+0000 7fd1c4a00640 1 -- 172.21.15.71:0/2666798915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1c015e8a0 msgr2=0x7fd1c015b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.716+0000 7fd1c4a00640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1c015e8a0 0x7fd1c015b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.716+0000 7fd1c4a00640 1 -- 172.21.15.71:0/2666798915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1c006dbb0 msgr2=0x7fd1c015fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.716+0000 7fd1c4a00640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1c006dbb0 0x7fd1c015fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.716+0000 7fd1c4a00640 1 -- 172.21.15.71:0/2666798915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c015ee00 con 0x7fd1c00d0a70 2024-04-20T21:19:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.716+0000 7fd1c4a00640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1c00d0a70 0x7fd1c0156db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c430 tx=0x7fd1ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.717+0000 7fd1bd600640 1 -- 172.21.15.71:0/2666798915 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac017070 con 0x7fd1c00d0a70 2024-04-20T21:19:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.717+0000 7fd1bd600640 1 -- 172.21.15.71:0/2666798915 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ac005ce0 con 0x7fd1c00d0a70 2024-04-20T21:19:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.717+0000 7fd1c7e00640 1 -- 172.21.15.71:0/2666798915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c015f0e0 con 0x7fd1c00d0a70 2024-04-20T21:19:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.717+0000 7fd1bd600640 1 -- 172.21.15.71:0/2666798915 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0072f0 con 0x7fd1c00d0a70 2024-04-20T21:19:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.717+0000 7fd1c7e00640 1 -- 172.21.15.71:0/2666798915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c015f6a0 con 0x7fd1c00d0a70 2024-04-20T21:19:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.718+0000 7fd1c7e00640 1 -- 172.21.15.71:0/2666798915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c015f8a0 con 0x7fd1c00d0a70 2024-04-20T21:19:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.719+0000 7fd1bd600640 1 -- 172.21.15.71:0/2666798915 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd1ac01a070 con 0x7fd1c00d0a70 2024-04-20T21:19:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.720+0000 7fd1bd600640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd1a006c8f0 0x7fd1a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.720+0000 7fd1bd600640 1 -- 172.21.15.71:0/2666798915 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd1ac08b2e0 con 0x7fd1c00d0a70 2024-04-20T21:19:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.720+0000 7fd1c5400640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd1a006c8f0 0x7fd1a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.721+0000 7fd1c5400640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd1a006c8f0 0x7fd1a006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009a30 tx=0x7fd1b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.724+0000 7fd1bd600640 1 -- 172.21.15.71:0/2666798915 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd1c015f8a0 con 0x7fd1c00d0a70 2024-04-20T21:19:36.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.926+0000 7fd1c7e00640 1 -- 172.21.15.71:0/2666798915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1c0068980 con 0x7fd1c00d0a70 2024-04-20T21:19:36.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.929+0000 7fd1bd600640 1 -- 172.21.15.71:0/2666798915 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fd1ac059460 con 0x7fd1c00d0a70 2024-04-20T21:19:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:36.929 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:36.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.931+0000 7fd1c7e00640 1 -- 172.21.15.71:0/2666798915 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd1a006c8f0 msgr2=0x7fd1a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.931+0000 7fd1c7e00640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd1a006c8f0 0x7fd1a006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009a30 tx=0x7fd1b4008040 comp rx=0 tx=0).stop 2024-04-20T21:19:36.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.931+0000 7fd1c7e00640 1 -- 172.21.15.71:0/2666798915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1c00d0a70 msgr2=0x7fd1c0156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:36.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.931+0000 7fd1c7e00640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1c00d0a70 0x7fd1c0156db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c430 tx=0x7fd1ac00c8f0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.932+0000 7fd1c7e00640 1 -- 172.21.15.71:0/2666798915 shutdown_connections 2024-04-20T21:19:36.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.932+0000 7fd1c7e00640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd1a006c8f0 0x7fd1a006edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.932+0000 7fd1c7e00640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1c015e8a0 0x7fd1c015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.932+0000 7fd1c7e00640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1c00d0a70 0x7fd1c0156db0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.932+0000 7fd1c7e00640 1 --2- 172.21.15.71:0/2666798915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1c006dbb0 0x7fd1c015fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:36.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.932+0000 7fd1c7e00640 1 -- 172.21.15.71:0/2666798915 >> 172.21.15.71:0/2666798915 conn(0x7fd1c00b3350 msgr2=0x7fd1c0071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:36.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.932+0000 7fd1c7e00640 1 -- 172.21.15.71:0/2666798915 shutdown_connections 2024-04-20T21:19:36.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:36.932+0000 7fd1c7e00640 1 -- 172.21.15.71:0/2666798915 wait complete. 2024-04-20T21:19:37.352 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-20T21:19:28.763862+0000', 'modified': '2024-04-20T21:19:34.067101+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6837/4085222328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 4085222328}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 4085222328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4254, 'qdb_cluster': [4254]} 2024-04-20T21:19:37.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-20T21:19:37.353 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-20T21:19:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.562+0000 7f65ff800640 1 Processor -- start 2024-04-20T21:19:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.562+0000 7f65ff800640 1 -- start start 2024-04-20T21:19:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.563+0000 7f65ff800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f65f815b3b0 0x7f65f806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.563+0000 7f65ff800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f65f806dcb0 0x7f65f8071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.563+0000 7f65ff800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f65f8072090 0x7f65f80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.563+0000 7f65ff800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f65f80ade40 con 0x7f65f815b3b0 2024-04-20T21:19:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.563+0000 7f65ff800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f65f80ae0e0 con 0x7f65f806dcb0 2024-04-20T21:19:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.563+0000 7f65ff800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f65f815b790 con 0x7f65f8072090 2024-04-20T21:19:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.564+0000 7f65fce00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f65f815b3b0 0x7f65f806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.564+0000 7f65fce00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f65f815b3b0 0x7f65f806eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38254/0 (socket says 172.21.15.71:38254) 2024-04-20T21:19:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.564+0000 7f65fce00640 1 -- 172.21.15.71:0/530092054 learned_addr learned my addr 172.21.15.71:0/530092054 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.564+0000 7f65fd800640 1 --2- 172.21.15.71:0/530092054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f65f8072090 0x7f65f80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.564+0000 7f65fce00640 1 -- 172.21.15.71:0/530092054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f65f8072090 msgr2=0x7f65f80d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.564+0000 7f65fce00640 1 --2- 172.21.15.71:0/530092054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f65f8072090 0x7f65f80d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.564+0000 7f65f7e00640 1 --2- 172.21.15.71:0/530092054 >> v2:172.21.15.137:3300/0 conn(0x7f65f806dcb0 0x7f65f8071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.564+0000 7f65fce00640 1 -- 172.21.15.71:0/530092054 >> v2:172.21.15.137:3300/0 conn(0x7f65f806dcb0 msgr2=0x7f65f8071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.564+0000 7f65fce00640 1 --2- 172.21.15.71:0/530092054 >> v2:172.21.15.137:3300/0 conn(0x7f65f806dcb0 0x7f65f8071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.564+0000 7f65fce00640 1 -- 172.21.15.71:0/530092054 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f80ae380 con 0x7f65f815b3b0 2024-04-20T21:19:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.564+0000 7f65fd800640 1 --2- 172.21.15.71:0/530092054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f65f8072090 0x7f65f80d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.565+0000 7f65fce00640 1 --2- 172.21.15.71:0/530092054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f815b3b0 0x7f65f806eaa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f65f80ad8d0 tx=0x7f65ec02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e9ee9a28b8c5d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.565+0000 7f65f7400640 1 -- 172.21.15.71:0/530092054 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec035020 con 0x7f65f815b3b0 2024-04-20T21:19:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.565+0000 7f65f7400640 1 -- 172.21.15.71:0/530092054 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ec02d040 con 0x7f65f815b3b0 2024-04-20T21:19:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.565+0000 7f65f7400640 1 -- 172.21.15.71:0/530092054 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec031a80 con 0x7f65f815b3b0 2024-04-20T21:19:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.566+0000 7f65ff800640 1 -- 172.21.15.71:0/530092054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f815b3b0 msgr2=0x7f65f806eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.566+0000 7f65ff800640 1 --2- 172.21.15.71:0/530092054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f815b3b0 0x7f65f806eaa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f65f80ad8d0 tx=0x7f65ec02b900 comp rx=0 tx=0).stop 2024-04-20T21:19:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.566+0000 7f65ff800640 1 -- 172.21.15.71:0/530092054 shutdown_connections 2024-04-20T21:19:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.566+0000 7f65ff800640 1 --2- 172.21.15.71:0/530092054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f65f8072090 0x7f65f80d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.566+0000 7f65ff800640 1 --2- 172.21.15.71:0/530092054 >> v2:172.21.15.137:3300/0 conn(0x7f65f806dcb0 0x7f65f8071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.566+0000 7f65ff800640 1 --2- 172.21.15.71:0/530092054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f815b3b0 0x7f65f806eaa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.566+0000 7f65ff800640 1 -- 172.21.15.71:0/530092054 >> 172.21.15.71:0/530092054 conn(0x7f65f80b3350 msgr2=0x7f65f80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.566+0000 7f65ff800640 1 -- 172.21.15.71:0/530092054 shutdown_connections 2024-04-20T21:19:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.566+0000 7f65ff800640 1 -- 172.21.15.71:0/530092054 wait complete. 2024-04-20T21:19:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.568+0000 7f65ff800640 1 Processor -- start 2024-04-20T21:19:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.568+0000 7f65ff800640 1 -- start start 2024-04-20T21:19:37.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.569+0000 7f65ff800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f806dcb0 0x7f65f80b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.569+0000 7f65ff800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f65f815b3b0 0x7f65f81f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.569+0000 7f65ff800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65f81efde0 0x7f65f80cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.569+0000 7f65ff800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f65f80aec20 con 0x7f65f806dcb0 2024-04-20T21:19:37.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.569+0000 7f65ff800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f65f80ae940 con 0x7f65f81efde0 2024-04-20T21:19:37.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.569+0000 7f65ff800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f65f806efe0 con 0x7f65f815b3b0 2024-04-20T21:19:37.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.569+0000 7f65fce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f806dcb0 0x7f65f80b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.569+0000 7f65fce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f806dcb0 0x7f65f80b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38256/0 (socket says 172.21.15.71:38256) 2024-04-20T21:19:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.569+0000 7f65fce00640 1 -- 172.21.15.71:0/3649957119 learned_addr learned my addr 172.21.15.71:0/3649957119 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.570+0000 7f65fce00640 1 -- 172.21.15.71:0/3649957119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f65f815b3b0 msgr2=0x7f65f81f3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.570+0000 7f65fce00640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f65f815b3b0 0x7f65f81f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.570+0000 7f65fce00640 1 -- 172.21.15.71:0/3649957119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65f81efde0 msgr2=0x7f65f80cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.570+0000 7f65fce00640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65f81efde0 0x7f65f80cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.570+0000 7f65fce00640 1 -- 172.21.15.71:0/3649957119 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f8153230 con 0x7f65f806dcb0 2024-04-20T21:19:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.570+0000 7f65fce00640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f806dcb0 0x7f65f80b0930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f65ec02b940 tx=0x7f65ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:37.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.570+0000 7f65f4c00640 1 -- 172.21.15.71:0/3649957119 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec040070 con 0x7f65f806dcb0 2024-04-20T21:19:37.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.570+0000 7f65f4c00640 1 -- 172.21.15.71:0/3649957119 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ec039c30 con 0x7f65f806dcb0 2024-04-20T21:19:37.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.570+0000 7f65ff800640 1 -- 172.21.15.71:0/3649957119 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f80af020 con 0x7f65f806dcb0 2024-04-20T21:19:37.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.570+0000 7f65f4c00640 1 -- 172.21.15.71:0/3649957119 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec035040 con 0x7f65f806dcb0 2024-04-20T21:19:37.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.570+0000 7f65ff800640 1 -- 172.21.15.71:0/3649957119 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f81f0610 con 0x7f65f806dcb0 2024-04-20T21:19:37.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.572+0000 7f65f4c00640 1 -- 172.21.15.71:0/3649957119 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f65ec04b060 con 0x7f65f806dcb0 2024-04-20T21:19:37.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.573+0000 7f65f4c00640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f65d806c8f0 0x7f65d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.573+0000 7f65f4c00640 1 -- 172.21.15.71:0/3649957119 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f65ec0add50 con 0x7f65f806dcb0 2024-04-20T21:19:37.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.574+0000 7f65f7e00640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f65d806c8f0 0x7f65d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.574+0000 7f66025a6740 1 Processor -- start 2024-04-20T21:19:37.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.574+0000 7f66025a6740 1 -- start start 2024-04-20T21:19:37.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.574+0000 7f65f7e00640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f65d806c8f0 0x7f65d806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65f8152f20 tx=0x7f65e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.575+0000 7f66025a6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b2870 0x563246869ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.575+0000 7f66025a6740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x56324686a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.575+0000 7f66025a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563246864d40 0x563246894b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.575+0000 7f66025a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5632467cc9d0 con 0x563246864d40 2024-04-20T21:19:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.575+0000 7f66025a6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563246773270 con 0x5632468b2870 2024-04-20T21:19:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.575+0000 7f66025a6740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5632467c8990 con 0x5632468688f0 2024-04-20T21:19:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.575+0000 7f65fd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563246864d40 0x563246894b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.575+0000 7f65fd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563246864d40 0x563246894b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38264/0 (socket says 172.21.15.71:38264) 2024-04-20T21:19:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.575+0000 7f65fd800640 1 -- 172.21.15.71:0/1276797629 learned_addr learned my addr 172.21.15.71:0/1276797629 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65f7e00640 1 --2- 172.21.15.71:0/1276797629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x56324686a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65fce00640 1 --2- 172.21.15.71:0/1276797629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b2870 0x563246869ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65fd800640 1 -- 172.21.15.71:0/1276797629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 msgr2=0x56324686a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65fd800640 1 --2- 172.21.15.71:0/1276797629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x56324686a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65fd800640 1 -- 172.21.15.71:0/1276797629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b2870 msgr2=0x563246869ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65fd800640 1 --2- 172.21.15.71:0/1276797629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b2870 0x563246869ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65fd800640 1 -- 172.21.15.71:0/1276797629 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632464df2d0 con 0x563246864d40 2024-04-20T21:19:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65f7e00640 1 --2- 172.21.15.71:0/1276797629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x56324686a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65fd800640 1 --2- 172.21.15.71:0/1276797629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563246864d40 0x563246894b80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65f0008e50 tx=0x7f65f000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c426c2f388fa4e94 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65e9600640 1 -- 172.21.15.71:0/1276797629 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f000e850 con 0x563246864d40 2024-04-20T21:19:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65e9600640 1 -- 172.21.15.71:0/1276797629 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f000e9f0 con 0x563246864d40 2024-04-20T21:19:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.576+0000 7f65e9600640 1 -- 172.21.15.71:0/1276797629 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f000ede0 con 0x563246864d40 2024-04-20T21:19:37.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.577+0000 7f66025a6740 1 -- 172.21.15.71:0/1276797629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563246864d40 msgr2=0x563246894b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.577+0000 7f66025a6740 1 --2- 172.21.15.71:0/1276797629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563246864d40 0x563246894b80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65f0008e50 tx=0x7f65f000d7a0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.577+0000 7f66025a6740 1 -- 172.21.15.71:0/1276797629 shutdown_connections 2024-04-20T21:19:37.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.577+0000 7f66025a6740 1 --2- 172.21.15.71:0/1276797629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563246864d40 0x563246894b80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.577+0000 7f66025a6740 1 --2- 172.21.15.71:0/1276797629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x56324686a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.577+0000 7f66025a6740 1 --2- 172.21.15.71:0/1276797629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b2870 0x563246869ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.577+0000 7f66025a6740 1 -- 172.21.15.71:0/1276797629 >> 172.21.15.71:0/1276797629 conn(0x563246867000 msgr2=0x5632468afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:37.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.577+0000 7f66025a6740 1 -- 172.21.15.71:0/1276797629 shutdown_connections 2024-04-20T21:19:37.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.577+0000 7f66025a6740 1 -- 172.21.15.71:0/1276797629 wait complete. 2024-04-20T21:19:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.578+0000 7f66025a6740 1 -- start start 2024-04-20T21:19:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.578+0000 7f66025a6740 1 Processor -- start 2024-04-20T21:19:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.579+0000 7f66025a6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468688f0 0x56324687f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.579+0000 7f66025a6740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468b2870 0x5632468937c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.579+0000 7f66025a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x563246893d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.579+0000 7f66025a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563246868e00 con 0x5632468b7190 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.579+0000 7f66025a6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5632467865e0 con 0x5632468688f0 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.579+0000 7f66025a6740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5632468690e0 con 0x5632468b2870 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.579+0000 7f66025a6740 10 client.0 _ll_register_callbacks cb 0x5632464deac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.579+0000 7f65fd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x563246893d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.579+0000 7f65fd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x563246893d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38274/0 (socket says 172.21.15.71:38274) 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.579+0000 7f65fd800640 1 -- 172.21.15.71:0/2877916574 learned_addr learned my addr 172.21.15.71:0/2877916574 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.580+0000 7f65f7e00640 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468b2870 0x5632468937c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.580+0000 7f65fce00640 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468688f0 0x56324687f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.580+0000 7f65fd800640 1 -- 172.21.15.71:0/2877916574 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468b2870 msgr2=0x5632468937c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.580+0000 7f65fd800640 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468b2870 0x5632468937c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.580+0000 7f65fd800640 1 -- 172.21.15.71:0/2877916574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468688f0 msgr2=0x56324687f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.580+0000 7f65fd800640 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468688f0 0x56324687f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.580+0000 7f65fd800640 1 -- 172.21.15.71:0/2877916574 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632465a96b0 con 0x5632468b7190 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.580+0000 7f65fd800640 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x563246893d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f65f000dbe0 tx=0x7f65f0005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b15eadd2b86b0f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.580+0000 7f65de000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f65de000640 1 -- 172.21.15.71:0/2877916574 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0024070 con 0x5632468b7190 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f65de000640 1 -- 172.21.15.71:0/2877916574 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f65f0003ba0 con 0x5632468b7190 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f66025a6740 1 -- 172.21.15.71:0/2877916574 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f000e9f0 con 0x5632468b7190 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f65de000640 1 -- 172.21.15.71:0/2877916574 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f65f002f050 con 0x5632468b7190 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f66025a6740 10 client.4389 fetch_fsmap learned FSMap version 6 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f66025a6740 1 -- 172.21.15.71:0/2877916574 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5632468b7c40 con 0x5632468b7190 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f65de000640 1 -- 172.21.15.71:0/2877916574 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f000e9f0 con 0x5632468b7190 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f65de000640 1 -- 172.21.15.71:0/2877916574 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 6) ==== 3503+0+0 (secure 0 0 0) 0x7f65f0032020 con 0x5632468b7190 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f66025a6740 10 client.4389 fetch_fsmap finished waiting for FSMap version 6 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f66025a6740 10 client.4389 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-20T21:19:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f66025a6740 20 client.4389 populate_metadata read hostname 'smithi071' 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f66025a6740 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x5632468c4540 0x5632468b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f66025a6740 4 client.4389 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.581+0000 7f66025a6740 1 -- 172.21.15.71:0/2877916574 --> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632467da3f0 con 0x5632468c4540 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.582+0000 7f65fce00640 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x5632468c4540 0x5632468b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.582+0000 7f65fce00640 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x5632468c4540 0x5632468b5030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=463ab90dd9acb509 server_cookie=c686763831603050 in_seq=0 out_seq=0 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.582+0000 7f65de000640 10 client.4389 ms_handle_connect on v2:172.21.15.71:6836/4085222328 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f65de000640 1 -- 172.21.15.71:0/2877916574 <== mds.0 v2:172.21.15.71:6836/4085222328 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5632467da3f0 con 0x5632468c4540 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f65de000640 10 client.4389 handle_command_reply: tid=0 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f66025a6740 1 client.4389 shutdown 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f66025a6740 1 -- 172.21.15.71:0/2877916574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 msgr2=0x563246893d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f66025a6740 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x563246893d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f65f000dbe0 tx=0x7f65f0005db0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f66025a6740 1 -- 172.21.15.71:0/2877916574 shutdown_connections 2024-04-20T21:19:37.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f66025a6740 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x5632468c4540 0x5632468b5030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f66025a6740 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x563246893d00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f66025a6740 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468b2870 0x5632468937c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f66025a6740 1 --2- 172.21.15.71:0/2877916574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468688f0 0x56324687f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f66025a6740 1 -- 172.21.15.71:0/2877916574 >> 172.21.15.71:0/2877916574 conn(0x563246864d40 msgr2=0x5632468af980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:37.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f65de000640 0 client.4389 ms_handle_reset on v2:172.21.15.71:6836/4085222328 2024-04-20T21:19:37.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f66025a6740 1 -- 172.21.15.71:0/2877916574 shutdown_connections 2024-04-20T21:19:37.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.583+0000 7f66025a6740 1 -- 172.21.15.71:0/2877916574 wait complete. 2024-04-20T21:19:37.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.584+0000 7f66025a6740 20 client.4389 trim_cache size 0 max 16384 2024-04-20T21:19:37.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.603+0000 7f66025a6740 1 Processor -- start 2024-04-20T21:19:37.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.603+0000 7f66025a6740 1 -- start start 2024-04-20T21:19:37.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.604+0000 7f66025a6740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x56324687f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.604+0000 7f66025a6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b2870 0x5632468b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.604+0000 7f66025a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x5632468942d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.604+0000 7f66025a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81fcbc0 con 0x5632468b7190 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.604+0000 7f66025a6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81fc070 con 0x5632468b2870 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.604+0000 7f66025a6740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f65f81fc570 con 0x5632468688f0 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65fd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x5632468942d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65fd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x5632468942d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38278/0 (socket says 172.21.15.71:38278) 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65fd800640 1 -- 172.21.15.71:0/1795377164 learned_addr learned my addr 172.21.15.71:0/1795377164 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65fd800640 1 -- 172.21.15.71:0/1795377164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 msgr2=0x56324687f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65fd800640 1 --2- 172.21.15.71:0/1795377164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x56324687f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65fd800640 1 -- 172.21.15.71:0/1795377164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b2870 msgr2=0x5632468b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65fd800640 1 --2- 172.21.15.71:0/1795377164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b2870 0x5632468b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65fd800640 1 -- 172.21.15.71:0/1795377164 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632468c4c30 con 0x5632468b7190 2024-04-20T21:19:37.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65fd800640 1 --2- 172.21.15.71:0/1795377164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x5632468942d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65f000e010 tx=0x7f65f001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd15909bf1541b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:37.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65e8c00640 1 -- 172.21.15.71:0/1795377164 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0024040 con 0x5632468b7190 2024-04-20T21:19:37.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65e8c00640 1 -- 172.21.15.71:0/1795377164 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f0003ba0 con 0x5632468b7190 2024-04-20T21:19:37.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.605+0000 7f65e8c00640 1 -- 172.21.15.71:0/1795377164 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f000fdc0 con 0x5632468b7190 2024-04-20T21:19:37.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.606+0000 7f66025a6740 1 -- 172.21.15.71:0/1795377164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 msgr2=0x5632468942d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.606+0000 7f66025a6740 1 --2- 172.21.15.71:0/1795377164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x5632468942d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65f000e010 tx=0x7f65f001f000 comp rx=0 tx=0).stop 2024-04-20T21:19:37.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.606+0000 7f66025a6740 1 -- 172.21.15.71:0/1795377164 shutdown_connections 2024-04-20T21:19:37.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.606+0000 7f66025a6740 1 --2- 172.21.15.71:0/1795377164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b7190 0x5632468942d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.606+0000 7f66025a6740 1 --2- 172.21.15.71:0/1795377164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b2870 0x5632468b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.606+0000 7f66025a6740 1 --2- 172.21.15.71:0/1795377164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x56324687f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.606+0000 7f66025a6740 1 -- 172.21.15.71:0/1795377164 >> 172.21.15.71:0/1795377164 conn(0x563246864d40 msgr2=0x563246865600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:37.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.606+0000 7f66025a6740 1 -- 172.21.15.71:0/1795377164 shutdown_connections 2024-04-20T21:19:37.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.606+0000 7f66025a6740 1 -- 172.21.15.71:0/1795377164 wait complete. 2024-04-20T21:19:37.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.607+0000 7f66025a6740 1 -- start start 2024-04-20T21:19:37.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.607+0000 7f66025a6740 1 Processor -- start 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.608+0000 7f66025a6740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x5632469299d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.608+0000 7f66025a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b2870 0x5632468af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.608+0000 7f66025a6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b7190 0x5632468afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.608+0000 7f66025a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5632468c43c0 con 0x5632468b2870 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.608+0000 7f66025a6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5632468b44a0 con 0x5632468b7190 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.608+0000 7f66025a6740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5632468c49e0 con 0x5632468688f0 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.608+0000 7f66025a6740 10 client.0 _ll_register_callbacks cb 0x7f65f0008ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.608+0000 7f65f7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b2870 0x5632468af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.608+0000 7f65f7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b2870 0x5632468af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38292/0 (socket says 172.21.15.71:38292) 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.608+0000 7f65f7e00640 1 -- 172.21.15.71:0/2050018754 learned_addr learned my addr 172.21.15.71:0/2050018754 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f65fce00640 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x5632469299d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f65fd800640 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b7190 0x5632468afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f65f7e00640 1 -- 172.21.15.71:0/2050018754 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 msgr2=0x5632469299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f65f7e00640 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x5632469299d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f65f7e00640 1 -- 172.21.15.71:0/2050018754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b7190 msgr2=0x5632468afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f65f7e00640 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b7190 0x5632468afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f65f7e00640 1 -- 172.21.15.71:0/2050018754 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563246865ed0 con 0x5632468b2870 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f65f7e00640 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b2870 0x5632468af5f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f65e400afd0 tx=0x7f65e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da8cb2d92c3b5c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f65de000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f65de000640 1 -- 172.21.15.71:0/2050018754 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e4023020 con 0x5632468b2870 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f65de000640 1 -- 172.21.15.71:0/2050018754 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f65e401f430 con 0x5632468b2870 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.609+0000 7f66025a6740 1 -- 172.21.15.71:0/2050018754 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f0003ba0 con 0x5632468b2870 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f65de000640 1 -- 172.21.15.71:0/2050018754 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f65e402d050 con 0x5632468b2870 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f66025a6740 10 client.4395 fetch_fsmap learned FSMap version 6 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f66025a6740 1 -- 172.21.15.71:0/2050018754 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56324688c7b0 con 0x5632468b2870 2024-04-20T21:19:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f65de000640 1 -- 172.21.15.71:0/2050018754 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f0003ba0 con 0x5632468b2870 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f65de000640 1 -- 172.21.15.71:0/2050018754 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 6) ==== 3503+0+0 (secure 0 0 0) 0x7f65e4030020 con 0x5632468b2870 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f66025a6740 10 client.4395 fetch_fsmap finished waiting for FSMap version 6 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f66025a6740 10 client.4395 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f66025a6740 20 client.4395 populate_metadata read hostname 'smithi071' 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f66025a6740 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x56324688c2c0 0x5632468b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f66025a6740 4 client.4395 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f66025a6740 1 -- 172.21.15.71:0/2050018754 --> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] -- command(tid 0: {"prefix": "status"}) -- 0x5632467d4260 con 0x56324688c2c0 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.610+0000 7f65fce00640 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x56324688c2c0 0x5632468b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f65de000640 10 client.4395 ms_handle_connect on v2:172.21.15.71:6836/4085222328 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f65fce00640 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x56324688c2c0 0x5632468b2c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b4299b555eaa95b server_cookie=9b07eeb15f723e60 in_seq=0 out_seq=0 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f65de000640 1 -- 172.21.15.71:0/2050018754 <== mds.0 v2:172.21.15.71:6836/4085222328 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5632467d4260 con 0x56324688c2c0 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f65de000640 10 client.4395 handle_command_reply: tid=0 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f66025a6740 1 client.4395 shutdown 2024-04-20T21:19:37.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f66025a6740 1 -- 172.21.15.71:0/2050018754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b2870 msgr2=0x5632468af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f66025a6740 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b2870 0x5632468af5f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f65e400afd0 tx=0x7f65e40046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f66025a6740 1 -- 172.21.15.71:0/2050018754 shutdown_connections 2024-04-20T21:19:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f66025a6740 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x56324688c2c0 0x5632468b2c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f66025a6740 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632468b7190 0x5632468afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f66025a6740 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5632468b2870 0x5632468af5f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f65de000640 0 client.4395 ms_handle_reset on v2:172.21.15.71:6836/4085222328 2024-04-20T21:19:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f66025a6740 1 --2- 172.21.15.71:0/2050018754 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5632468688f0 0x5632469299d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f66025a6740 1 -- 172.21.15.71:0/2050018754 >> 172.21.15.71:0/2050018754 conn(0x563246864d40 msgr2=0x5632468b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.611+0000 7f66025a6740 1 -- 172.21.15.71:0/2050018754 shutdown_connections 2024-04-20T21:19:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f66025a6740 1 -- 172.21.15.71:0/2050018754 wait complete. 2024-04-20T21:19:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f66025a6740 20 client.4395 trim_cache size 0 max 16384 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "da776687-7be6-4259-b098-1ebb1c5bd96b", 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4254, 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 8.2474734470000008, 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 6, 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 25, 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 24, 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 13.702797883000001 2024-04-20T21:19:37.616 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-20T21:19:37.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f65ff800640 1 -- 172.21.15.71:0/3649957119 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f65d806c8f0 msgr2=0x7f65d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f65ff800640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f65d806c8f0 0x7f65d806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65f8152f20 tx=0x7f65e4008040 comp rx=0 tx=0).stop 2024-04-20T21:19:37.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f65ff800640 1 -- 172.21.15.71:0/3649957119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f806dcb0 msgr2=0x7f65f80b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f65ff800640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f806dcb0 0x7f65f80b0930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f65ec02b940 tx=0x7f65ec0046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f65ff800640 1 -- 172.21.15.71:0/3649957119 shutdown_connections 2024-04-20T21:19:37.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f65ff800640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f65d806c8f0 0x7f65d806edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f65ff800640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65f81efde0 0x7f65f80cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f65ff800640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f65f815b3b0 0x7f65f81f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f65ff800640 1 --2- 172.21.15.71:0/3649957119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f806dcb0 0x7f65f80b0930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f65ff800640 1 -- 172.21.15.71:0/3649957119 >> 172.21.15.71:0/3649957119 conn(0x7f65f80b3350 msgr2=0x7f65f814f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:37.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.612+0000 7f65ff800640 1 -- 172.21.15.71:0/3649957119 shutdown_connections 2024-04-20T21:19:37.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.613+0000 7f65ff800640 1 -- 172.21.15.71:0/3649957119 wait complete. 2024-04-20T21:19:37.628 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-20T21:19:37.629 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-20T21:19:37.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-20T21:19:37.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.821+0000 7f3f3ba00640 1 Processor -- start 2024-04-20T21:19:37.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.822+0000 7f3f3ba00640 1 -- start start 2024-04-20T21:19:37.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.823+0000 7f3f3ba00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f34162c00 0x7f3f340d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.823+0000 7f3f3ba00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3f3406fc30 0x7f3f340d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.823+0000 7f3f3ba00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f3406df70 con 0x7f3f3406f090 2024-04-20T21:19:37.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.823+0000 7f3f3ba00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3f34162fe0 con 0x7f3f3406fc30 2024-04-20T21:19:37.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.823+0000 7f3f3ba00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3f3406ec00 con 0x7f3f34162c00 2024-04-20T21:19:37.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.823+0000 7f3f39a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3f3406fc30 0x7f3f340d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.823+0000 7f3f2be00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3f3406f090 0x7f3f3406b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45620/0 (socket says 172.21.15.71:45620) 2024-04-20T21:19:37.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.823+0000 7f3f2be00640 1 -- 172.21.15.71:0/2878564006 learned_addr learned my addr 172.21.15.71:0/2878564006 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:37.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.824+0000 7f3f39000640 1 --2- 172.21.15.71:0/2878564006 >> v2:172.21.15.137:3300/0 conn(0x7f3f34162c00 0x7f3f340d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.824+0000 7f3f39a00640 1 -- 172.21.15.71:0/2878564006 >> v2:172.21.15.137:3300/0 conn(0x7f3f34162c00 msgr2=0x7f3f340d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:37.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.824+0000 7f3f39a00640 1 --2- 172.21.15.71:0/2878564006 >> v2:172.21.15.137:3300/0 conn(0x7f3f34162c00 0x7f3f340d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.824+0000 7f3f39a00640 1 -- 172.21.15.71:0/2878564006 >> v1:172.21.15.71:6789/0 conn(0x7f3f3406f090 legacy=0x7f3f3406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.824+0000 7f3f39a00640 1 -- 172.21.15.71:0/2878564006 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3406e310 con 0x7f3f3406fc30 2024-04-20T21:19:37.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.825+0000 7f3f39a00640 1 --2- 172.21.15.71:0/2878564006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f3406fc30 0x7f3f340d08a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3f3406c930 tx=0x7f3f2c02be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9515b0a1333fc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:37.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.825+0000 7f3f33e00640 1 -- 172.21.15.71:0/2878564006 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c039070 con 0x7f3f3406fc30 2024-04-20T21:19:37.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.825+0000 7f3f33e00640 1 -- 172.21.15.71:0/2878564006 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c02cbe0 con 0x7f3f3406fc30 2024-04-20T21:19:37.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.825+0000 7f3f33e00640 1 -- 172.21.15.71:0/2878564006 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c034440 con 0x7f3f3406fc30 2024-04-20T21:19:37.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.826+0000 7f3f3ba00640 1 -- 172.21.15.71:0/2878564006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f3406fc30 msgr2=0x7f3f340d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.826+0000 7f3f3ba00640 1 --2- 172.21.15.71:0/2878564006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f3406fc30 0x7f3f340d08a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3f3406c930 tx=0x7f3f2c02be30 comp rx=0 tx=0).stop 2024-04-20T21:19:37.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.826+0000 7f3f3ba00640 1 -- 172.21.15.71:0/2878564006 shutdown_connections 2024-04-20T21:19:37.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.826+0000 7f3f3ba00640 1 --2- 172.21.15.71:0/2878564006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f3406fc30 0x7f3f340d08a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.826+0000 7f3f3ba00640 1 --2- 172.21.15.71:0/2878564006 >> v2:172.21.15.137:3300/0 conn(0x7f3f34162c00 0x7f3f340d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.826+0000 7f3f3ba00640 1 -- 172.21.15.71:0/2878564006 >> 172.21.15.71:0/2878564006 conn(0x7f3f340b3350 msgr2=0x7f3f340b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:37.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.826+0000 7f3f3ba00640 1 -- 172.21.15.71:0/2878564006 shutdown_connections 2024-04-20T21:19:37.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.826+0000 7f3f3ba00640 1 -- 172.21.15.71:0/2878564006 wait complete. 2024-04-20T21:19:37.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.828+0000 7f3f3ba00640 1 Processor -- start 2024-04-20T21:19:37.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.828+0000 7f3f3ba00640 1 -- start start 2024-04-20T21:19:37.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.829+0000 7f3f3ba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f3406f090 0x7f3f34154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.829+0000 7f3f3ba00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f3406fc30 0x7f3f34154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.829+0000 7f3f3ba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f34162c00 0x7f3f340aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.829+0000 7f3f3ba00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3406dbb0 con 0x7f3f3406fc30 2024-04-20T21:19:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.829+0000 7f3f3ba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3406e890 con 0x7f3f34162c00 2024-04-20T21:19:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.829+0000 7f3f3ba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3406dd30 con 0x7f3f3406f090 2024-04-20T21:19:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.830+0000 7f3f2be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f3406fc30 0x7f3f34154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.830+0000 7f3f2be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f3406fc30 0x7f3f34154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38316/0 (socket says 172.21.15.71:38316) 2024-04-20T21:19:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.830+0000 7f3f2be00640 1 -- 172.21.15.71:0/1934876363 learned_addr learned my addr 172.21.15.71:0/1934876363 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.830+0000 7f3f39a00640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f34162c00 0x7f3f340aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.830+0000 7f3f39000640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f3406f090 0x7f3f34154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.830+0000 7f3f2be00640 1 -- 172.21.15.71:0/1934876363 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f3406f090 msgr2=0x7f3f34154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.830+0000 7f3f2be00640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f3406f090 0x7f3f34154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.830+0000 7f3f2be00640 1 -- 172.21.15.71:0/1934876363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f34162c00 msgr2=0x7f3f340aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:37.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.830+0000 7f3f2be00640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f34162c00 0x7f3f340aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:37.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.830+0000 7f3f2be00640 1 -- 172.21.15.71:0/1934876363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f341654b0 con 0x7f3f3406fc30 2024-04-20T21:19:37.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.831+0000 7f3f2be00640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f3406fc30 0x7f3f34154fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00c470 tx=0x7f3f1c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:37.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.831+0000 7f3f31600640 1 -- 172.21.15.71:0/1934876363 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c017070 con 0x7f3f3406fc30 2024-04-20T21:19:37.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.831+0000 7f3f31600640 1 -- 172.21.15.71:0/1934876363 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c005ce0 con 0x7f3f3406fc30 2024-04-20T21:19:37.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.831+0000 7f3f31600640 1 -- 172.21.15.71:0/1934876363 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0072f0 con 0x7f3f3406fc30 2024-04-20T21:19:37.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.831+0000 7f3f3ba00640 1 -- 172.21.15.71:0/1934876363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f34165790 con 0x7f3f3406fc30 2024-04-20T21:19:37.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.831+0000 7f3f3ba00640 1 -- 172.21.15.71:0/1934876363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f34165d50 con 0x7f3f3406fc30 2024-04-20T21:19:37.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.832+0000 7f3f3ba00640 1 -- 172.21.15.71:0/1934876363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f34068980 con 0x7f3f3406fc30 2024-04-20T21:19:37.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.833+0000 7f3f31600640 1 -- 172.21.15.71:0/1934876363 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f1c01a070 con 0x7f3f3406fc30 2024-04-20T21:19:37.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.834+0000 7f3f31600640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3f1006c8f0 0x7f3f1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:37.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.834+0000 7f3f31600640 1 -- 172.21.15.71:0/1934876363 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3f1c08b270 con 0x7f3f3406fc30 2024-04-20T21:19:37.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.835+0000 7f3f39000640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3f1006c8f0 0x7f3f1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:37.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.835+0000 7f3f39000640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3f1006c8f0 0x7f3f1006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f24006fd0 tx=0x7f3f24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:37.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:37.839+0000 7f3f31600640 1 -- 172.21.15.71:0/1934876363 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3f1c058c70 con 0x7f3f3406fc30 2024-04-20T21:19:38.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.075+0000 7f3f3ba00640 1 -- 172.21.15.71:0/1934876363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3f340b0ce0 con 0x7f3f3406fc30 2024-04-20T21:19:38.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.075+0000 7f3f31600640 1 -- 172.21.15.71:0/1934876363 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f3f1c05cf70 con 0x7f3f3406fc30 2024-04-20T21:19:38.075 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-20T21:19:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 -- 172.21.15.71:0/1934876363 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3f1006c8f0 msgr2=0x7f3f1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3f1006c8f0 0x7f3f1006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f24006fd0 tx=0x7f3f24008040 comp rx=0 tx=0).stop 2024-04-20T21:19:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 -- 172.21.15.71:0/1934876363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f3406fc30 msgr2=0x7f3f34154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f3406fc30 0x7f3f34154fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00c470 tx=0x7f3f1c001e70 comp rx=0 tx=0).stop 2024-04-20T21:19:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 -- 172.21.15.71:0/1934876363 shutdown_connections 2024-04-20T21:19:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3f1006c8f0 0x7f3f1006edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f34162c00 0x7f3f340aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f3406fc30 0x7f3f34154fb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 --2- 172.21.15.71:0/1934876363 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f3406f090 0x7f3f34154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 -- 172.21.15.71:0/1934876363 >> 172.21.15.71:0/1934876363 conn(0x7f3f340b3350 msgr2=0x7f3f340b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:38.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 -- 172.21.15.71:0/1934876363 shutdown_connections 2024-04-20T21:19:38.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38.078+0000 7f3f3ba00640 1 -- 172.21.15.71:0/1934876363 wait complete. 2024-04-20T21:19:38.098 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-20T21:19:38.099 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T21:19:38.099 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-04-20T21:19:38.099 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-20T21:19:38.099 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-20T21:19:38.099 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-20T21:19:38.099 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T21:19:38.099 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T21:19:38.099 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-20T21:19:38.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:38.099 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-04-20T21:19:38.152 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:19:38.152 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:19:38.153 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-20T21:19:38.154 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42607sec preferred_lft 42607sec 2024-04-20T21:19:38.154 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2024-04-20T21:19:38.154 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:19:38.155 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-20T21:19:38.155 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:19:38.155 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:19:38.155 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add name ceph-brx type bridge 2024-04-20T21:19:38.155 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr flush dev ceph-brx 2024-04-20T21:19:38.155 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set ceph-brx up 2024-04-20T21:19:38.155 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-20T21:19:38.155 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:19:38.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:19:39.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:19:39.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:39.199 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T21:19:39.268 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-04-20T21:19:39.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:39.271 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-04-20T21:19:39.322 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-04-20T21:19:39.322 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T21:19:39.322 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T21:19:39.322 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T21:19:39.322 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T21:19:39.323 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:19:39.323 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:19:39.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T21:19:39.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T21:19:39.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T21:19:39.323 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:19:39.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:19:40.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:19:40.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:40.064 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-20T21:19:40.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:40.114 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2024-04-20T21:19:40.166 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:19:40.166 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:19:40.166 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T21:19:40.166 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-20T21:19:40.166 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:19:40.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:19:40.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:19:40.351 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-20T21:19:40.351 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:19:40.352 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:19:40.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-20T21:19:40.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-20T21:19:40.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-20T21:19:40.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-20T21:19:40.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-20T21:19:40.352 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:19:40.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:19:40.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:19:40.639 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:19:40.639 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:19:40.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2024-04-20T21:19:40.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.0 master ceph-brx 2024-04-20T21:19:40.640 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:19:40.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:19:40.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:19:40.840 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-20T21:19:40.840 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:19:40.840 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-20T21:19:40.886 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-20T21:19:40.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:19:40.887 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-20T21:19:40.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2024-04-20T21:19:41.041 DEBUG:teuthology.orchestra.run.smithi071:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:19:41.081 INFO:teuthology.orchestra.run.smithi071.stdout:/proc 2024-04-20T21:19:41.081 INFO:teuthology.orchestra.run.smithi071.stdout:/sys 2024-04-20T21:19:41.081 INFO:teuthology.orchestra.run.smithi071.stdout:/dev 2024-04-20T21:19:41.081 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/security 2024-04-20T21:19:41.081 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/shm 2024-04-20T21:19:41.081 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/pts 2024-04-20T21:19:41.081 INFO:teuthology.orchestra.run.smithi071.stdout:/run 2024-04-20T21:19:41.081 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/cgroup 2024-04-20T21:19:41.081 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/pstore 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/bpf 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/ 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/selinux 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/mqueue 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/hugepages 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/debug 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/tracing 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/fuse/connections 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/config 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:19:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/1000 2024-04-20T21:19:41.083 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph 2024-04-20T21:19:41.083 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-0 2024-04-20T21:19:41.083 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-1 2024-04-20T21:19:41.083 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-2 2024-04-20T21:19:41.083 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-3 2024-04-20T21:19:41.083 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns 2024-04-20T21:19:41.083 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T21:19:41.083 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T21:19:41.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:41.084 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2024-04-20T21:19:41.179 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-20T21:19:41.179 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-20T21:19:41.184 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2024-04-20T21:19:41.249 DEBUG:teuthology.orchestra.run.smithi071:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:19:41.288 INFO:teuthology.orchestra.run.smithi071.stdout:/proc 2024-04-20T21:19:41.288 INFO:teuthology.orchestra.run.smithi071.stdout:/sys 2024-04-20T21:19:41.288 INFO:teuthology.orchestra.run.smithi071.stdout:/dev 2024-04-20T21:19:41.288 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/security 2024-04-20T21:19:41.288 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/shm 2024-04-20T21:19:41.288 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/pts 2024-04-20T21:19:41.288 INFO:teuthology.orchestra.run.smithi071.stdout:/run 2024-04-20T21:19:41.288 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/cgroup 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/pstore 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/bpf 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/ 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/selinux 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/mqueue 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/hugepages 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/debug 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/tracing 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/fuse/connections 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/config 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:19:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:19:41.290 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/1000 2024-04-20T21:19:41.290 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph 2024-04-20T21:19:41.290 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-0 2024-04-20T21:19:41.290 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-1 2024-04-20T21:19:41.290 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-2 2024-04-20T21:19:41.290 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-3 2024-04-20T21:19:41.290 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns 2024-04-20T21:19:41.290 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T21:19:41.290 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T21:19:41.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:41.291 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2024-04-20T21:19:41.360 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi071.stderr:2024-04-20T21:19:41.361+0000 7f1a2b84c480 -1 init, newargv = 0x55585de6b4d0 newargc=15 2024-04-20T21:19:41.361 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi071.stderr:ceph-fuse[29710]: starting ceph client 2024-04-20T21:19:41.374 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi071.stderr:ceph-fuse[29710]: starting fuse 2024-04-20T21:19:42.475 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2024-04-20T21:19:42.567 DEBUG:teuthology.orchestra.run.smithi071:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:19:42.620 INFO:teuthology.orchestra.run.smithi071.stdout:/proc 2024-04-20T21:19:42.620 INFO:teuthology.orchestra.run.smithi071.stdout:/sys 2024-04-20T21:19:42.620 INFO:teuthology.orchestra.run.smithi071.stdout:/dev 2024-04-20T21:19:42.620 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/security 2024-04-20T21:19:42.620 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/shm 2024-04-20T21:19:42.620 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/pts 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/run 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/cgroup 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/pstore 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/bpf 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/ 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/selinux 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/mqueue 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/hugepages 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/debug 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/tracing 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/fuse/connections 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/config 2024-04-20T21:19:42.621 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/1000 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-0 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-1 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-2 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-3 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T21:19:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-20T21:19:42.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:42.623 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2024-04-20T21:19:42.672 INFO:teuthology.orchestra.run.smithi071.stdout:42 2024-04-20T21:19:42.672 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-20T21:19:42.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo stdin-killer -- python3 -c ' 2024-04-20T21:19:42.672 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2024-04-20T21:19:42.672 DEBUG:teuthology.orchestra.run.smithi071:> import re 2024-04-20T21:19:42.672 DEBUG:teuthology.orchestra.run.smithi071:> import os 2024-04-20T21:19:42.672 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2024-04-20T21:19:42.672 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:19:42.672 DEBUG:teuthology.orchestra.run.smithi071:> def _find_admin_socket(client_name): 2024-04-20T21:19:42.672 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> contents = proc_f.read() 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> if mountpoint in contents: 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> return f 2024-04-20T21:19:42.673 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-20T21:19:42.674 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:19:42.674 DEBUG:teuthology.orchestra.run.smithi071:> print(_find_admin_socket("client.admin")) 2024-04-20T21:19:42.674 DEBUG:teuthology.orchestra.run.smithi071:> ' 2024-04-20T21:19:42.827 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.admin.29710.asok 2024-04-20T21:19:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:19:42.845 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.29710.asok 2024-04-20T21:19:42.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:42.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.29710.asok status 2024-04-20T21:19:43.069 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-20T21:19:43.069 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2024-04-20T21:19:43.069 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-20T21:19:43.069 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-20T21:19:43.069 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "admin", 2024-04-20T21:19:43.069 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "29710", 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4410, 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4410 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2024-04-20T21:19:43.070 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2277244131 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2277244131 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.4410 192.168.0.1:0/2277244131", 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "192.168.0.1:0/2277244131", 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 6, 2024-04-20T21:19:43.071 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 25, 2024-04-20T21:19:43.072 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2024-04-20T21:19:43.072 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklisted": false, 2024-04-20T21:19:43.072 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2024-04-20T21:19:43.072 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-20T21:19:43.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:43.084 DEBUG:teuthology.orchestra.run.smithi071:> stat --file-system '--printf=%T 2024-04-20T21:19:43.084 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-20T21:19:43.136 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2024-04-20T21:19:43.136 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-20T21:19:43.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:43.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-20T21:19:43.218 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-20T21:19:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-20T21:19:43.364 INFO:teuthology.orchestra.run.smithi071.stdout:# file: . 2024-04-20T21:19:43.364 INFO:teuthology.orchestra.run.smithi071.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-20T21:19:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:19:43.375 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:19:43.375 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:19:43.424 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.665+0000 7f96d7e00640 1 Processor -- start 2024-04-20T21:19:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.665+0000 7f96d7e00640 1 -- start start 2024-04-20T21:19:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.666+0000 7f96d7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 0x7f96d80adf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.666+0000 7f96d7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f96d806b900 0x7f96d806bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.666+0000 7f96d7e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d8071a80 con 0x7f96d80b2f70 2024-04-20T21:19:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.666+0000 7f96d7e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f96d806c270 con 0x7f96d806b900 2024-04-20T21:19:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.666+0000 7f96d7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f96d8071cf0 con 0x7f96d80b4320 2024-04-20T21:19:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.667+0000 7f96ce000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 0x7f96d80adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.667+0000 7f96ce000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 0x7f96d80adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:45486/0 (socket says 172.21.15.71:45486) 2024-04-20T21:19:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.667+0000 7f96ce000640 1 -- 172.21.15.71:0/2131034751 learned_addr learned my addr 172.21.15.71:0/2131034751 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.667+0000 7f96d7400640 1 --2- 172.21.15.71:0/2131034751 >> v2:172.21.15.137:3300/0 conn(0x7f96d806b900 0x7f96d806bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.668+0000 7f96ce000640 1 -- 172.21.15.71:0/2131034751 >> v2:172.21.15.137:3300/0 conn(0x7f96d806b900 msgr2=0x7f96d806bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.668+0000 7f96ce000640 1 --2- 172.21.15.71:0/2131034751 >> v2:172.21.15.137:3300/0 conn(0x7f96d806b900 0x7f96d806bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.668+0000 7f96ce000640 1 -- 172.21.15.71:0/2131034751 >> v1:172.21.15.137:6789/0 conn(0x7f96d80b2f70 legacy=0x7f96d815f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.668+0000 7f96ce000640 1 -- 172.21.15.71:0/2131034751 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d8071fd0 con 0x7f96d80b4320 2024-04-20T21:19:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.669+0000 7f96ce000640 1 --2- 172.21.15.71:0/2131034751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 0x7f96d80adf60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009e50 tx=0x7f96c002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdab8a85bb7bbe8b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.669+0000 7f96d6000640 1 -- 172.21.15.71:0/2131034751 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c002cb00 con 0x7f96d80b4320 2024-04-20T21:19:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.670+0000 7f96d6000640 1 -- 172.21.15.71:0/2131034751 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c002cca0 con 0x7f96d80b4320 2024-04-20T21:19:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.670+0000 7f96d6000640 1 -- 172.21.15.71:0/2131034751 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0034610 con 0x7f96d80b4320 2024-04-20T21:19:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.670+0000 7f96d7e00640 1 -- 172.21.15.71:0/2131034751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 msgr2=0x7f96d80adf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.670+0000 7f96d7e00640 1 --2- 172.21.15.71:0/2131034751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 0x7f96d80adf60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009e50 tx=0x7f96c002bf60 comp rx=0 tx=0).stop 2024-04-20T21:19:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.670+0000 7f96d7e00640 1 -- 172.21.15.71:0/2131034751 shutdown_connections 2024-04-20T21:19:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.670+0000 7f96d7e00640 1 --2- 172.21.15.71:0/2131034751 >> v2:172.21.15.137:3300/0 conn(0x7f96d806b900 0x7f96d806bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.670+0000 7f96d7e00640 1 --2- 172.21.15.71:0/2131034751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 0x7f96d80adf60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.670+0000 7f96d7e00640 1 -- 172.21.15.71:0/2131034751 >> 172.21.15.71:0/2131034751 conn(0x7f96d80d0040 msgr2=0x7f96d80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.670+0000 7f96d7e00640 1 -- 172.21.15.71:0/2131034751 shutdown_connections 2024-04-20T21:19:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.670+0000 7f96d7e00640 1 -- 172.21.15.71:0/2131034751 wait complete. 2024-04-20T21:19:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.672+0000 7f96d7e00640 1 Processor -- start 2024-04-20T21:19:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.672+0000 7f96d7e00640 1 -- start start 2024-04-20T21:19:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.673+0000 7f96d7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96d806b900 0x7f96d815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.673+0000 7f96d7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96d80b2f70 0x7f96d809a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.673+0000 7f96d7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 0x7f96d809cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.673+0000 7f96d7e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96d815fcc0 con 0x7f96d80b2f70 2024-04-20T21:19:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.673+0000 7f96d7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96d80736c0 con 0x7f96d806b900 2024-04-20T21:19:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.673+0000 7f96d7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f96d815fe40 con 0x7f96d80b4320 2024-04-20T21:19:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.673+0000 7f96ce000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96d80b2f70 0x7f96d809a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.673+0000 7f96ce000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96d80b2f70 0x7f96d809a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50706/0 (socket says 172.21.15.71:50706) 2024-04-20T21:19:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.673+0000 7f96ce000640 1 -- 172.21.15.71:0/797471159 learned_addr learned my addr 172.21.15.71:0/797471159 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.674+0000 7f96d6a00640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96d806b900 0x7f96d815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.674+0000 7f96d7400640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 0x7f96d809cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.674+0000 7f96ce000640 1 -- 172.21.15.71:0/797471159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 msgr2=0x7f96d809cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.674+0000 7f96ce000640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 0x7f96d809cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.674+0000 7f96ce000640 1 -- 172.21.15.71:0/797471159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96d806b900 msgr2=0x7f96d815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.674+0000 7f96ce000640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96d806b900 0x7f96d815b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.674+0000 7f96ce000640 1 -- 172.21.15.71:0/797471159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d809b4b0 con 0x7f96d80b2f70 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.674+0000 7f96d7400640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 0x7f96d809cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.674+0000 7f96ce000640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96d80b2f70 0x7f96d809a9f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96c0000f80 tx=0x7f96c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.675+0000 7f96cf400640 1 -- 172.21.15.71:0/797471159 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0044020 con 0x7f96d80b2f70 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.675+0000 7f96cf400640 1 -- 172.21.15.71:0/797471159 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c002ce50 con 0x7f96d80b2f70 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.675+0000 7f96cf400640 1 -- 172.21.15.71:0/797471159 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0009510 con 0x7f96d80b2f70 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.675+0000 7f96d7e00640 1 -- 172.21.15.71:0/797471159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d809b790 con 0x7f96d80b2f70 2024-04-20T21:19:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.675+0000 7f96d7e00640 1 -- 172.21.15.71:0/797471159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d809bd50 con 0x7f96d80b2f70 2024-04-20T21:19:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.676+0000 7f96d7e00640 1 -- 172.21.15.71:0/797471159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d8075b60 con 0x7f96d80b2f70 2024-04-20T21:19:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.677+0000 7f96cf400640 1 -- 172.21.15.71:0/797471159 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f96c0047020 con 0x7f96d80b2f70 2024-04-20T21:19:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.678+0000 7f96cf400640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f96b406c8f0 0x7f96b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.678+0000 7f96cf400640 1 -- 172.21.15.71:0/797471159 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f96c00ae810 con 0x7f96d80b2f70 2024-04-20T21:19:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.678+0000 7f96d6a00640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f96b406c8f0 0x7f96b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.679+0000 7f96d6a00640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f96b406c8f0 0x7f96b406edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f96c8007fd0 tx=0x7f96c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:43.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.683+0000 7f96cf400640 1 -- 172.21.15.71:0/797471159 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f96c004e030 con 0x7f96d80b2f70 2024-04-20T21:19:43.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.882+0000 7f96d7e00640 1 -- 172.21.15.71:0/797471159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96d80d0880 con 0x7f96d80b2f70 2024-04-20T21:19:43.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.885+0000 7f96cf400640 1 -- 172.21.15.71:0/797471159 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f96c007c870 con 0x7f96d80b2f70 2024-04-20T21:19:43.886 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:43.886 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:43.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.888+0000 7f96d7e00640 1 -- 172.21.15.71:0/797471159 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f96b406c8f0 msgr2=0x7f96b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:43.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.888+0000 7f96d7e00640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f96b406c8f0 0x7f96b406edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f96c8007fd0 tx=0x7f96c8009040 comp rx=0 tx=0).stop 2024-04-20T21:19:43.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.888+0000 7f96d7e00640 1 -- 172.21.15.71:0/797471159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96d80b2f70 msgr2=0x7f96d809a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:43.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.888+0000 7f96d7e00640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96d80b2f70 0x7f96d809a9f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96c0000f80 tx=0x7f96c0004a40 comp rx=0 tx=0).stop 2024-04-20T21:19:43.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.888+0000 7f96d7e00640 1 -- 172.21.15.71:0/797471159 shutdown_connections 2024-04-20T21:19:43.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.888+0000 7f96d7e00640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f96b406c8f0 0x7f96b406edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:43.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.888+0000 7f96d7e00640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96d80b4320 0x7f96d809cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:43.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.888+0000 7f96d7e00640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96d80b2f70 0x7f96d809a9f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:43.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.888+0000 7f96d7e00640 1 --2- 172.21.15.71:0/797471159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96d806b900 0x7f96d815b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:43.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.888+0000 7f96d7e00640 1 -- 172.21.15.71:0/797471159 >> 172.21.15.71:0/797471159 conn(0x7f96d80d0040 msgr2=0x7f96d80acf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:43.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.889+0000 7f96d7e00640 1 -- 172.21.15.71:0/797471159 shutdown_connections 2024-04-20T21:19:43.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:43.889+0000 7f96d7e00640 1 -- 172.21.15.71:0/797471159 wait complete. 2024-04-20T21:19:43.908 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:19:43.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:19:44.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.108+0000 7ff0ad200640 1 Processor -- start 2024-04-20T21:19:44.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.108+0000 7ff0ad200640 1 -- start start 2024-04-20T21:19:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.110+0000 7ff0ad200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0a8156c20 0x7ff0a806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.110+0000 7ff0ad200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a8141c60 con 0x7ff0a80d0360 2024-04-20T21:19:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.110+0000 7ff0ad200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a80adab0 con 0x7ff0a815ca40 2024-04-20T21:19:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.110+0000 7ff0ad200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a815cf90 con 0x7ff0a8156c20 2024-04-20T21:19:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.110+0000 7ff0a6800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff0a80d0360 0x7ff0a8142140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52710/0 (socket says 172.21.15.71:52710) 2024-04-20T21:19:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.110+0000 7ff0a6800640 1 -- 172.21.15.71:0/3260193676 learned_addr learned my addr 172.21.15.71:0/3260193676 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:44.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a5e00640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0a8156c20 0x7ff0a806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2630887734 0 0) 0x7ff0a8141c60 con 0x7ff0a80d0360 2024-04-20T21:19:44.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff08c003520 con 0x7ff0a80d0360 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1581959998 0 0) 0x7ff08c003520 con 0x7ff0a80d0360 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0a8156c20 msgr2=0x7ff0a806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0a8156c20 0x7ff0a806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 >> v1:172.21.15.137:6789/0 conn(0x7ff0a815ca40 legacy=0x7ff0a80ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a815d270 con 0x7ff0a80d0360 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7ff0a0001670 con 0x7ff0a80d0360 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 >> v1:172.21.15.71:6789/0 conn(0x7ff0a80d0360 legacy=0x7ff0a8142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0a8156c20 0x7ff08c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c003f60 0x7ff08c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff08c004d40 0x7ff08c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a815cf90 con 0x7ff08c004d40 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c00baa0 con 0x7ff08c003f60 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.111+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff08c00bca0 con 0x7ff0a8156c20 2024-04-20T21:19:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.112+0000 7ff0a6800640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff08c004d40 0x7ff08c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.112+0000 7ff0a5400640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c003f60 0x7ff08c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.112+0000 7ff0a5e00640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0a8156c20 0x7ff08c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.112+0000 7ff0a6800640 1 -- 172.21.15.71:0/3260193676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0a8156c20 msgr2=0x7ff08c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:44.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.112+0000 7ff0a6800640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0a8156c20 0x7ff08c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.112+0000 7ff0a6800640 1 -- 172.21.15.71:0/3260193676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c003f60 msgr2=0x7ff08c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:44.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.112+0000 7ff0a6800640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c003f60 0x7ff08c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.112+0000 7ff0a6800640 1 -- 172.21.15.71:0/3260193676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c003520 con 0x7ff08c004d40 2024-04-20T21:19:44.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.113+0000 7ff0a6800640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff08c004d40 0x7ff08c0051c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000c210 tx=0x7ff08c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c58586606e7c6a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:44.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.114+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0007d30 con 0x7ff08c004d40 2024-04-20T21:19:44.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.114+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a0030070 con 0x7ff08c004d40 2024-04-20T21:19:44.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.114+0000 7ff0a4a00640 1 -- 172.21.15.71:0/3260193676 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a002cde0 con 0x7ff08c004d40 2024-04-20T21:19:44.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.114+0000 7ff0ad200640 1 -- 172.21.15.71:0/3260193676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff08c004d40 msgr2=0x7ff08c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.114+0000 7ff0ad200640 1 --2- 172.21.15.71:0/3260193676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff08c004d40 0x7ff08c0051c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000c210 tx=0x7ff08c005830 comp rx=0 tx=0).stop 2024-04-20T21:19:44.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.114+0000 7ff0a6800640 1 -- 172.21.15.71:0/3260193676 reap_dead start 2024-04-20T21:19:44.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.114+0000 7ff0ad200640 1 -- 172.21.15.71:0/3260193676 shutdown_connections 2024-04-20T21:19:44.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.114+0000 7ff0ad200640 1 -- 172.21.15.71:0/3260193676 >> 172.21.15.71:0/3260193676 conn(0x7ff0a80b3350 msgr2=0x7ff0a80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:44.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.114+0000 7ff0ad200640 1 -- 172.21.15.71:0/3260193676 shutdown_connections 2024-04-20T21:19:44.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.115+0000 7ff0ad200640 1 -- 172.21.15.71:0/3260193676 wait complete. 2024-04-20T21:19:44.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.116+0000 7ff0ad200640 1 Processor -- start 2024-04-20T21:19:44.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.117+0000 7ff0ad200640 1 -- start start 2024-04-20T21:19:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.117+0000 7ff0ad200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff08c004d40 0x7ff0a806e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.117+0000 7ff0ad200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a81545e0 0x7ff0a80ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.117+0000 7ff0ad200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0a80afce0 0x7ff0a80b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.117+0000 7ff0ad200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a8142850 con 0x7ff0a80afce0 2024-04-20T21:19:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.117+0000 7ff0ad200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a815d830 con 0x7ff0a81545e0 2024-04-20T21:19:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.117+0000 7ff0ad200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a81429d0 con 0x7ff08c004d40 2024-04-20T21:19:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.118+0000 7ff0a6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0a80afce0 0x7ff0a80b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.118+0000 7ff0a6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0a80afce0 0x7ff0a80b0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50714/0 (socket says 172.21.15.71:50714) 2024-04-20T21:19:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.118+0000 7ff0a6800640 1 -- 172.21.15.71:0/3089279432 learned_addr learned my addr 172.21.15.71:0/3089279432 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.118+0000 7ff0a5e00640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff08c004d40 0x7ff0a806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.118+0000 7ff0a5400640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a81545e0 0x7ff0a80ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.118+0000 7ff0a6800640 1 -- 172.21.15.71:0/3089279432 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff08c004d40 msgr2=0x7ff0a806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.118+0000 7ff0a6800640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff08c004d40 0x7ff0a806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.118+0000 7ff0a6800640 1 -- 172.21.15.71:0/3089279432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a81545e0 msgr2=0x7ff0a80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.118+0000 7ff0a6800640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a81545e0 0x7ff0a80ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.118+0000 7ff0a6800640 1 -- 172.21.15.71:0/3089279432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a80ced10 con 0x7ff0a80afce0 2024-04-20T21:19:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.119+0000 7ff0a6800640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0a80afce0 0x7ff0a80b0160 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000c300 tx=0x7ff0a0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:44.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.119+0000 7ff09e000640 1 -- 172.21.15.71:0/3089279432 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0004bf0 con 0x7ff0a80afce0 2024-04-20T21:19:44.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.119+0000 7ff09e000640 1 -- 172.21.15.71:0/3089279432 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a0004d90 con 0x7ff0a80afce0 2024-04-20T21:19:44.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.119+0000 7ff09e000640 1 -- 172.21.15.71:0/3089279432 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0007270 con 0x7ff0a80afce0 2024-04-20T21:19:44.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.119+0000 7ff0ad200640 1 -- 172.21.15.71:0/3089279432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a80ceff0 con 0x7ff0a80afce0 2024-04-20T21:19:44.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.119+0000 7ff0ad200640 1 -- 172.21.15.71:0/3089279432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a80cf5b0 con 0x7ff0a80afce0 2024-04-20T21:19:44.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.120+0000 7ff0ad200640 1 -- 172.21.15.71:0/3089279432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a8068980 con 0x7ff0a80afce0 2024-04-20T21:19:44.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.121+0000 7ff09e000640 1 -- 172.21.15.71:0/3089279432 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0a0007410 con 0x7ff0a80afce0 2024-04-20T21:19:44.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.122+0000 7ff09e000640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff08406c8f0 0x7ff08406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.122+0000 7ff09e000640 1 -- 172.21.15.71:0/3089279432 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff0a00ad6f0 con 0x7ff0a80afce0 2024-04-20T21:19:44.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.122+0000 7ff0a5e00640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff08406c8f0 0x7ff08406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.123+0000 7ff0a5e00640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff08406c8f0 0x7ff08406edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff098009a10 tx=0x7ff098008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:44.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.126+0000 7ff09e000640 1 -- 172.21.15.71:0/3089279432 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff0a0046060 con 0x7ff0a80afce0 2024-04-20T21:19:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.323+0000 7ff0ad200640 1 -- 172.21.15.71:0/3089279432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff0a815db10 con 0x7ff0a80afce0 2024-04-20T21:19:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.324+0000 7ff09e000640 1 -- 172.21.15.71:0/3089279432 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7ff0a007b740 con 0x7ff0a80afce0 2024-04-20T21:19:44.324 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:19:44.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.326+0000 7ff0ad200640 1 -- 172.21.15.71:0/3089279432 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff08406c8f0 msgr2=0x7ff08406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.326+0000 7ff0ad200640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff08406c8f0 0x7ff08406edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff098009a10 tx=0x7ff098008040 comp rx=0 tx=0).stop 2024-04-20T21:19:44.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.326+0000 7ff0ad200640 1 -- 172.21.15.71:0/3089279432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0a80afce0 msgr2=0x7ff0a80b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.326+0000 7ff0ad200640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0a80afce0 0x7ff0a80b0160 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000c300 tx=0x7ff0a0001a40 comp rx=0 tx=0).stop 2024-04-20T21:19:44.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.326+0000 7ff0ad200640 1 -- 172.21.15.71:0/3089279432 shutdown_connections 2024-04-20T21:19:44.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.326+0000 7ff0ad200640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff08406c8f0 0x7ff08406edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.326+0000 7ff0ad200640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0a80afce0 0x7ff0a80b0160 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.326+0000 7ff0ad200640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a81545e0 0x7ff0a80ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.326+0000 7ff0ad200640 1 --2- 172.21.15.71:0/3089279432 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff08c004d40 0x7ff0a806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.326+0000 7ff0ad200640 1 -- 172.21.15.71:0/3089279432 >> 172.21.15.71:0/3089279432 conn(0x7ff0a80b3350 msgr2=0x7ff0a806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:44.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.327+0000 7ff0ad200640 1 -- 172.21.15.71:0/3089279432 shutdown_connections 2024-04-20T21:19:44.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.327+0000 7ff0ad200640 1 -- 172.21.15.71:0/3089279432 wait complete. 2024-04-20T21:19:44.345 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:19:44.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.548+0000 7f6331c00640 1 Processor -- start 2024-04-20T21:19:44.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.549+0000 7f6331c00640 1 -- start start 2024-04-20T21:19:44.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.550+0000 7f6331c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f632c06ca00 0x7f632c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.550+0000 7f6331c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632c15fad0 con 0x7f632c06bdd0 2024-04-20T21:19:44.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.550+0000 7f6331c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632c06e3a0 con 0x7f632c06eb60 2024-04-20T21:19:44.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.550+0000 7f6331c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f632c15f510 con 0x7f632c06ca00 2024-04-20T21:19:44.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.551+0000 7f632be00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f632c06bdd0 0x7f632c06c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52720/0 (socket says 172.21.15.71:52720) 2024-04-20T21:19:44.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.551+0000 7f632be00640 1 -- 172.21.15.71:0/2299063723 learned_addr learned my addr 172.21.15.71:0/2299063723 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:44.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.551+0000 7f632b400640 1 --2- 172.21.15.71:0/2299063723 >> v2:172.21.15.137:3300/0 conn(0x7f632c06ca00 0x7f632c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.551+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158108927 0 0) 0x7f632c15fad0 con 0x7f632c06bdd0 2024-04-20T21:19:44.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.551+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6310003520 con 0x7f632c06bdd0 2024-04-20T21:19:44.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.551+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 933225814 0 0) 0x7f6310003520 con 0x7f632c06bdd0 2024-04-20T21:19:44.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 >> v2:172.21.15.137:3300/0 conn(0x7f632c06ca00 msgr2=0x7f632c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:44.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 --2- 172.21.15.71:0/2299063723 >> v2:172.21.15.137:3300/0 conn(0x7f632c06ca00 0x7f632c15eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 >> v1:172.21.15.137:6789/0 conn(0x7f632c06eb60 legacy=0x7f632c06efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c15f7f0 con 0x7f632c06bdd0 2024-04-20T21:19:44.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f631c0019f0 con 0x7f632c06bdd0 2024-04-20T21:19:44.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 >> v1:172.21.15.71:6789/0 conn(0x7f632c06bdd0 legacy=0x7f632c06c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 --2- 172.21.15.71:0/2299063723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63100039b0 0x7f6310003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 --2- 172.21.15.71:0/2299063723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6310004800 0x7f6310004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 --2- 172.21.15.71:0/2299063723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63100051c0 0x7f631000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f632c15f510 con 0x7f63100039b0 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f631000c160 con 0x7f63100051c0 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f631000c360 con 0x7f6310004800 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f632be00640 1 --2- 172.21.15.71:0/2299063723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63100039b0 0x7f6310003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.552+0000 7f6331200640 1 --2- 172.21.15.71:0/2299063723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63100051c0 0x7f631000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.553+0000 7f632be00640 1 -- 172.21.15.71:0/2299063723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6310004800 msgr2=0x7f6310004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.553+0000 7f632be00640 1 --2- 172.21.15.71:0/2299063723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6310004800 0x7f6310004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.553+0000 7f632be00640 1 -- 172.21.15.71:0/2299063723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63100051c0 msgr2=0x7f631000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.553+0000 7f632be00640 1 --2- 172.21.15.71:0/2299063723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63100051c0 0x7f631000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.553+0000 7f632be00640 1 -- 172.21.15.71:0/2299063723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6310003520 con 0x7f63100039b0 2024-04-20T21:19:44.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.553+0000 7f6331200640 1 -- 172.21.15.71:0/2299063723 reap_dead start 2024-04-20T21:19:44.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.554+0000 7f632be00640 1 --2- 172.21.15.71:0/2299063723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63100039b0 0x7f6310003dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f631c00a840 tx=0x7f6310005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b0400135b3ff4e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:44.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.554+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c00a460 con 0x7f63100039b0 2024-04-20T21:19:44.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.554+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f631c034650 con 0x7f63100039b0 2024-04-20T21:19:44.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.554+0000 7f632aa00640 1 -- 172.21.15.71:0/2299063723 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c034a80 con 0x7f63100039b0 2024-04-20T21:19:44.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.554+0000 7f6331c00640 1 -- 172.21.15.71:0/2299063723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63100039b0 msgr2=0x7f6310003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.554+0000 7f6331c00640 1 --2- 172.21.15.71:0/2299063723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63100039b0 0x7f6310003dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f631c00a840 tx=0x7f6310005830 comp rx=0 tx=0).stop 2024-04-20T21:19:44.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.555+0000 7f6331c00640 1 -- 172.21.15.71:0/2299063723 shutdown_connections 2024-04-20T21:19:44.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.555+0000 7f6331c00640 1 --2- 172.21.15.71:0/2299063723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63100039b0 0x7f6310003dd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.555+0000 7f6331c00640 1 -- 172.21.15.71:0/2299063723 >> 172.21.15.71:0/2299063723 conn(0x7f632c0d0880 msgr2=0x7f632c0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:44.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.555+0000 7f6331c00640 1 -- 172.21.15.71:0/2299063723 shutdown_connections 2024-04-20T21:19:44.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.555+0000 7f6331c00640 1 -- 172.21.15.71:0/2299063723 wait complete. 2024-04-20T21:19:44.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.556+0000 7f6331c00640 1 Processor -- start 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.557+0000 7f6331c00640 1 -- start start 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.557+0000 7f6331c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63100039b0 0x7f632c1f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.557+0000 7f6331c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f632c15a5f0 0x7f632c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.557+0000 7f6331c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f632c150330 0x7f632c072210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.557+0000 7f6331c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f632c155a10 con 0x7f632c15a5f0 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.557+0000 7f6331c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f632c155890 con 0x7f632c150330 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.557+0000 7f6331c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f632c06c1b0 con 0x7f63100039b0 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.558+0000 7f632b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f632c15a5f0 0x7f632c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.558+0000 7f632b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f632c15a5f0 0x7f632c155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50720/0 (socket says 172.21.15.71:50720) 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.558+0000 7f632b400640 1 -- 172.21.15.71:0/1354408688 learned_addr learned my addr 172.21.15.71:0/1354408688 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.558+0000 7f6331200640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f632c150330 0x7f632c072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.558+0000 7f632be00640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63100039b0 0x7f632c1f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.558+0000 7f632b400640 1 -- 172.21.15.71:0/1354408688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63100039b0 msgr2=0x7f632c1f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.558+0000 7f632b400640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63100039b0 0x7f632c1f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.558+0000 7f632b400640 1 -- 172.21.15.71:0/1354408688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f632c150330 msgr2=0x7f632c072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.558+0000 7f632b400640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f632c150330 0x7f632c072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.558+0000 7f632b400640 1 -- 172.21.15.71:0/1354408688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c1f5090 con 0x7f632c15a5f0 2024-04-20T21:19:44.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.558+0000 7f632b400640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f632c15a5f0 0x7f632c155f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f631400e6f0 tx=0x7f631400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:44.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.559+0000 7f6323e00640 1 -- 172.21.15.71:0/1354408688 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314017070 con 0x7f632c15a5f0 2024-04-20T21:19:44.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.559+0000 7f6323e00640 1 -- 172.21.15.71:0/1354408688 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f631400c730 con 0x7f632c15a5f0 2024-04-20T21:19:44.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.559+0000 7f6323e00640 1 -- 172.21.15.71:0/1354408688 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631400cb00 con 0x7f632c15a5f0 2024-04-20T21:19:44.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.559+0000 7f6331c00640 1 -- 172.21.15.71:0/1354408688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c1f5370 con 0x7f632c15a5f0 2024-04-20T21:19:44.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.559+0000 7f6331c00640 1 -- 172.21.15.71:0/1354408688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c159280 con 0x7f632c15a5f0 2024-04-20T21:19:44.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.560+0000 7f6331c00640 1 -- 172.21.15.71:0/1354408688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632c075b30 con 0x7f632c15a5f0 2024-04-20T21:19:44.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.561+0000 7f6323e00640 1 -- 172.21.15.71:0/1354408688 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f631401a070 con 0x7f632c15a5f0 2024-04-20T21:19:44.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.562+0000 7f6323e00640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f630806c8f0 0x7f630806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.563+0000 7f6323e00640 1 -- 172.21.15.71:0/1354408688 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f631408c090 con 0x7f632c15a5f0 2024-04-20T21:19:44.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.563+0000 7f632be00640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f630806c8f0 0x7f630806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.563+0000 7f632be00640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f630806c8f0 0x7f630806edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f631c034000 tx=0x7f631c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:44.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.567+0000 7f6323e00640 1 -- 172.21.15.71:0/1354408688 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f631405a0e0 con 0x7f632c15a5f0 2024-04-20T21:19:44.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.764+0000 7f6331c00640 1 -- 172.21.15.71:0/1354408688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f632c06bbb0 con 0x7f632c15a5f0 2024-04-20T21:19:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.765+0000 7f6323e00640 1 -- 172.21.15.71:0/1354408688 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f63140599e0 con 0x7f632c15a5f0 2024-04-20T21:19:44.765 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:19:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.767+0000 7f6331c00640 1 -- 172.21.15.71:0/1354408688 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f630806c8f0 msgr2=0x7f630806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.768+0000 7f6331c00640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f630806c8f0 0x7f630806edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f631c034000 tx=0x7f631c009030 comp rx=0 tx=0).stop 2024-04-20T21:19:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.768+0000 7f6331c00640 1 -- 172.21.15.71:0/1354408688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f632c15a5f0 msgr2=0x7f632c155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.768+0000 7f6331c00640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f632c15a5f0 0x7f632c155f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f631400e6f0 tx=0x7f631400ebb0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.768+0000 7f6331c00640 1 -- 172.21.15.71:0/1354408688 shutdown_connections 2024-04-20T21:19:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.768+0000 7f6331c00640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f630806c8f0 0x7f630806edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.768+0000 7f6331c00640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f632c150330 0x7f632c072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.768+0000 7f6331c00640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f632c15a5f0 0x7f632c155f90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.768+0000 7f6331c00640 1 --2- 172.21.15.71:0/1354408688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63100039b0 0x7f632c1f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.768+0000 7f6331c00640 1 -- 172.21.15.71:0/1354408688 >> 172.21.15.71:0/1354408688 conn(0x7f632c0d0880 msgr2=0x7f632c0b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:44.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.768+0000 7f6331c00640 1 -- 172.21.15.71:0/1354408688 shutdown_connections 2024-04-20T21:19:44.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.768+0000 7f6331c00640 1 -- 172.21.15.71:0/1354408688 wait complete. 2024-04-20T21:19:44.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:19:44.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.992+0000 7f6acbc00640 1 Processor -- start 2024-04-20T21:19:44.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.993+0000 7f6acbc00640 1 -- start start 2024-04-20T21:19:44.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.994+0000 7f6acbc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac40cee90 0x7f6ac40d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.994+0000 7f6acbc00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac40cf390 con 0x7f6ac40ca5f0 2024-04-20T21:19:44.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.994+0000 7f6acbc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac40cf670 con 0x7f6ac40b4650 2024-04-20T21:19:44.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.994+0000 7f6acbc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac40cffa0 con 0x7f6ac40cee90 2024-04-20T21:19:44.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.995+0000 7f6ac9200640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6ac40ca5f0 0x7f6ac40ca9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52732/0 (socket says 172.21.15.71:52732) 2024-04-20T21:19:44.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.995+0000 7f6ac9200640 1 -- 172.21.15.71:0/1773669633 learned_addr learned my addr 172.21.15.71:0/1773669633 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:44.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.995+0000 7f6abbe00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac40cee90 0x7f6ac40d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.995+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2489813807 0 0) 0x7f6ac40cf390 con 0x7f6ac40ca5f0 2024-04-20T21:19:44.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.995+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa4003520 con 0x7f6ac40ca5f0 2024-04-20T21:19:44.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.995+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1869922866 0 0) 0x7f6aa4003520 con 0x7f6ac40ca5f0 2024-04-20T21:19:44.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.995+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac40cee90 msgr2=0x7f6ac40d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:44.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.995+0000 7f6ac3e00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac40cee90 0x7f6ac40d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.995+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 >> v1:172.21.15.137:6789/0 conn(0x7f6ac40b4650 legacy=0x7f6ac40b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac40cf950 con 0x7f6ac40ca5f0 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f6ab4001670 con 0x7f6ac40ca5f0 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 >> v1:172.21.15.71:6789/0 conn(0x7f6ac40ca5f0 legacy=0x7f6ac40ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac3e00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac40cee90 0x7f6aa40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac3e00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4003f60 0x7f6aa4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac3e00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aa4004d40 0x7f6aa40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa400bb50 con 0x7f6aa4003f60 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa400bcd0 con 0x7f6aa4004d40 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6aa400bed0 con 0x7f6ac40cee90 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6abbe00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4003f60 0x7f6aa4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac9200640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac40cee90 0x7f6aa40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac9c00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aa4004d40 0x7f6aa40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6abbe00640 1 -- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac40cee90 msgr2=0x7f6aa40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6abbe00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac40cee90 0x7f6aa40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6abbe00640 1 -- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aa4004d40 msgr2=0x7f6aa40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6abbe00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aa4004d40 0x7f6aa40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6abbe00640 1 -- 172.21.15.71:0/1773669633 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa4003520 con 0x7f6aa4003f60 2024-04-20T21:19:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac9200640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac40cee90 0x7f6aa40039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.996+0000 7f6ac9c00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aa4004d40 0x7f6aa40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.998+0000 7f6abbe00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4003f60 0x7f6aa4004800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009ac0 tx=0x7f6aa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22abcd356fac172e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.998+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac039070 con 0x7f6aa4003f60 2024-04-20T21:19:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.998+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aac02c6b0 con 0x7f6aa4003f60 2024-04-20T21:19:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.998+0000 7f6ac3e00640 1 -- 172.21.15.71:0/1773669633 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac009690 con 0x7f6aa4003f60 2024-04-20T21:19:45.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.998+0000 7f6acbc00640 1 -- 172.21.15.71:0/1773669633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4003f60 msgr2=0x7f6aa4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.998+0000 7f6acbc00640 1 --2- 172.21.15.71:0/1773669633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6aa4003f60 0x7f6aa4004800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009ac0 tx=0x7f6aa4005830 comp rx=0 tx=0).stop 2024-04-20T21:19:45.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.998+0000 7f6ac9c00640 1 -- 172.21.15.71:0/1773669633 reap_dead start 2024-04-20T21:19:45.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.999+0000 7f6acbc00640 1 -- 172.21.15.71:0/1773669633 shutdown_connections 2024-04-20T21:19:45.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.999+0000 7f6acbc00640 1 -- 172.21.15.71:0/1773669633 >> 172.21.15.71:0/1773669633 conn(0x7f6ac4070390 msgr2=0x7f6ac40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:45.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.999+0000 7f6acbc00640 1 -- 172.21.15.71:0/1773669633 shutdown_connections 2024-04-20T21:19:45.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:44.999+0000 7f6acbc00640 1 -- 172.21.15.71:0/1773669633 wait complete. 2024-04-20T21:19:45.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.000+0000 7f6acbc00640 1 Processor -- start 2024-04-20T21:19:45.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.000+0000 7f6acbc00640 1 -- start start 2024-04-20T21:19:45.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.001+0000 7f6acbc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6aa4003f60 0x7f6ac4161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.001+0000 7f6acbc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac4152e40 0x7f6ac41f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.001+0000 7f6acbc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac41f85c0 0x7f6ac41f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.001+0000 7f6acbc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac40d0ae0 con 0x7f6ac4152e40 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.001+0000 7f6acbc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac40d0960 con 0x7f6ac41f85c0 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.001+0000 7f6acbc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac40d0430 con 0x7f6aa4003f60 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.002+0000 7f6abbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac4152e40 0x7f6ac41f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.002+0000 7f6abbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac4152e40 0x7f6ac41f8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50726/0 (socket says 172.21.15.71:50726) 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.002+0000 7f6abbe00640 1 -- 172.21.15.71:0/4245316199 learned_addr learned my addr 172.21.15.71:0/4245316199 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.002+0000 7f6ac9c00640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac41f85c0 0x7f6ac41f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.002+0000 7f6ac9200640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6aa4003f60 0x7f6ac4161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.002+0000 7f6abbe00640 1 -- 172.21.15.71:0/4245316199 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6aa4003f60 msgr2=0x7f6ac4161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.002+0000 7f6abbe00640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6aa4003f60 0x7f6ac4161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.002+0000 7f6abbe00640 1 -- 172.21.15.71:0/4245316199 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac41f85c0 msgr2=0x7f6ac41f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.002+0000 7f6abbe00640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac41f85c0 0x7f6ac41f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.002+0000 7f6abbe00640 1 -- 172.21.15.71:0/4245316199 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac4158050 con 0x7f6ac4152e40 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.002+0000 7f6abbe00640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac4152e40 0x7f6ac41f8080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6aac000c00 tx=0x7f6aac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.003+0000 7f6ac1600640 1 -- 172.21.15.71:0/4245316199 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac043020 con 0x7f6ac4152e40 2024-04-20T21:19:45.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.003+0000 7f6ac1600640 1 -- 172.21.15.71:0/4245316199 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aac02cd90 con 0x7f6ac4152e40 2024-04-20T21:19:45.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.003+0000 7f6ac1600640 1 -- 172.21.15.71:0/4245316199 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac039040 con 0x7f6ac4152e40 2024-04-20T21:19:45.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.003+0000 7f6acbc00640 1 -- 172.21.15.71:0/4245316199 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac4158330 con 0x7f6ac4152e40 2024-04-20T21:19:45.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.003+0000 7f6acbc00640 1 -- 172.21.15.71:0/4245316199 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac41588f0 con 0x7f6ac4152e40 2024-04-20T21:19:45.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.004+0000 7f6acbc00640 1 -- 172.21.15.71:0/4245316199 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac4069090 con 0x7f6ac4152e40 2024-04-20T21:19:45.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.005+0000 7f6ac1600640 1 -- 172.21.15.71:0/4245316199 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6aac046020 con 0x7f6ac4152e40 2024-04-20T21:19:45.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.006+0000 7f6ac1600640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6aa006c8f0 0x7f6aa006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.006+0000 7f6ac1600640 1 -- 172.21.15.71:0/4245316199 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6aac0ad800 con 0x7f6ac4152e40 2024-04-20T21:19:45.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.006+0000 7f6ac9200640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6aa006c8f0 0x7f6aa006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.007+0000 7f6ac9200640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6aa006c8f0 0x7f6aa006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4000ff0 tx=0x7f6ab4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:45.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.011+0000 7f6ac1600640 1 -- 172.21.15.71:0/4245316199 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6aac04d070 con 0x7f6ac4152e40 2024-04-20T21:19:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.213+0000 7f6acbc00640 1 -- 172.21.15.71:0/4245316199 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6ac4071160 con 0x7f6ac4152e40 2024-04-20T21:19:45.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.214+0000 7f6ac1600640 1 -- 172.21.15.71:0/4245316199 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f6aac07b8e0 con 0x7f6ac4152e40 2024-04-20T21:19:45.214 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:19:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 -- 172.21.15.71:0/4245316199 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6aa006c8f0 msgr2=0x7f6aa006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6aa006c8f0 0x7f6aa006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4000ff0 tx=0x7f6ab4009040 comp rx=0 tx=0).stop 2024-04-20T21:19:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 -- 172.21.15.71:0/4245316199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac4152e40 msgr2=0x7f6ac41f8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac4152e40 0x7f6ac41f8080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6aac000c00 tx=0x7f6aac004730 comp rx=0 tx=0).stop 2024-04-20T21:19:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 -- 172.21.15.71:0/4245316199 shutdown_connections 2024-04-20T21:19:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6aa006c8f0 0x7f6aa006edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac41f85c0 0x7f6ac41f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ac4152e40 0x7f6ac41f8080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 --2- 172.21.15.71:0/4245316199 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6aa4003f60 0x7f6ac4161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 -- 172.21.15.71:0/4245316199 >> 172.21.15.71:0/4245316199 conn(0x7f6ac4070390 msgr2=0x7f6ac40b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 -- 172.21.15.71:0/4245316199 shutdown_connections 2024-04-20T21:19:45.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.217+0000 7f6acbc00640 1 -- 172.21.15.71:0/4245316199 wait complete. 2024-04-20T21:19:45.235 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:19:45.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.440+0000 7f7d3ec00640 1 Processor -- start 2024-04-20T21:19:45.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.440+0000 7f7d3ec00640 1 -- start start 2024-04-20T21:19:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.442+0000 7f7d3ec00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7d38156c20 0x7f7d3806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.442+0000 7f7d3ec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 0x7f7d380ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.442+0000 7f7d3ec00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7d380ad8e0 0x7f7d380d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.442+0000 7f7d3ec00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7d38141c60 con 0x7f7d38156c20 2024-04-20T21:19:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.442+0000 7f7d3ec00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7d3815cf90 con 0x7f7d380ad8e0 2024-04-20T21:19:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.442+0000 7f7d3ec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3815d270 con 0x7f7d3815ca40 2024-04-20T21:19:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.442+0000 7f7d37e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7d38156c20 0x7f7d3806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.442+0000 7f7d37e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7d38156c20 0x7f7d3806b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50734/0 (socket says 172.21.15.71:50734) 2024-04-20T21:19:45.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.442+0000 7f7d37e00640 1 -- 172.21.15.71:0/4274742744 learned_addr learned my addr 172.21.15.71:0/4274742744 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:45.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.443+0000 7f7d37400640 1 --2- 172.21.15.71:0/4274742744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 0x7f7d380ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.443+0000 7f7d3cc00640 1 --2- 172.21.15.71:0/4274742744 >> v2:172.21.15.137:3300/0 conn(0x7f7d380ad8e0 0x7f7d380d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.443+0000 7f7d37e00640 1 -- 172.21.15.71:0/4274742744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 msgr2=0x7f7d380ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:45.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.443+0000 7f7d37e00640 1 --2- 172.21.15.71:0/4274742744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 0x7f7d380ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.443+0000 7f7d37e00640 1 -- 172.21.15.71:0/4274742744 >> v2:172.21.15.137:3300/0 conn(0x7f7d380ad8e0 msgr2=0x7f7d380d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:45.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.443+0000 7f7d37e00640 1 --2- 172.21.15.71:0/4274742744 >> v2:172.21.15.137:3300/0 conn(0x7f7d380ad8e0 0x7f7d380d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.443+0000 7f7d37e00640 1 -- 172.21.15.71:0/4274742744 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3815d550 con 0x7f7d38156c20 2024-04-20T21:19:45.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.443+0000 7f7d37400640 1 --2- 172.21.15.71:0/4274742744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 0x7f7d380ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:45.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.443+0000 7f7d3cc00640 1 --2- 172.21.15.71:0/4274742744 >> v2:172.21.15.137:3300/0 conn(0x7f7d380ad8e0 0x7f7d380d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:45.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.444+0000 7f7d37e00640 1 --2- 172.21.15.71:0/4274742744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d38156c20 0x7f7d3806b900 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d3815ff70 tx=0x7f7d2802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be04d087e41caf6a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:45.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.444+0000 7f7d36a00640 1 -- 172.21.15.71:0/4274742744 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28035020 con 0x7f7d38156c20 2024-04-20T21:19:45.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.445+0000 7f7d36a00640 1 -- 172.21.15.71:0/4274742744 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2802d040 con 0x7f7d38156c20 2024-04-20T21:19:45.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.445+0000 7f7d36a00640 1 -- 172.21.15.71:0/4274742744 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28031a80 con 0x7f7d38156c20 2024-04-20T21:19:45.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.445+0000 7f7d3ec00640 1 -- 172.21.15.71:0/4274742744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d38156c20 msgr2=0x7f7d3806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.445+0000 7f7d3ec00640 1 --2- 172.21.15.71:0/4274742744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d38156c20 0x7f7d3806b900 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d3815ff70 tx=0x7f7d2802b900 comp rx=0 tx=0).stop 2024-04-20T21:19:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.445+0000 7f7d3ec00640 1 -- 172.21.15.71:0/4274742744 shutdown_connections 2024-04-20T21:19:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.445+0000 7f7d3ec00640 1 --2- 172.21.15.71:0/4274742744 >> v2:172.21.15.137:3300/0 conn(0x7f7d380ad8e0 0x7f7d380d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.445+0000 7f7d3ec00640 1 --2- 172.21.15.71:0/4274742744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 0x7f7d380ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.445+0000 7f7d3ec00640 1 --2- 172.21.15.71:0/4274742744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d38156c20 0x7f7d3806b900 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.445+0000 7f7d3ec00640 1 -- 172.21.15.71:0/4274742744 >> 172.21.15.71:0/4274742744 conn(0x7f7d380b3350 msgr2=0x7f7d380b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.445+0000 7f7d3ec00640 1 -- 172.21.15.71:0/4274742744 shutdown_connections 2024-04-20T21:19:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.445+0000 7f7d3ec00640 1 -- 172.21.15.71:0/4274742744 wait complete. 2024-04-20T21:19:45.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.447+0000 7f7d3ec00640 1 Processor -- start 2024-04-20T21:19:45.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.447+0000 7f7d3ec00640 1 -- start start 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.448+0000 7f7d3ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d380ad8e0 0x7f7d380ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.448+0000 7f7d3ec00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d38156c20 0x7f7d3815b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.448+0000 7f7d3ec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 0x7f7d3815b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.448+0000 7f7d3ec00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3806bfc0 con 0x7f7d38156c20 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.448+0000 7f7d3ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3806be40 con 0x7f7d380ad8e0 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.448+0000 7f7d3ec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7d380d08a0 con 0x7f7d3815ca40 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.448+0000 7f7d37400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d38156c20 0x7f7d3815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d37400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d38156c20 0x7f7d3815b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50750/0 (socket says 172.21.15.71:50750) 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d37400640 1 -- 172.21.15.71:0/2773078462 learned_addr learned my addr 172.21.15.71:0/2773078462 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d37e00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d380ad8e0 0x7f7d380ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d3cc00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 0x7f7d3815b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d37400640 1 -- 172.21.15.71:0/2773078462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 msgr2=0x7f7d3815b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d37400640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 0x7f7d3815b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d37400640 1 -- 172.21.15.71:0/2773078462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d380ad8e0 msgr2=0x7f7d380ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d37400640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d380ad8e0 0x7f7d380ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d37400640 1 -- 172.21.15.71:0/2773078462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3806dd80 con 0x7f7d38156c20 2024-04-20T21:19:45.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d3cc00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 0x7f7d3815b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:45.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d37400640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d38156c20 0x7f7d3815b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000ce00 tx=0x7f7d2000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:45.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.449+0000 7f7d2fe00640 1 -- 172.21.15.71:0/2773078462 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2000f890 con 0x7f7d38156c20 2024-04-20T21:19:45.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.450+0000 7f7d2fe00640 1 -- 172.21.15.71:0/2773078462 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2000fa30 con 0x7f7d38156c20 2024-04-20T21:19:45.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.450+0000 7f7d3ec00640 1 -- 172.21.15.71:0/2773078462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3806e060 con 0x7f7d38156c20 2024-04-20T21:19:45.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.450+0000 7f7d2fe00640 1 -- 172.21.15.71:0/2773078462 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2000fe40 con 0x7f7d38156c20 2024-04-20T21:19:45.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.450+0000 7f7d3ec00640 1 -- 172.21.15.71:0/2773078462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3806e620 con 0x7f7d38156c20 2024-04-20T21:19:45.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.451+0000 7f7d3ec00640 1 -- 172.21.15.71:0/2773078462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d38068980 con 0x7f7d38156c20 2024-04-20T21:19:45.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.452+0000 7f7d2fe00640 1 -- 172.21.15.71:0/2773078462 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d20018400 con 0x7f7d38156c20 2024-04-20T21:19:45.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.453+0000 7f7d2fe00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d1406c8f0 0x7f7d1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.453+0000 7f7d2fe00640 1 -- 172.21.15.71:0/2773078462 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7d2008ccd0 con 0x7f7d38156c20 2024-04-20T21:19:45.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.453+0000 7f7d37e00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d1406c8f0 0x7f7d1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.454+0000 7f7d37e00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d1406c8f0 0x7f7d1406edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7d28036000 tx=0x7f7d2803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:45.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.458+0000 7f7d2fe00640 1 -- 172.21.15.71:0/2773078462 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7d20014030 con 0x7f7d38156c20 2024-04-20T21:19:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.656+0000 7f7d3ec00640 1 -- 172.21.15.71:0/2773078462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7d380b1490 con 0x7f7d38156c20 2024-04-20T21:19:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.657+0000 7f7d2fe00640 1 -- 172.21.15.71:0/2773078462 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f7d2000ae20 con 0x7f7d38156c20 2024-04-20T21:19:45.657 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:19:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 -- 172.21.15.71:0/2773078462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d1406c8f0 msgr2=0x7f7d1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d1406c8f0 0x7f7d1406edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7d28036000 tx=0x7f7d2803c040 comp rx=0 tx=0).stop 2024-04-20T21:19:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 -- 172.21.15.71:0/2773078462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d38156c20 msgr2=0x7f7d3815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d38156c20 0x7f7d3815b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000ce00 tx=0x7f7d2000a650 comp rx=0 tx=0).stop 2024-04-20T21:19:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 -- 172.21.15.71:0/2773078462 shutdown_connections 2024-04-20T21:19:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d1406c8f0 0x7f7d1406edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d3815ca40 0x7f7d3815b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d38156c20 0x7f7d3815b410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 --2- 172.21.15.71:0/2773078462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d380ad8e0 0x7f7d380ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 -- 172.21.15.71:0/2773078462 >> 172.21.15.71:0/2773078462 conn(0x7f7d380b3350 msgr2=0x7f7d380aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:45.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 -- 172.21.15.71:0/2773078462 shutdown_connections 2024-04-20T21:19:45.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.660+0000 7f7d3ec00640 1 -- 172.21.15.71:0/2773078462 wait complete. 2024-04-20T21:19:45.679 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T21:19:45.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.874+0000 7fbc1dc00640 1 Processor -- start 2024-04-20T21:19:45.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.874+0000 7fbc1dc00640 1 -- start start 2024-04-20T21:19:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.876+0000 7fbc1dc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbc180b2f70 0x7fbc180b4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.876+0000 7fbc1dc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc1806b900 0x7fbc1806bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.876+0000 7fbc1dc00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc18071a80 con 0x7fbc180adf60 2024-04-20T21:19:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.876+0000 7fbc1dc00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbc180ae3f0 con 0x7fbc180b2f70 2024-04-20T21:19:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.876+0000 7fbc1dc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbc1806c240 con 0x7fbc1806b900 2024-04-20T21:19:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.876+0000 7fbc17e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbc180b2f70 0x7fbc180b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.877+0000 7fbc0fe00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbc180adf60 0x7fbc1815f5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52746/0 (socket says 172.21.15.71:52746) 2024-04-20T21:19:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.877+0000 7fbc0fe00640 1 -- 172.21.15.71:0/650214229 learned_addr learned my addr 172.21.15.71:0/650214229 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.877+0000 7fbc1d200640 1 --2- 172.21.15.71:0/650214229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc1806b900 0x7fbc1806bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.877+0000 7fbc17e00640 1 -- 172.21.15.71:0/650214229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc1806b900 msgr2=0x7fbc1806bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.877+0000 7fbc17400640 1 -- 172.21.15.71:0/650214229 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 901464739 0 0) 0x7fbc18071a80 con 0x7fbc180adf60 2024-04-20T21:19:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.877+0000 7fbc17e00640 1 --2- 172.21.15.71:0/650214229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc1806b900 0x7fbc1806bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.877+0000 7fbc17e00640 1 -- 172.21.15.71:0/650214229 >> v1:172.21.15.71:6789/0 conn(0x7fbc180adf60 legacy=0x7fbc1815f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.877+0000 7fbc17e00640 1 -- 172.21.15.71:0/650214229 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc18071cf0 con 0x7fbc180b2f70 2024-04-20T21:19:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.878+0000 7fbc17e00640 1 --2- 172.21.15.71:0/650214229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc180b2f70 0x7fbc180b4320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbc080097a0 tx=0x7fbc0802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb90ef7d629f906 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.879+0000 7fbc17400640 1 -- 172.21.15.71:0/650214229 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08035020 con 0x7fbc180b2f70 2024-04-20T21:19:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.879+0000 7fbc17400640 1 -- 172.21.15.71:0/650214229 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc08031810 con 0x7fbc180b2f70 2024-04-20T21:19:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.879+0000 7fbc17400640 1 -- 172.21.15.71:0/650214229 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08031be0 con 0x7fbc180b2f70 2024-04-20T21:19:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.879+0000 7fbc1dc00640 1 -- 172.21.15.71:0/650214229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc180b2f70 msgr2=0x7fbc180b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.879+0000 7fbc1dc00640 1 --2- 172.21.15.71:0/650214229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc180b2f70 0x7fbc180b4320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbc080097a0 tx=0x7fbc0802b8b0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.879+0000 7fbc1dc00640 1 -- 172.21.15.71:0/650214229 shutdown_connections 2024-04-20T21:19:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.879+0000 7fbc1dc00640 1 --2- 172.21.15.71:0/650214229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc1806b900 0x7fbc1806bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.879+0000 7fbc1dc00640 1 --2- 172.21.15.71:0/650214229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc180b2f70 0x7fbc180b4320 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.879+0000 7fbc1dc00640 1 -- 172.21.15.71:0/650214229 >> 172.21.15.71:0/650214229 conn(0x7fbc180d0040 msgr2=0x7fbc180d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.879+0000 7fbc1dc00640 1 -- 172.21.15.71:0/650214229 shutdown_connections 2024-04-20T21:19:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.879+0000 7fbc1dc00640 1 -- 172.21.15.71:0/650214229 wait complete. 2024-04-20T21:19:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.881+0000 7fbc1dc00640 1 Processor -- start 2024-04-20T21:19:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.881+0000 7fbc1dc00640 1 -- start start 2024-04-20T21:19:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.882+0000 7fbc1dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc1806b900 0x7fbc18149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.882+0000 7fbc1dc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc180adf60 0x7fbc1809ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.882+0000 7fbc1dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc180b2f70 0x7fbc181e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.882+0000 7fbc1dc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc180736c0 con 0x7fbc180b2f70 2024-04-20T21:19:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.882+0000 7fbc1dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbc180739c0 con 0x7fbc1806b900 2024-04-20T21:19:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.882+0000 7fbc1dc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbc1815fcc0 con 0x7fbc180adf60 2024-04-20T21:19:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.882+0000 7fbc1d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc180b2f70 0x7fbc181e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.883+0000 7fbc1d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc180b2f70 0x7fbc181e7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50782/0 (socket says 172.21.15.71:50782) 2024-04-20T21:19:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.883+0000 7fbc1d200640 1 -- 172.21.15.71:0/2539917376 learned_addr learned my addr 172.21.15.71:0/2539917376 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.883+0000 7fbc0fe00640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc180adf60 0x7fbc1809ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.883+0000 7fbc17e00640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc1806b900 0x7fbc18149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.883+0000 7fbc1d200640 1 -- 172.21.15.71:0/2539917376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc180adf60 msgr2=0x7fbc1809ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.883+0000 7fbc1d200640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc180adf60 0x7fbc1809ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.883+0000 7fbc1d200640 1 -- 172.21.15.71:0/2539917376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc1806b900 msgr2=0x7fbc18149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.883+0000 7fbc1d200640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc1806b900 0x7fbc18149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.883+0000 7fbc1d200640 1 -- 172.21.15.71:0/2539917376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1809c400 con 0x7fbc180b2f70 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.883+0000 7fbc1d200640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc180b2f70 0x7fbc181e7bc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbc10007e40 tx=0x7fbc1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.884+0000 7fbc14c00640 1 -- 172.21.15.71:0/2539917376 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10014620 con 0x7fbc180b2f70 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.884+0000 7fbc14c00640 1 -- 172.21.15.71:0/2539917376 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc10019070 con 0x7fbc180b2f70 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.884+0000 7fbc14c00640 1 -- 172.21.15.71:0/2539917376 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10014a20 con 0x7fbc180b2f70 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.884+0000 7fbc1dc00640 1 -- 172.21.15.71:0/2539917376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc1809c6e0 con 0x7fbc180b2f70 2024-04-20T21:19:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.884+0000 7fbc1dc00640 1 -- 172.21.15.71:0/2539917376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc1809cca0 con 0x7fbc180b2f70 2024-04-20T21:19:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.885+0000 7fbc1dc00640 1 -- 172.21.15.71:0/2539917376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc180742b0 con 0x7fbc180b2f70 2024-04-20T21:19:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.886+0000 7fbc14c00640 1 -- 172.21.15.71:0/2539917376 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc10014bc0 con 0x7fbc180b2f70 2024-04-20T21:19:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.887+0000 7fbc14c00640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbbf406c8f0 0x7fbbf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.887+0000 7fbc14c00640 1 -- 172.21.15.71:0/2539917376 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbc1008c840 con 0x7fbc180b2f70 2024-04-20T21:19:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.887+0000 7fbc17e00640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbbf406c8f0 0x7fbbf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.888+0000 7fbc17e00640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbbf406c8f0 0x7fbbf406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbc08036000 tx=0x7fbc0803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:45.892+0000 7fbc14c00640 1 -- 172.21.15.71:0/2539917376 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbc180742b0 con 0x7fbc180b2f70 2024-04-20T21:19:46.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.100+0000 7fbc1dc00640 1 -- 172.21.15.71:0/2539917376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbc18072360 con 0x7fbc180b2f70 2024-04-20T21:19:46.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.101+0000 7fbc14c00640 1 -- 172.21.15.71:0/2539917376 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fbc18072360 con 0x7fbc180b2f70 2024-04-20T21:19:46.100 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2024-04-20T21:19:46.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.103+0000 7fbc1dc00640 1 -- 172.21.15.71:0/2539917376 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbbf406c8f0 msgr2=0x7fbbf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.103+0000 7fbc1dc00640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbbf406c8f0 0x7fbbf406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbc08036000 tx=0x7fbc0803c040 comp rx=0 tx=0).stop 2024-04-20T21:19:46.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.103+0000 7fbc1dc00640 1 -- 172.21.15.71:0/2539917376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc180b2f70 msgr2=0x7fbc181e7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.103+0000 7fbc1dc00640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc180b2f70 0x7fbc181e7bc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbc10007e40 tx=0x7fbc1000e4b0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.103+0000 7fbc1dc00640 1 -- 172.21.15.71:0/2539917376 shutdown_connections 2024-04-20T21:19:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.103+0000 7fbc1dc00640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbbf406c8f0 0x7fbbf406edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.103+0000 7fbc1dc00640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc180b2f70 0x7fbc181e7bc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.103+0000 7fbc1dc00640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc180adf60 0x7fbc1809ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.103+0000 7fbc1dc00640 1 --2- 172.21.15.71:0/2539917376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc1806b900 0x7fbc18149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.103+0000 7fbc1dc00640 1 -- 172.21.15.71:0/2539917376 >> 172.21.15.71:0/2539917376 conn(0x7fbc180d0040 msgr2=0x7fbc180b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.104+0000 7fbc1dc00640 1 -- 172.21.15.71:0/2539917376 shutdown_connections 2024-04-20T21:19:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.104+0000 7fbc1dc00640 1 -- 172.21.15.71:0/2539917376 wait complete. 2024-04-20T21:19:46.121 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:19:46.122 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:19:46.170 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:46.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.403+0000 7feaa5400640 1 Processor -- start 2024-04-20T21:19:46.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.403+0000 7feaa5400640 1 -- start start 2024-04-20T21:19:46.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7feaa5400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feaa015b7e0 0x7feaa015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7feaa5400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaa015c190 0x7feaa006ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7feaa5400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa006ccc0 con 0x7feaa015b400 2024-04-20T21:19:46.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7feaa5400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7feaa006d280 con 0x7feaa015b7e0 2024-04-20T21:19:46.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7feaa5400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feaa006cfa0 con 0x7feaa015c190 2024-04-20T21:19:46.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7fea9f400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feaa015b7e0 0x7feaa015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7fea9f400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feaa015b7e0 0x7feaa015bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50794/0 (socket says 172.21.15.71:50794) 2024-04-20T21:19:46.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7fea9f400640 1 -- 172.21.15.71:0/1441913681 learned_addr learned my addr 172.21.15.71:0/1441913681 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:46.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7feaa4a00640 1 --2- 172.21.15.71:0/1441913681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaa015c190 0x7feaa006ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7fea9f400640 1 -- 172.21.15.71:0/1441913681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaa015c190 msgr2=0x7feaa006ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:46.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7fea9f400640 1 --2- 172.21.15.71:0/1441913681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaa015c190 0x7feaa006ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7fea9f400640 1 -- 172.21.15.71:0/1441913681 >> v1:172.21.15.71:6789/0 conn(0x7feaa015b400 legacy=0x7feaa0072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7fea9f400640 1 -- 172.21.15.71:0/1441913681 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa006e440 con 0x7feaa015b7e0 2024-04-20T21:19:46.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7fea9ea00640 1 -- 172.21.15.71:0/1441913681 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387984568 0 0) 0x7feaa006ccc0 con 0x7feaa015b400 2024-04-20T21:19:46.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.405+0000 7feaa4a00640 1 --2- 172.21.15.71:0/1441913681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaa015c190 0x7feaa006ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:46.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.406+0000 7fea9f400640 1 --2- 172.21.15.71:0/1441913681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feaa015b7e0 0x7feaa015bc50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009870 tx=0x7fea8c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3054b07b4ecaeb13 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:46.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.407+0000 7fea9ea00640 1 -- 172.21.15.71:0/1441913681 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c034070 con 0x7feaa015b7e0 2024-04-20T21:19:46.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.407+0000 7fea9ea00640 1 -- 172.21.15.71:0/1441913681 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8c030840 con 0x7feaa015b7e0 2024-04-20T21:19:46.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.407+0000 7fea9ea00640 1 -- 172.21.15.71:0/1441913681 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c030c10 con 0x7feaa015b7e0 2024-04-20T21:19:46.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.407+0000 7feaa5400640 1 -- 172.21.15.71:0/1441913681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feaa015b7e0 msgr2=0x7feaa015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.407+0000 7feaa5400640 1 --2- 172.21.15.71:0/1441913681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feaa015b7e0 0x7feaa015bc50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009870 tx=0x7fea8c02b980 comp rx=0 tx=0).stop 2024-04-20T21:19:46.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.407+0000 7feaa5400640 1 -- 172.21.15.71:0/1441913681 shutdown_connections 2024-04-20T21:19:46.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.407+0000 7feaa5400640 1 --2- 172.21.15.71:0/1441913681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaa015c190 0x7feaa006ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.407+0000 7feaa5400640 1 --2- 172.21.15.71:0/1441913681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feaa015b7e0 0x7feaa015bc50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.407+0000 7feaa5400640 1 -- 172.21.15.71:0/1441913681 >> 172.21.15.71:0/1441913681 conn(0x7feaa00d0040 msgr2=0x7feaa00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:46.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.407+0000 7feaa5400640 1 -- 172.21.15.71:0/1441913681 shutdown_connections 2024-04-20T21:19:46.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.408+0000 7feaa5400640 1 -- 172.21.15.71:0/1441913681 wait complete. 2024-04-20T21:19:46.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.409+0000 7feaa5400640 1 Processor -- start 2024-04-20T21:19:46.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.409+0000 7feaa5400640 1 -- start start 2024-04-20T21:19:46.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.410+0000 7feaa5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feaa015b400 0x7feaa00cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.410+0000 7feaa5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaa015b7e0 0x7feaa01542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.410+0000 7feaa5400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaa015c190 0x7feaa00b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.410+0000 7feaa5400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feaa015c770 con 0x7feaa015b400 2024-04-20T21:19:46.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.410+0000 7feaa5400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feaa015c5f0 con 0x7feaa015b7e0 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.410+0000 7feaa5400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feaa006f180 con 0x7feaa015c190 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.410+0000 7fea9fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feaa015b400 0x7feaa00cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.411+0000 7fea9fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feaa015b400 0x7feaa00cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50810/0 (socket says 172.21.15.71:50810) 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.411+0000 7fea9fe00640 1 -- 172.21.15.71:0/4146698274 learned_addr learned my addr 172.21.15.71:0/4146698274 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.411+0000 7feaa4a00640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaa015c190 0x7feaa00b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.411+0000 7fea9f400640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaa015b7e0 0x7feaa01542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.411+0000 7fea9fe00640 1 -- 172.21.15.71:0/4146698274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaa015c190 msgr2=0x7feaa00b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.411+0000 7fea9fe00640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaa015c190 0x7feaa00b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.411+0000 7fea9fe00640 1 -- 172.21.15.71:0/4146698274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaa015b7e0 msgr2=0x7feaa01542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.411+0000 7fea9fe00640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaa015b7e0 0x7feaa01542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.411+0000 7fea9fe00640 1 -- 172.21.15.71:0/4146698274 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa00cef90 con 0x7feaa015b400 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.411+0000 7fea9f400640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaa015b7e0 0x7feaa01542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.411+0000 7fea9fe00640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feaa015b400 0x7feaa00cea50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea9000c4b0 tx=0x7fea9000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.412+0000 7fea97e00640 1 -- 172.21.15.71:0/4146698274 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea90017070 con 0x7feaa015b400 2024-04-20T21:19:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.412+0000 7fea97e00640 1 -- 172.21.15.71:0/4146698274 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea90005480 con 0x7feaa015b400 2024-04-20T21:19:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.412+0000 7feaa5400640 1 -- 172.21.15.71:0/4146698274 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa00b0450 con 0x7feaa015b400 2024-04-20T21:19:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.412+0000 7fea97e00640 1 -- 172.21.15.71:0/4146698274 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea90003830 con 0x7feaa015b400 2024-04-20T21:19:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.412+0000 7feaa5400640 1 -- 172.21.15.71:0/4146698274 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa00b0a10 con 0x7feaa015b400 2024-04-20T21:19:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.413+0000 7feaa5400640 1 -- 172.21.15.71:0/4146698274 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa0075b60 con 0x7feaa015b400 2024-04-20T21:19:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.414+0000 7fea97e00640 1 -- 172.21.15.71:0/4146698274 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fea9001a070 con 0x7feaa015b400 2024-04-20T21:19:46.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.415+0000 7fea97e00640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fea8006c920 0x7fea8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.415+0000 7fea97e00640 1 -- 172.21.15.71:0/4146698274 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fea9008b1a0 con 0x7feaa015b400 2024-04-20T21:19:46.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.415+0000 7fea9f400640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fea8006c920 0x7fea8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.416+0000 7fea9f400640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fea8006c920 0x7fea8006ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea8c036000 tx=0x7fea8c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:46.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.419+0000 7fea97e00640 1 -- 172.21.15.71:0/4146698274 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fea90059320 con 0x7feaa015b400 2024-04-20T21:19:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.605+0000 7feaa5400640 1 -- 172.21.15.71:0/4146698274 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feaa00ae630 con 0x7feaa015b400 2024-04-20T21:19:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.607+0000 7fea97e00640 1 -- 172.21.15.71:0/4146698274 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fea90058c20 con 0x7feaa015b400 2024-04-20T21:19:46.607 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:46.607 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.609+0000 7feaa5400640 1 -- 172.21.15.71:0/4146698274 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fea8006c920 msgr2=0x7fea8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.609+0000 7feaa5400640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fea8006c920 0x7fea8006ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea8c036000 tx=0x7fea8c03b040 comp rx=0 tx=0).stop 2024-04-20T21:19:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.609+0000 7feaa5400640 1 -- 172.21.15.71:0/4146698274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feaa015b400 msgr2=0x7feaa00cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.609+0000 7feaa5400640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feaa015b400 0x7feaa00cea50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea9000c4b0 tx=0x7fea9000c970 comp rx=0 tx=0).stop 2024-04-20T21:19:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.609+0000 7feaa5400640 1 -- 172.21.15.71:0/4146698274 shutdown_connections 2024-04-20T21:19:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.609+0000 7feaa5400640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fea8006c920 0x7fea8006ede0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.609+0000 7feaa5400640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaa015c190 0x7feaa00b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.609+0000 7feaa5400640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaa015b7e0 0x7feaa01542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.609+0000 7feaa5400640 1 --2- 172.21.15.71:0/4146698274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feaa015b400 0x7feaa00cea50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.609+0000 7feaa5400640 1 -- 172.21.15.71:0/4146698274 >> 172.21.15.71:0/4146698274 conn(0x7feaa00d0040 msgr2=0x7feaa006b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.610+0000 7feaa5400640 1 -- 172.21.15.71:0/4146698274 shutdown_connections 2024-04-20T21:19:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.610+0000 7feaa5400640 1 -- 172.21.15.71:0/4146698274 wait complete. 2024-04-20T21:19:46.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:19:46.627 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:19:46.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.821+0000 7fb680000640 1 Processor -- start 2024-04-20T21:19:46.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.821+0000 7fb680000640 1 -- start start 2024-04-20T21:19:46.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.823+0000 7fb680000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6780d0a70 0x7fb67806e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.823+0000 7fb680000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67806f060 con 0x7fb67815e8a0 2024-04-20T21:19:46.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.823+0000 7fb680000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67806e7c0 con 0x7fb67806dbb0 2024-04-20T21:19:46.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.823+0000 7fb680000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb67806eaa0 con 0x7fb6780d0a70 2024-04-20T21:19:46.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.823+0000 7fb67d600640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb67815e8a0 0x7fb6780d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52766/0 (socket says 172.21.15.71:52766) 2024-04-20T21:19:46.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.823+0000 7fb67d600640 1 -- 172.21.15.71:0/2108371403 learned_addr learned my addr 172.21.15.71:0/2108371403 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:46.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb67cc00640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6780d0a70 0x7fb67806e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099236508 0 0) 0x7fb67806f060 con 0x7fb67815e8a0 2024-04-20T21:19:46.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb660003520 con 0x7fb67815e8a0 2024-04-20T21:19:46.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3012456173 0 0) 0x7fb660003520 con 0x7fb67815e8a0 2024-04-20T21:19:46.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6780d0a70 msgr2=0x7fb67806e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:46.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6780d0a70 0x7fb67806e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 >> v1:172.21.15.137:6789/0 conn(0x7fb67806dbb0 legacy=0x7fb6780ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67806ed80 con 0x7fb67815e8a0 2024-04-20T21:19:46.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fb66c001670 con 0x7fb67815e8a0 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 >> v1:172.21.15.71:6789/0 conn(0x7fb67815e8a0 legacy=0x7fb6780d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6600039e0 0x7fb660003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb660004800 0x7fb660004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6780d0a70 0x7fb660005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb67806eaa0 con 0x7fb6600039e0 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb66000baf0 con 0x7fb660004800 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb66000bcf0 con 0x7fb6780d0a70 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.824+0000 7fb67d600640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6600039e0 0x7fb660003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.825+0000 7fb67cc00640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb660004800 0x7fb660004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.825+0000 7fb67e000640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6780d0a70 0x7fb660005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.825+0000 7fb67d600640 1 -- 172.21.15.71:0/2108371403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6780d0a70 msgr2=0x7fb660005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.825+0000 7fb67d600640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6780d0a70 0x7fb660005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.825+0000 7fb67d600640 1 -- 172.21.15.71:0/2108371403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb660004800 msgr2=0x7fb660004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:46.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.825+0000 7fb67d600640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb660004800 0x7fb660004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.825+0000 7fb67d600640 1 -- 172.21.15.71:0/2108371403 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb660003520 con 0x7fb6600039e0 2024-04-20T21:19:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.826+0000 7fb67d600640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6600039e0 0x7fb660003e00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00c240 tx=0x7fb660005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2adb300e8d2ba4b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.826+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c007d10 con 0x7fb6600039e0 2024-04-20T21:19:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.826+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb66c030070 con 0x7fb6600039e0 2024-04-20T21:19:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.826+0000 7fb677e00640 1 -- 172.21.15.71:0/2108371403 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c02cd60 con 0x7fb6600039e0 2024-04-20T21:19:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.827+0000 7fb680000640 1 -- 172.21.15.71:0/2108371403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6600039e0 msgr2=0x7fb660003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.827+0000 7fb680000640 1 --2- 172.21.15.71:0/2108371403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6600039e0 0x7fb660003e00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00c240 tx=0x7fb660005830 comp rx=0 tx=0).stop 2024-04-20T21:19:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.827+0000 7fb67e000640 1 -- 172.21.15.71:0/2108371403 reap_dead start 2024-04-20T21:19:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.827+0000 7fb680000640 1 -- 172.21.15.71:0/2108371403 shutdown_connections 2024-04-20T21:19:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.827+0000 7fb680000640 1 -- 172.21.15.71:0/2108371403 >> 172.21.15.71:0/2108371403 conn(0x7fb6780b3350 msgr2=0x7fb6780b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.827+0000 7fb680000640 1 -- 172.21.15.71:0/2108371403 shutdown_connections 2024-04-20T21:19:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.827+0000 7fb680000640 1 -- 172.21.15.71:0/2108371403 wait complete. 2024-04-20T21:19:46.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.829+0000 7fb680000640 1 Processor -- start 2024-04-20T21:19:46.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.829+0000 7fb680000640 1 -- start start 2024-04-20T21:19:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.830+0000 7fb680000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6600039e0 0x7fb6781507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.830+0000 7fb680000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb678153200 0x7fb67809b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.830+0000 7fb680000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb67809d1c0 0x7fb67809d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.830+0000 7fb680000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb67806fef0 con 0x7fb67809d1c0 2024-04-20T21:19:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.830+0000 7fb680000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb67806fd70 con 0x7fb678153200 2024-04-20T21:19:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.830+0000 7fb680000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb67806e1e0 con 0x7fb6600039e0 2024-04-20T21:19:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.830+0000 7fb67e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb67809d1c0 0x7fb67809d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.830+0000 7fb67e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb67809d1c0 0x7fb67809d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50820/0 (socket says 172.21.15.71:50820) 2024-04-20T21:19:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.830+0000 7fb67e000640 1 -- 172.21.15.71:0/752905221 learned_addr learned my addr 172.21.15.71:0/752905221 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb67d600640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6600039e0 0x7fb6781507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb67cc00640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb678153200 0x7fb67809b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb67e000640 1 -- 172.21.15.71:0/752905221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6600039e0 msgr2=0x7fb6781507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb67e000640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6600039e0 0x7fb6781507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb67e000640 1 -- 172.21.15.71:0/752905221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb678153200 msgr2=0x7fb67809b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb67e000640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb678153200 0x7fb67809b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb67e000640 1 -- 172.21.15.71:0/752905221 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67809c120 con 0x7fb67809d1c0 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb67e000640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb67809d1c0 0x7fb67809d640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb6780719a0 tx=0x7fb67000e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb675600640 1 -- 172.21.15.71:0/752905221 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670003b80 con 0x7fb67809d1c0 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb675600640 1 -- 172.21.15.71:0/752905221 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb670018070 con 0x7fb67809d1c0 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb675600640 1 -- 172.21.15.71:0/752905221 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6700050d0 con 0x7fb67809d1c0 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb680000640 1 -- 172.21.15.71:0/752905221 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67809c400 con 0x7fb67809d1c0 2024-04-20T21:19:46.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.831+0000 7fb680000640 1 -- 172.21.15.71:0/752905221 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67809c9c0 con 0x7fb67809d1c0 2024-04-20T21:19:46.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.832+0000 7fb680000640 1 -- 172.21.15.71:0/752905221 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67814f410 con 0x7fb67809d1c0 2024-04-20T21:19:46.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.833+0000 7fb675600640 1 -- 172.21.15.71:0/752905221 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb670005270 con 0x7fb67809d1c0 2024-04-20T21:19:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.834+0000 7fb675600640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb65c06c8f0 0x7fb65c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.834+0000 7fb675600640 1 -- 172.21.15.71:0/752905221 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb67008bad0 con 0x7fb67809d1c0 2024-04-20T21:19:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.835+0000 7fb67d600640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb65c06c8f0 0x7fb65c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.835+0000 7fb67d600640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb65c06c8f0 0x7fb65c06edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb66c034000 tx=0x7fb66c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:46.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:46.839+0000 7fb675600640 1 -- 172.21.15.71:0/752905221 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb670059b20 con 0x7fb67809d1c0 2024-04-20T21:19:47.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.023+0000 7fb680000640 1 -- 172.21.15.71:0/752905221 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb678068980 con 0x7fb67809d1c0 2024-04-20T21:19:47.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.024+0000 7fb675600640 1 -- 172.21.15.71:0/752905221 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fb670059420 con 0x7fb67809d1c0 2024-04-20T21:19:47.024 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 -- 172.21.15.71:0/752905221 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb65c06c8f0 msgr2=0x7fb65c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb65c06c8f0 0x7fb65c06edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb66c034000 tx=0x7fb66c009030 comp rx=0 tx=0).stop 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 -- 172.21.15.71:0/752905221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb67809d1c0 msgr2=0x7fb67809d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb67809d1c0 0x7fb67809d640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb6780719a0 tx=0x7fb67000e9e0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 -- 172.21.15.71:0/752905221 shutdown_connections 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb65c06c8f0 0x7fb65c06edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb67809d1c0 0x7fb67809d640 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb678153200 0x7fb67809b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 --2- 172.21.15.71:0/752905221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6600039e0 0x7fb6781507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 -- 172.21.15.71:0/752905221 >> 172.21.15.71:0/752905221 conn(0x7fb6780b3350 msgr2=0x7fb67815b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 -- 172.21.15.71:0/752905221 shutdown_connections 2024-04-20T21:19:47.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.027+0000 7fb680000640 1 -- 172.21.15.71:0/752905221 wait complete. 2024-04-20T21:19:47.045 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:19:47.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.233+0000 7f46efe00640 1 Processor -- start 2024-04-20T21:19:47.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.234+0000 7f46efe00640 1 -- start start 2024-04-20T21:19:47.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.235+0000 7f46efe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f46f0161a50 0x7f46f00b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:47.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.235+0000 7f46efe00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f00d0980 con 0x7f46f00d3b20 2024-04-20T21:19:47.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.235+0000 7f46efe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f0162490 con 0x7f46f006c010 2024-04-20T21:19:47.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.235+0000 7f46efe00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f46f00d0c60 con 0x7f46f0161a50 2024-04-20T21:19:47.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.235+0000 7f46eea00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f46f0161a50 0x7f46f00b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:47.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.235+0000 7f46eea00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f46f0161a50 0x7f46f00b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50832/0 (socket says 172.21.15.71:50832) 2024-04-20T21:19:47.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.235+0000 7f46eea00640 1 -- 172.21.15.71:0/2947829182 learned_addr learned my addr 172.21.15.71:0/2947829182 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:47.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.235+0000 7f46e6000640 1 --1- 172.21.15.71:0/2947829182 >> v1:172.21.15.71:6789/0 conn(0x7f46f00d3b20 0x7f46f006b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52778/0 (socket says 172.21.15.71:52778) 2024-04-20T21:19:47.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.236+0000 7f46eea00640 1 -- 172.21.15.71:0/2947829182 >> v1:172.21.15.137:6789/0 conn(0x7f46f006c010 legacy=0x7f46f00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:47.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.236+0000 7f46eea00640 1 -- 172.21.15.71:0/2947829182 >> v1:172.21.15.71:6789/0 conn(0x7f46f00d3b20 legacy=0x7f46f006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.236+0000 7f46eea00640 1 -- 172.21.15.71:0/2947829182 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f0162770 con 0x7f46f0161a50 2024-04-20T21:19:47.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.237+0000 7f46eea00640 1 --2- 172.21.15.71:0/2947829182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f0161a50 0x7f46f00b3180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f46f00d0de0 tx=0x7f46e002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc85df2b801f747 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:47.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.237+0000 7f46ee000640 1 -- 172.21.15.71:0/2947829182 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0034070 con 0x7f46f0161a50 2024-04-20T21:19:47.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.237+0000 7f46ee000640 1 -- 172.21.15.71:0/2947829182 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e0030840 con 0x7f46f0161a50 2024-04-20T21:19:47.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.237+0000 7f46ee000640 1 -- 172.21.15.71:0/2947829182 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0030c10 con 0x7f46f0161a50 2024-04-20T21:19:47.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.238+0000 7f46efe00640 1 -- 172.21.15.71:0/2947829182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f0161a50 msgr2=0x7f46f00b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.238+0000 7f46efe00640 1 --2- 172.21.15.71:0/2947829182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f0161a50 0x7f46f00b3180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f46f00d0de0 tx=0x7f46e002b980 comp rx=0 tx=0).stop 2024-04-20T21:19:47.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.238+0000 7f46efe00640 1 -- 172.21.15.71:0/2947829182 shutdown_connections 2024-04-20T21:19:47.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.238+0000 7f46efe00640 1 --2- 172.21.15.71:0/2947829182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f0161a50 0x7f46f00b3180 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.238+0000 7f46efe00640 1 -- 172.21.15.71:0/2947829182 >> 172.21.15.71:0/2947829182 conn(0x7f46f00d0ed0 msgr2=0x7f46f00d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:47.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.238+0000 7f46efe00640 1 -- 172.21.15.71:0/2947829182 shutdown_connections 2024-04-20T21:19:47.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.238+0000 7f46efe00640 1 -- 172.21.15.71:0/2947829182 wait complete. 2024-04-20T21:19:47.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.240+0000 7f46efe00640 1 Processor -- start 2024-04-20T21:19:47.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.240+0000 7f46efe00640 1 -- start start 2024-04-20T21:19:47.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46efe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46f006c010 0x7f46f015d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:47.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46efe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46f0161a50 0x7f46f0157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:47.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46efe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f015ea50 0x7f46f0157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:47.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46efe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46f0162ae0 con 0x7f46f015ea50 2024-04-20T21:19:47.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46efe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46f00d0690 con 0x7f46f0161a50 2024-04-20T21:19:47.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46efe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f46f0161e30 con 0x7f46f006c010 2024-04-20T21:19:47.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46ef400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f015ea50 0x7f46f0157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:47.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46ef400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f015ea50 0x7f46f0157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50844/0 (socket says 172.21.15.71:50844) 2024-04-20T21:19:47.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46ef400640 1 -- 172.21.15.71:0/3924275833 learned_addr learned my addr 172.21.15.71:0/3924275833 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:47.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46eea00640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46f006c010 0x7f46f015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:47.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46e6000640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46f0161a50 0x7f46f0157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:47.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46ef400640 1 -- 172.21.15.71:0/3924275833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46f006c010 msgr2=0x7f46f015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46ef400640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46f006c010 0x7f46f015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46ef400640 1 -- 172.21.15.71:0/3924275833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46f0161a50 msgr2=0x7f46f0157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46ef400640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46f0161a50 0x7f46f0157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.241+0000 7f46ef400640 1 -- 172.21.15.71:0/3924275833 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f015d9b0 con 0x7f46f015ea50 2024-04-20T21:19:47.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.242+0000 7f46ef400640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f015ea50 0x7f46f0157b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46e800c730 tx=0x7f46e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:47.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.242+0000 7f46e7400640 1 -- 172.21.15.71:0/3924275833 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8016020 con 0x7f46f015ea50 2024-04-20T21:19:47.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.242+0000 7f46e7400640 1 -- 172.21.15.71:0/3924275833 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e800aa50 con 0x7f46f015ea50 2024-04-20T21:19:47.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.242+0000 7f46e7400640 1 -- 172.21.15.71:0/3924275833 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e800ce40 con 0x7f46f015ea50 2024-04-20T21:19:47.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.242+0000 7f46efe00640 1 -- 172.21.15.71:0/3924275833 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f015dc90 con 0x7f46f015ea50 2024-04-20T21:19:47.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.242+0000 7f46efe00640 1 -- 172.21.15.71:0/3924275833 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f015e250 con 0x7f46f015ea50 2024-04-20T21:19:47.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.243+0000 7f46efe00640 1 -- 172.21.15.71:0/3924275833 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f0075b30 con 0x7f46f015ea50 2024-04-20T21:19:47.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.244+0000 7f46e7400640 1 -- 172.21.15.71:0/3924275833 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f46e8019020 con 0x7f46f015ea50 2024-04-20T21:19:47.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.245+0000 7f46e7400640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f46cc06c8f0 0x7f46cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:47.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.245+0000 7f46e7400640 1 -- 172.21.15.71:0/3924275833 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f46e808c2b0 con 0x7f46f015ea50 2024-04-20T21:19:47.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.245+0000 7f46eea00640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f46cc06c8f0 0x7f46cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:47.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.246+0000 7f46eea00640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f46cc06c8f0 0x7f46cc06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46e0036000 tx=0x7f46e003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:47.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.249+0000 7f46e7400640 1 -- 172.21.15.71:0/3924275833 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f46e8020020 con 0x7f46f015ea50 2024-04-20T21:19:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.449+0000 7f46efe00640 1 -- 172.21.15.71:0/3924275833 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f46f0160640 con 0x7f46f015ea50 2024-04-20T21:19:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.450+0000 7f46e7400640 1 -- 172.21.15.71:0/3924275833 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f46e80102e0 con 0x7f46f015ea50 2024-04-20T21:19:47.450 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:19:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 -- 172.21.15.71:0/3924275833 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f46cc06c8f0 msgr2=0x7f46cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f46cc06c8f0 0x7f46cc06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46e0036000 tx=0x7f46e003b040 comp rx=0 tx=0).stop 2024-04-20T21:19:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 -- 172.21.15.71:0/3924275833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f015ea50 msgr2=0x7f46f0157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f015ea50 0x7f46f0157b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46e800c730 tx=0x7f46e800cbf0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 -- 172.21.15.71:0/3924275833 shutdown_connections 2024-04-20T21:19:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f46cc06c8f0 0x7f46cc06edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f015ea50 0x7f46f0157b50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46f0161a50 0x7f46f0157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 --2- 172.21.15.71:0/3924275833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46f006c010 0x7f46f015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 -- 172.21.15.71:0/3924275833 >> 172.21.15.71:0/3924275833 conn(0x7f46f00d0ed0 msgr2=0x7f46f00b75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 -- 172.21.15.71:0/3924275833 shutdown_connections 2024-04-20T21:19:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.453+0000 7f46efe00640 1 -- 172.21.15.71:0/3924275833 wait complete. 2024-04-20T21:19:47.471 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:19:47.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.673+0000 7efd6ec00640 1 Processor -- start 2024-04-20T21:19:47.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.674+0000 7efd6ec00640 1 -- start start 2024-04-20T21:19:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.675+0000 7efd6ec00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efd6806d070 0x7efd680d2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.675+0000 7efd6ec00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efd680d34f0 0x7efd680b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.675+0000 7efd6ec00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd680cfb40 con 0x7efd6815e750 2024-04-20T21:19:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.675+0000 7efd6ec00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7efd680d3950 con 0x7efd680d34f0 2024-04-20T21:19:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.675+0000 7efd6ec00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7efd680d0a20 con 0x7efd6806d070 2024-04-20T21:19:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.675+0000 7efd6d800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7efd6815e750 0x7efd680cf430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52790/0 (socket says 172.21.15.71:52790) 2024-04-20T21:19:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.675+0000 7efd6d800640 1 -- 172.21.15.71:0/1569378694 learned_addr learned my addr 172.21.15.71:0/1569378694 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.675+0000 7efd6e200640 1 --2- 172.21.15.71:0/1569378694 >> v2:172.21.15.71:3300/0 conn(0x7efd680d34f0 0x7efd680b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.676+0000 7efd6ce00640 1 --2- 172.21.15.71:0/1569378694 >> v2:172.21.15.137:3300/0 conn(0x7efd6806d070 0x7efd680d2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.676+0000 7efd6e200640 1 -- 172.21.15.71:0/1569378694 >> v2:172.21.15.137:3300/0 conn(0x7efd6806d070 msgr2=0x7efd680d2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.676+0000 7efd6e200640 1 --2- 172.21.15.71:0/1569378694 >> v2:172.21.15.137:3300/0 conn(0x7efd6806d070 0x7efd680d2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.676+0000 7efd6e200640 1 -- 172.21.15.71:0/1569378694 >> v1:172.21.15.71:6789/0 conn(0x7efd6815e750 legacy=0x7efd680cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.676+0000 7efd6e200640 1 -- 172.21.15.71:0/1569378694 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd680cfe10 con 0x7efd680d34f0 2024-04-20T21:19:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.677+0000 7efd6e200640 1 --2- 172.21.15.71:0/1569378694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd680d34f0 0x7efd680b77b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd680ba3b0 tx=0x7efd6002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1dd0866c56f026 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.677+0000 7efd67e00640 1 -- 172.21.15.71:0/1569378694 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60039070 con 0x7efd680d34f0 2024-04-20T21:19:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.677+0000 7efd67e00640 1 -- 172.21.15.71:0/1569378694 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6002cc80 con 0x7efd680d34f0 2024-04-20T21:19:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.677+0000 7efd67e00640 1 -- 172.21.15.71:0/1569378694 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60034660 con 0x7efd680d34f0 2024-04-20T21:19:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.678+0000 7efd6ec00640 1 -- 172.21.15.71:0/1569378694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd680d34f0 msgr2=0x7efd680b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.678+0000 7efd6ec00640 1 --2- 172.21.15.71:0/1569378694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd680d34f0 0x7efd680b77b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd680ba3b0 tx=0x7efd6002bed0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.678+0000 7efd6ec00640 1 -- 172.21.15.71:0/1569378694 shutdown_connections 2024-04-20T21:19:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.678+0000 7efd6ec00640 1 --2- 172.21.15.71:0/1569378694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd680d34f0 0x7efd680b77b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.678+0000 7efd6ec00640 1 --2- 172.21.15.71:0/1569378694 >> v2:172.21.15.137:3300/0 conn(0x7efd6806d070 0x7efd680d2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.678+0000 7efd6ec00640 1 -- 172.21.15.71:0/1569378694 >> 172.21.15.71:0/1569378694 conn(0x7efd680d0e50 msgr2=0x7efd680d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.678+0000 7efd6ec00640 1 -- 172.21.15.71:0/1569378694 shutdown_connections 2024-04-20T21:19:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.678+0000 7efd6ec00640 1 -- 172.21.15.71:0/1569378694 wait complete. 2024-04-20T21:19:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.680+0000 7efd6ec00640 1 Processor -- start 2024-04-20T21:19:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.680+0000 7efd6ec00640 1 -- start start 2024-04-20T21:19:47.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.681+0000 7efd6ec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd6806d070 0x7efd6814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:47.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.681+0000 7efd6ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd680d34f0 0x7efd681528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:47.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.681+0000 7efd6ec00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd6815e750 0x7efd6814d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.681+0000 7efd6ec00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efd680d06b0 con 0x7efd6815e750 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.681+0000 7efd6ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efd680d03d0 con 0x7efd680d34f0 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.681+0000 7efd6ec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efd680b7cf0 con 0x7efd6806d070 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.681+0000 7efd6e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd6815e750 0x7efd6814d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.681+0000 7efd6e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd6815e750 0x7efd6814d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50858/0 (socket says 172.21.15.71:50858) 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.681+0000 7efd6e200640 1 -- 172.21.15.71:0/127334293 learned_addr learned my addr 172.21.15.71:0/127334293 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.682+0000 7efd6ce00640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd680d34f0 0x7efd681528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.682+0000 7efd6d800640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd6806d070 0x7efd6814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.682+0000 7efd6e200640 1 -- 172.21.15.71:0/127334293 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd6806d070 msgr2=0x7efd6814eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.682+0000 7efd6e200640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd6806d070 0x7efd6814eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.682+0000 7efd6e200640 1 -- 172.21.15.71:0/127334293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd680d34f0 msgr2=0x7efd681528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.682+0000 7efd6e200640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd680d34f0 0x7efd681528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.682+0000 7efd6e200640 1 -- 172.21.15.71:0/127334293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6814da10 con 0x7efd6815e750 2024-04-20T21:19:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.682+0000 7efd6e200640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd6815e750 0x7efd6814d0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd6002c4e0 tx=0x7efd60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.682+0000 7efd65600640 1 -- 172.21.15.71:0/127334293 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60039050 con 0x7efd6815e750 2024-04-20T21:19:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.683+0000 7efd65600640 1 -- 172.21.15.71:0/127334293 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd60045070 con 0x7efd6815e750 2024-04-20T21:19:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.683+0000 7efd65600640 1 -- 172.21.15.71:0/127334293 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6003e830 con 0x7efd6815e750 2024-04-20T21:19:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.683+0000 7efd6ec00640 1 -- 172.21.15.71:0/127334293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd6814dcf0 con 0x7efd6815e750 2024-04-20T21:19:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.683+0000 7efd6ec00640 1 -- 172.21.15.71:0/127334293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd6814e2b0 con 0x7efd6815e750 2024-04-20T21:19:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.684+0000 7efd6ec00640 1 -- 172.21.15.71:0/127334293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd68075b30 con 0x7efd6815e750 2024-04-20T21:19:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.685+0000 7efd65600640 1 -- 172.21.15.71:0/127334293 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd6003e9d0 con 0x7efd6815e750 2024-04-20T21:19:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.686+0000 7efd65600640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7efd4c06c8f0 0x7efd4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.686+0000 7efd65600640 1 -- 172.21.15.71:0/127334293 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efd600aeca0 con 0x7efd6815e750 2024-04-20T21:19:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.686+0000 7efd6d800640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7efd4c06c8f0 0x7efd4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.686+0000 7efd6d800640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7efd4c06c8f0 0x7efd4c06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd5c000f60 tx=0x7efd5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.690+0000 7efd65600640 1 -- 172.21.15.71:0/127334293 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7efd6007ce10 con 0x7efd6815e750 2024-04-20T21:19:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.890+0000 7efd6ec00640 1 -- 172.21.15.71:0/127334293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efd680ca8a0 con 0x7efd6815e750 2024-04-20T21:19:47.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.891+0000 7efd65600640 1 -- 172.21.15.71:0/127334293 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7efd6007c710 con 0x7efd6815e750 2024-04-20T21:19:47.891 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:19:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 -- 172.21.15.71:0/127334293 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7efd4c06c8f0 msgr2=0x7efd4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7efd4c06c8f0 0x7efd4c06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd5c000f60 tx=0x7efd5c009040 comp rx=0 tx=0).stop 2024-04-20T21:19:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 -- 172.21.15.71:0/127334293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd6815e750 msgr2=0x7efd6814d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd6815e750 0x7efd6814d0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd6002c4e0 tx=0x7efd60004a40 comp rx=0 tx=0).stop 2024-04-20T21:19:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 -- 172.21.15.71:0/127334293 shutdown_connections 2024-04-20T21:19:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7efd4c06c8f0 0x7efd4c06edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd6815e750 0x7efd6814d0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd680d34f0 0x7efd681528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 --2- 172.21.15.71:0/127334293 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd6806d070 0x7efd6814eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:47.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 -- 172.21.15.71:0/127334293 >> 172.21.15.71:0/127334293 conn(0x7efd680d0e50 msgr2=0x7efd680c9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:47.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 -- 172.21.15.71:0/127334293 shutdown_connections 2024-04-20T21:19:47.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:47.894+0000 7efd6ec00640 1 -- 172.21.15.71:0/127334293 wait complete. 2024-04-20T21:19:47.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:19:48.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.114+0000 7fba60a00640 1 Processor -- start 2024-04-20T21:19:48.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.114+0000 7fba60a00640 1 -- start start 2024-04-20T21:19:48.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.115+0000 7fba60a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba5c15d4f0 0x7fba5c0ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.115+0000 7fba60a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5c06b900 con 0x7fba5c0aee60 2024-04-20T21:19:48.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.115+0000 7fba60a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5c06bbe0 con 0x7fba5c06e060 2024-04-20T21:19:48.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.115+0000 7fba60a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fba5c06c510 con 0x7fba5c15d4f0 2024-04-20T21:19:48.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.116+0000 7fba5a800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fba5c0aee60 0x7fba5c0af240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52796/0 (socket says 172.21.15.71:52796) 2024-04-20T21:19:48.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.116+0000 7fba5a800640 1 -- 172.21.15.71:0/538483843 learned_addr learned my addr 172.21.15.71:0/538483843 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.116+0000 7fba59e00640 1 --2- 172.21.15.71:0/538483843 >> v2:172.21.15.137:3300/0 conn(0x7fba5c15d4f0 0x7fba5c0ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.116+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158550915 0 0) 0x7fba5c06b900 con 0x7fba5c0aee60 2024-04-20T21:19:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.116+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba40003520 con 0x7fba5c0aee60 2024-04-20T21:19:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.116+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1138160963 0 0) 0x7fba40003520 con 0x7fba5c0aee60 2024-04-20T21:19:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 >> v2:172.21.15.137:3300/0 conn(0x7fba5c15d4f0 msgr2=0x7fba5c0ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 --2- 172.21.15.71:0/538483843 >> v2:172.21.15.137:3300/0 conn(0x7fba5c15d4f0 0x7fba5c0ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 >> v1:172.21.15.137:6789/0 conn(0x7fba5c06e060 legacy=0x7fba5c06e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c06bec0 con 0x7fba5c0aee60 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fba4c001670 con 0x7fba5c0aee60 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 >> v1:172.21.15.71:6789/0 conn(0x7fba5c0aee60 legacy=0x7fba5c0af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 --2- 172.21.15.71:0/538483843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba40003a00 0x7fba40003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 --2- 172.21.15.71:0/538483843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba40004800 0x7fba40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 --2- 172.21.15.71:0/538483843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba400051c0 0x7fba4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c06c510 con 0x7fba40003a00 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba4000c0c0 con 0x7fba400051c0 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fba4000c2c0 con 0x7fba40004800 2024-04-20T21:19:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba5a800640 1 --2- 172.21.15.71:0/538483843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba40003a00 0x7fba40003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba5a800640 1 -- 172.21.15.71:0/538483843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba40004800 msgr2=0x7fba40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba5a800640 1 --2- 172.21.15.71:0/538483843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba40004800 0x7fba40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba5a800640 1 -- 172.21.15.71:0/538483843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba400051c0 msgr2=0x7fba4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.117+0000 7fba5a800640 1 --2- 172.21.15.71:0/538483843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba400051c0 0x7fba4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.118+0000 7fba5a800640 1 -- 172.21.15.71:0/538483843 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba40003520 con 0x7fba40003a00 2024-04-20T21:19:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.118+0000 7fba5b200640 1 -- 172.21.15.71:0/538483843 reap_dead start 2024-04-20T21:19:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.119+0000 7fba5a800640 1 --2- 172.21.15.71:0/538483843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba40003a00 0x7fba40003e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00c0e0 tx=0x7fba40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5864cec324858b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.119+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c007c20 con 0x7fba40003a00 2024-04-20T21:19:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.119+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c030070 con 0x7fba40003a00 2024-04-20T21:19:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.119+0000 7fba59400640 1 -- 172.21.15.71:0/538483843 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c005d70 con 0x7fba40003a00 2024-04-20T21:19:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.119+0000 7fba60a00640 1 -- 172.21.15.71:0/538483843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba40003a00 msgr2=0x7fba40003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.119+0000 7fba60a00640 1 --2- 172.21.15.71:0/538483843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba40003a00 0x7fba40003e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00c0e0 tx=0x7fba40005830 comp rx=0 tx=0).stop 2024-04-20T21:19:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.120+0000 7fba60a00640 1 -- 172.21.15.71:0/538483843 shutdown_connections 2024-04-20T21:19:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.120+0000 7fba60a00640 1 --2- 172.21.15.71:0/538483843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba40003a00 0x7fba40003e20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.120+0000 7fba60a00640 1 -- 172.21.15.71:0/538483843 >> 172.21.15.71:0/538483843 conn(0x7fba5c0b5270 msgr2=0x7fba5c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.120+0000 7fba60a00640 1 -- 172.21.15.71:0/538483843 shutdown_connections 2024-04-20T21:19:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.120+0000 7fba60a00640 1 -- 172.21.15.71:0/538483843 wait complete. 2024-04-20T21:19:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.121+0000 7fba60a00640 1 Processor -- start 2024-04-20T21:19:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.122+0000 7fba60a00640 1 -- start start 2024-04-20T21:19:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.122+0000 7fba60a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba40003a00 0x7fba5c15fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.122+0000 7fba60a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c1f8bd0 0x7fba5c14ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.122+0000 7fba60a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5c14ede0 0x7fba5c15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.122+0000 7fba60a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c0af240 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.122+0000 7fba60a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c06c9a0 con 0x7fba5c14ede0 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.122+0000 7fba60a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fba5c0af3c0 con 0x7fba40003a00 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.123+0000 7fba59e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c1f8bd0 0x7fba5c14ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.123+0000 7fba59e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c1f8bd0 0x7fba5c14ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50866/0 (socket says 172.21.15.71:50866) 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.123+0000 7fba59e00640 1 -- 172.21.15.71:0/4099134133 learned_addr learned my addr 172.21.15.71:0/4099134133 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.123+0000 7fba59e00640 1 -- 172.21.15.71:0/4099134133 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba40003a00 msgr2=0x7fba5c15fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.123+0000 7fba59e00640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba40003a00 0x7fba5c15fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.123+0000 7fba59e00640 1 -- 172.21.15.71:0/4099134133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5c14ede0 msgr2=0x7fba5c15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.123+0000 7fba59e00640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5c14ede0 0x7fba5c15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.123+0000 7fba59e00640 1 -- 172.21.15.71:0/4099134133 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c160330 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.123+0000 7fba59e00640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c1f8bd0 0x7fba5c14ac10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba4800e7a0 tx=0x7fba4800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.124+0000 7fba52a00640 1 -- 172.21.15.71:0/4099134133 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48017070 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.124+0000 7fba52a00640 1 -- 172.21.15.71:0/4099134133 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4800c6d0 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.124+0000 7fba60a00640 1 -- 172.21.15.71:0/4099134133 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c1f80f0 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.124+0000 7fba52a00640 1 -- 172.21.15.71:0/4099134133 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4800caa0 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.124+0000 7fba60a00640 1 -- 172.21.15.71:0/4099134133 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c1f86b0 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.125+0000 7fba60a00640 1 -- 172.21.15.71:0/4099134133 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5c075b30 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.126+0000 7fba52a00640 1 -- 172.21.15.71:0/4099134133 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba4801a070 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.127+0000 7fba52a00640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fba3c06c8f0 0x7fba3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.127+0000 7fba52a00640 1 -- 172.21.15.71:0/4099134133 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fba4808bf70 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.127+0000 7fba5a800640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fba3c06c8f0 0x7fba3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.128+0000 7fba5a800640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fba3c06c8f0 0x7fba3c06edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fba4c034000 tx=0x7fba4c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:48.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.131+0000 7fba52a00640 1 -- 172.21.15.71:0/4099134133 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fba4805a050 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.317+0000 7fba60a00640 1 -- 172.21.15.71:0/4099134133 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fba5c06de40 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.318+0000 7fba52a00640 1 -- 172.21.15.71:0/4099134133 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fba48059950 con 0x7fba5c1f8bd0 2024-04-20T21:19:48.318 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 -- 172.21.15.71:0/4099134133 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fba3c06c8f0 msgr2=0x7fba3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fba3c06c8f0 0x7fba3c06edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fba4c034000 tx=0x7fba4c02e000 comp rx=0 tx=0).stop 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 -- 172.21.15.71:0/4099134133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c1f8bd0 msgr2=0x7fba5c14ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c1f8bd0 0x7fba5c14ac10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba4800e7a0 tx=0x7fba4800eba0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 -- 172.21.15.71:0/4099134133 shutdown_connections 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fba3c06c8f0 0x7fba3c06edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5c14ede0 0x7fba5c15b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c1f8bd0 0x7fba5c14ac10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 --2- 172.21.15.71:0/4099134133 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba40003a00 0x7fba5c15fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 -- 172.21.15.71:0/4099134133 >> 172.21.15.71:0/4099134133 conn(0x7fba5c0b5270 msgr2=0x7fba5c153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 -- 172.21.15.71:0/4099134133 shutdown_connections 2024-04-20T21:19:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.321+0000 7fba60a00640 1 -- 172.21.15.71:0/4099134133 wait complete. 2024-04-20T21:19:48.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T21:19:48.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.526+0000 7f02bf200640 1 Processor -- start 2024-04-20T21:19:48.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.526+0000 7f02bf200640 1 -- start start 2024-04-20T21:19:48.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.528+0000 7f02bf200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f02c0159e10 0x7f02c0071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.528+0000 7f02bf200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c0160e50 con 0x7f02c006da90 2024-04-20T21:19:48.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.528+0000 7f02bf200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c015cc90 con 0x7f02c015a1f0 2024-04-20T21:19:48.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.528+0000 7f02bf200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f02c0072900 con 0x7f02c0159e10 2024-04-20T21:19:48.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.528+0000 7f02be800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f02c006da90 0x7f02c0160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52812/0 (socket says 172.21.15.71:52812) 2024-04-20T21:19:48.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02be800640 1 -- 172.21.15.71:0/2149707418 learned_addr learned my addr 172.21.15.71:0/2149707418 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:48.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bde00640 1 --2- 172.21.15.71:0/2149707418 >> v2:172.21.15.137:3300/0 conn(0x7f02c0159e10 0x7f02c0071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029970784 0 0) 0x7f02c0160e50 con 0x7f02c006da90 2024-04-20T21:19:48.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02a4003520 con 0x7f02c006da90 2024-04-20T21:19:48.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1550299291 0 0) 0x7f02a4003520 con 0x7f02c006da90 2024-04-20T21:19:48.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 >> v2:172.21.15.137:3300/0 conn(0x7f02c0159e10 msgr2=0x7f02c0071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:48.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 --2- 172.21.15.71:0/2149707418 >> v2:172.21.15.137:3300/0 conn(0x7f02c0159e10 0x7f02c0071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 >> v1:172.21.15.137:6789/0 conn(0x7f02c015a1f0 legacy=0x7f02c0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c015cf70 con 0x7f02c006da90 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f02b8001670 con 0x7f02c006da90 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 >> v1:172.21.15.71:6789/0 conn(0x7f02c006da90 legacy=0x7f02c0160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a40039b0 0x7f02a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02a4004800 0x7f02a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02a40051c0 0x7f02a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f02a400c030 con 0x7f02a40039b0 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02a400c1e0 con 0x7f02a4004800 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.529+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f02a400c3e0 con 0x7f02a40051c0 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.530+0000 7f02bde00640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a40039b0 0x7f02a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.530+0000 7f02bde00640 1 -- 172.21.15.71:0/2149707418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02a40051c0 msgr2=0x7f02a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.530+0000 7f02be800640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02a40051c0 0x7f02a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.530+0000 7f02b5400640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02a4004800 0x7f02a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.530+0000 7f02bde00640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02a40051c0 0x7f02a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.530+0000 7f02bde00640 1 -- 172.21.15.71:0/2149707418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02a4004800 msgr2=0x7f02a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:48.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.530+0000 7f02bde00640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02a4004800 0x7f02a4004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.530+0000 7f02bde00640 1 -- 172.21.15.71:0/2149707418 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a4003520 con 0x7f02a40039b0 2024-04-20T21:19:48.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.530+0000 7f02be800640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02a40051c0 0x7f02a400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:48.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.530+0000 7f02be800640 1 -- 172.21.15.71:0/2149707418 reap_dead start 2024-04-20T21:19:48.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.531+0000 7f02bde00640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a40039b0 0x7f02a4003dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009fc0 tx=0x7f02a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bf30cab73f843 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:48.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.531+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0039070 con 0x7f02a40039b0 2024-04-20T21:19:48.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.531+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b002cbf0 con 0x7f02a40039b0 2024-04-20T21:19:48.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.531+0000 7f02bd400640 1 -- 172.21.15.71:0/2149707418 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0009c10 con 0x7f02a40039b0 2024-04-20T21:19:48.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.532+0000 7f02bf200640 1 -- 172.21.15.71:0/2149707418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a40039b0 msgr2=0x7f02a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.532+0000 7f02bf200640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a40039b0 0x7f02a4003dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009fc0 tx=0x7f02a4005830 comp rx=0 tx=0).stop 2024-04-20T21:19:48.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.532+0000 7f02bf200640 1 -- 172.21.15.71:0/2149707418 shutdown_connections 2024-04-20T21:19:48.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.532+0000 7f02bf200640 1 --2- 172.21.15.71:0/2149707418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a40039b0 0x7f02a4003dd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.532+0000 7f02bf200640 1 -- 172.21.15.71:0/2149707418 >> 172.21.15.71:0/2149707418 conn(0x7f02c00d0040 msgr2=0x7f02c00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:48.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.532+0000 7f02bf200640 1 -- 172.21.15.71:0/2149707418 shutdown_connections 2024-04-20T21:19:48.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.532+0000 7f02bf200640 1 -- 172.21.15.71:0/2149707418 wait complete. 2024-04-20T21:19:48.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.534+0000 7f02bf200640 1 Processor -- start 2024-04-20T21:19:48.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.534+0000 7f02bf200640 1 -- start start 2024-04-20T21:19:48.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02bf200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02a40039b0 0x7f02c01f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02bf200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02c01f3710 0x7f02c01f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02bf200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02c00c9ce0 0x7f02c00ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02bf200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f02c015d530 con 0x7f02c01f3710 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02bf200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02c015ca40 con 0x7f02c00c9ce0 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02bf200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f02c015d810 con 0x7f02a40039b0 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02b5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02c01f3710 0x7f02c01f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02b5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02c01f3710 0x7f02c01f5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50878/0 (socket says 172.21.15.71:50878) 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02b5400640 1 -- 172.21.15.71:0/572890279 learned_addr learned my addr 172.21.15.71:0/572890279 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02bde00640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02a40039b0 0x7f02c01f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02b5400640 1 -- 172.21.15.71:0/572890279 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02a40039b0 msgr2=0x7f02c01f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02be800640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02c00c9ce0 0x7f02c00ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02b5400640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02a40039b0 0x7f02c01f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.535+0000 7f02b5400640 1 -- 172.21.15.71:0/572890279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02c00c9ce0 msgr2=0x7f02c00ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.536+0000 7f02b5400640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02c00c9ce0 0x7f02c00ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.536+0000 7f02b5400640 1 -- 172.21.15.71:0/572890279 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c0071d30 con 0x7f02c01f3710 2024-04-20T21:19:48.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.536+0000 7f02b5400640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02c01f3710 0x7f02c01f5030 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f02a800d570 tx=0x7f02a800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:48.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.536+0000 7f02b6a00640 1 -- 172.21.15.71:0/572890279 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a8003610 con 0x7f02c01f3710 2024-04-20T21:19:48.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.536+0000 7f02b6a00640 1 -- 172.21.15.71:0/572890279 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a8017070 con 0x7f02c01f3710 2024-04-20T21:19:48.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.536+0000 7f02bf200640 1 -- 172.21.15.71:0/572890279 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c00b3520 con 0x7f02c01f3710 2024-04-20T21:19:48.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.536+0000 7f02b6a00640 1 -- 172.21.15.71:0/572890279 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a80039b0 con 0x7f02c01f3710 2024-04-20T21:19:48.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.536+0000 7f02bf200640 1 -- 172.21.15.71:0/572890279 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c00b3ae0 con 0x7f02c01f3710 2024-04-20T21:19:48.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.537+0000 7f02bf200640 1 -- 172.21.15.71:0/572890279 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c0075b60 con 0x7f02c01f3710 2024-04-20T21:19:48.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.538+0000 7f02b6a00640 1 -- 172.21.15.71:0/572890279 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02a8003b50 con 0x7f02c01f3710 2024-04-20T21:19:48.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.539+0000 7f02b6a00640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f029c06c8f0 0x7f029c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:48.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.539+0000 7f02b6a00640 1 -- 172.21.15.71:0/572890279 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f02a808bd10 con 0x7f02c01f3710 2024-04-20T21:19:48.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.540+0000 7f02bde00640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f029c06c8f0 0x7f029c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:48.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.540+0000 7f02bde00640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f029c06c8f0 0x7f029c06edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f02b0036000 tx=0x7f02b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:48.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.544+0000 7f02b6a00640 1 -- 172.21.15.71:0/572890279 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f02a8091020 con 0x7f02c01f3710 2024-04-20T21:19:48.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.754+0000 7f02bf200640 1 -- 172.21.15.71:0/572890279 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f02c009dc30 con 0x7f02c01f3710 2024-04-20T21:19:48.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.755+0000 7f02b6a00640 1 -- 172.21.15.71:0/572890279 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f02a800f2f0 con 0x7f02c01f3710 2024-04-20T21:19:48.755 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2024-04-20T21:19:48.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 -- 172.21.15.71:0/572890279 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f029c06c8f0 msgr2=0x7f029c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f029c06c8f0 0x7f029c06edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f02b0036000 tx=0x7f02b002e000 comp rx=0 tx=0).stop 2024-04-20T21:19:48.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 -- 172.21.15.71:0/572890279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02c01f3710 msgr2=0x7f02c01f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:48.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02c01f3710 0x7f02c01f5030 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f02a800d570 tx=0x7f02a800da30 comp rx=0 tx=0).stop 2024-04-20T21:19:48.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 -- 172.21.15.71:0/572890279 shutdown_connections 2024-04-20T21:19:48.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f029c06c8f0 0x7f029c06edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02c00c9ce0 0x7f02c00ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02c01f3710 0x7f02c01f5030 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 --2- 172.21.15.71:0/572890279 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02a40039b0 0x7f02c01f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:48.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 -- 172.21.15.71:0/572890279 >> 172.21.15.71:0/572890279 conn(0x7f02c00d0040 msgr2=0x7f02c0157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:48.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 -- 172.21.15.71:0/572890279 shutdown_connections 2024-04-20T21:19:48.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:48.758+0000 7f02bf200640 1 -- 172.21.15.71:0/572890279 wait complete. 2024-04-20T21:19:48.777 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2024-04-20T21:19:48.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:48.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-20T21:19:48.852 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi071.stderr:ceph-fuse[29710]: fuse finished with error 0 and tester_r 0 2024-04-20T21:19:48.858 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T21:19:48.957 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2024-04-20T21:19:48.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:19:48.958 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-20T21:19:49.016 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:49.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.214+0000 7fd6ea400640 1 Processor -- start 2024-04-20T21:19:49.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.214+0000 7fd6ea400640 1 -- start start 2024-04-20T21:19:49.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.216+0000 7fd6ea400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6e415a1f0 0x7fd6e4072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.216+0000 7fd6ea400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e415cc90 con 0x7fd6e4159e10 2024-04-20T21:19:49.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.216+0000 7fd6ea400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e415cf70 con 0x7fd6e4072190 2024-04-20T21:19:49.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.216+0000 7fd6ea400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd6e4072900 con 0x7fd6e415a1f0 2024-04-20T21:19:49.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.216+0000 7fd6e3e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6e415a1f0 0x7fd6e4072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.216+0000 7fd6e9000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd6e4159e10 0x7fd6e4071a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52822/0 (socket says 172.21.15.71:52822) 2024-04-20T21:19:49.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.216+0000 7fd6e9000640 1 -- 172.21.15.71:0/2206011972 learned_addr learned my addr 172.21.15.71:0/2206011972 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:49.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.217+0000 7fd6e3e00640 1 -- 172.21.15.71:0/2206011972 >> v1:172.21.15.137:6789/0 conn(0x7fd6e4072190 legacy=0x7fd6e4073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:49.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.217+0000 7fd6e3e00640 1 -- 172.21.15.71:0/2206011972 >> v1:172.21.15.71:6789/0 conn(0x7fd6e4159e10 legacy=0x7fd6e4071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.217+0000 7fd6e3e00640 1 -- 172.21.15.71:0/2206011972 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e415d250 con 0x7fd6e415a1f0 2024-04-20T21:19:49.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.217+0000 7fd6e3400640 1 -- 172.21.15.71:0/2206011972 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422475329 0 0) 0x7fd6e415cc90 con 0x7fd6e4159e10 2024-04-20T21:19:49.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.218+0000 7fd6e3e00640 1 --2- 172.21.15.71:0/2206011972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e415a1f0 0x7fd6e4072ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00097a0 tx=0x7fd6d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73791196553cd97 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:49.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.218+0000 7fd6e3400640 1 -- 172.21.15.71:0/2206011972 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0035020 con 0x7fd6e415a1f0 2024-04-20T21:19:49.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.218+0000 7fd6e3400640 1 -- 172.21.15.71:0/2206011972 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d0031830 con 0x7fd6e415a1f0 2024-04-20T21:19:49.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.218+0000 7fd6e3400640 1 -- 172.21.15.71:0/2206011972 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0031c00 con 0x7fd6e415a1f0 2024-04-20T21:19:49.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.219+0000 7fd6ea400640 1 -- 172.21.15.71:0/2206011972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e415a1f0 msgr2=0x7fd6e4072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.219+0000 7fd6ea400640 1 --2- 172.21.15.71:0/2206011972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e415a1f0 0x7fd6e4072ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00097a0 tx=0x7fd6d002b8d0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.219+0000 7fd6ea400640 1 -- 172.21.15.71:0/2206011972 shutdown_connections 2024-04-20T21:19:49.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.219+0000 7fd6ea400640 1 --2- 172.21.15.71:0/2206011972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e415a1f0 0x7fd6e4072ee0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.219+0000 7fd6ea400640 1 -- 172.21.15.71:0/2206011972 >> 172.21.15.71:0/2206011972 conn(0x7fd6e40d0040 msgr2=0x7fd6e40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:49.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.219+0000 7fd6ea400640 1 -- 172.21.15.71:0/2206011972 shutdown_connections 2024-04-20T21:19:49.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.219+0000 7fd6ea400640 1 -- 172.21.15.71:0/2206011972 wait complete. 2024-04-20T21:19:49.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.221+0000 7fd6ea400640 1 Processor -- start 2024-04-20T21:19:49.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.221+0000 7fd6ea400640 1 -- start start 2024-04-20T21:19:49.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6ea400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6e4072190 0x7fd6e4151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6ea400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e4159e10 0x7fd6e415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6ea400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6e415a1f0 0x7fd6e4153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6ea400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e415d810 con 0x7fd6e4159e10 2024-04-20T21:19:49.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6ea400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e415ca40 con 0x7fd6e4072190 2024-04-20T21:19:49.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6ea400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e4073b30 con 0x7fd6e415a1f0 2024-04-20T21:19:49.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e4159e10 0x7fd6e415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e4159e10 0x7fd6e415afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50904/0 (socket says 172.21.15.71:50904) 2024-04-20T21:19:49.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e3e00640 1 -- 172.21.15.71:0/2916175372 learned_addr learned my addr 172.21.15.71:0/2916175372 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:49.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e9000640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6e4072190 0x7fd6e4151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e3e00640 1 -- 172.21.15.71:0/2916175372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6e415a1f0 msgr2=0x7fd6e4153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e9a00640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6e415a1f0 0x7fd6e4153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e3e00640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6e415a1f0 0x7fd6e4153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e3e00640 1 -- 172.21.15.71:0/2916175372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6e4072190 msgr2=0x7fd6e4151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e3e00640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6e4072190 0x7fd6e4151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e3e00640 1 -- 172.21.15.71:0/2916175372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e415b930 con 0x7fd6e4159e10 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e9000640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6e4072190 0x7fd6e4151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.222+0000 7fd6e9a00640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6e415a1f0 0x7fd6e4153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.223+0000 7fd6e3e00640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e4159e10 0x7fd6e415afe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0034040 tx=0x7fd6d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.223+0000 7fd6e0c00640 1 -- 172.21.15.71:0/2916175372 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0004230 con 0x7fd6e4159e10 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.223+0000 7fd6e0c00640 1 -- 172.21.15.71:0/2916175372 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d00043f0 con 0x7fd6e4159e10 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.223+0000 7fd6e0c00640 1 -- 172.21.15.71:0/2916175372 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0003850 con 0x7fd6e4159e10 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.223+0000 7fd6ea400640 1 -- 172.21.15.71:0/2916175372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e415bc10 con 0x7fd6e4159e10 2024-04-20T21:19:49.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.223+0000 7fd6ea400640 1 -- 172.21.15.71:0/2916175372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e4151cd0 con 0x7fd6e4159e10 2024-04-20T21:19:49.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.225+0000 7fd6ea400640 1 -- 172.21.15.71:0/2916175372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e4075b60 con 0x7fd6e4159e10 2024-04-20T21:19:49.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.225+0000 7fd6e0c00640 1 -- 172.21.15.71:0/2916175372 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6d0038020 con 0x7fd6e4159e10 2024-04-20T21:19:49.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.226+0000 7fd6e0c00640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6c406c8f0 0x7fd6c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.226+0000 7fd6e0c00640 1 -- 172.21.15.71:0/2916175372 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd6d00ada40 con 0x7fd6e4159e10 2024-04-20T21:19:49.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.227+0000 7fd6e9000640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6c406c8f0 0x7fd6c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.227+0000 7fd6e9000640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6c406c8f0 0x7fd6c406edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8000f60 tx=0x7fd6d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:49.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.231+0000 7fd6e0c00640 1 -- 172.21.15.71:0/2916175372 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd6d0040070 con 0x7fd6e4159e10 2024-04-20T21:19:49.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.439+0000 7fd6ea400640 1 -- 172.21.15.71:0/2916175372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6e415dda0 con 0x7fd6e4159e10 2024-04-20T21:19:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.441+0000 7fd6e0c00640 1 -- 172.21.15.71:0/2916175372 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fd6d007bb20 con 0x7fd6e4159e10 2024-04-20T21:19:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:49.442 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 -- 172.21.15.71:0/2916175372 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6c406c8f0 msgr2=0x7fd6c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6c406c8f0 0x7fd6c406edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8000f60 tx=0x7fd6d8009040 comp rx=0 tx=0).stop 2024-04-20T21:19:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 -- 172.21.15.71:0/2916175372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e4159e10 msgr2=0x7fd6e415afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e4159e10 0x7fd6e415afe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0034040 tx=0x7fd6d00046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 -- 172.21.15.71:0/2916175372 shutdown_connections 2024-04-20T21:19:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd6c406c8f0 0x7fd6c406edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6e415a1f0 0x7fd6e4153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e4159e10 0x7fd6e415afe0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 --2- 172.21.15.71:0/2916175372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6e4072190 0x7fd6e4151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 -- 172.21.15.71:0/2916175372 >> 172.21.15.71:0/2916175372 conn(0x7fd6e40d0040 msgr2=0x7fd6e4071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 -- 172.21.15.71:0/2916175372 shutdown_connections 2024-04-20T21:19:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.444+0000 7fd6ea400640 1 -- 172.21.15.71:0/2916175372 wait complete. 2024-04-20T21:19:49.463 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:49.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.658+0000 7f1d41000640 1 Processor -- start 2024-04-20T21:19:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.658+0000 7f1d41000640 1 -- start start 2024-04-20T21:19:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.659+0000 7f1d41000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1d3c06dcb0 0x7f1d3c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.659+0000 7f1d41000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3c0ade40 con 0x7f1d3c072090 2024-04-20T21:19:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.659+0000 7f1d41000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3c0ae0e0 con 0x7f1d3c15b3b0 2024-04-20T21:19:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.659+0000 7f1d41000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1d3c06f1b0 con 0x7f1d3c06dcb0 2024-04-20T21:19:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.660+0000 7f1d3a800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1d3c072090 0x7f1d3c0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52832/0 (socket says 172.21.15.71:52832) 2024-04-20T21:19:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.660+0000 7f1d3a800640 1 -- 172.21.15.71:0/1881274885 learned_addr learned my addr 172.21.15.71:0/1881274885 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:49.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.660+0000 7f1d33e00640 1 --2- 172.21.15.71:0/1881274885 >> v2:172.21.15.137:3300/0 conn(0x7f1d3c06dcb0 0x7f1d3c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.660+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247114600 0 0) 0x7f1d3c0ade40 con 0x7f1d3c072090 2024-04-20T21:19:49.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.660+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d1c003520 con 0x7f1d3c072090 2024-04-20T21:19:49.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.660+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1525407474 0 0) 0x7f1d1c003520 con 0x7f1d3c072090 2024-04-20T21:19:49.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.660+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 >> v2:172.21.15.137:3300/0 conn(0x7f1d3c06dcb0 msgr2=0x7f1d3c071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:49.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.660+0000 7f1d39400640 1 --2- 172.21.15.71:0/1881274885 >> v2:172.21.15.137:3300/0 conn(0x7f1d3c06dcb0 0x7f1d3c071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.660+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 >> v1:172.21.15.137:6789/0 conn(0x7f1d3c15b3b0 legacy=0x7f1d3c06eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c15b790 con 0x7f1d3c072090 2024-04-20T21:19:49.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f1d340019f0 con 0x7f1d3c072090 2024-04-20T21:19:49.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 >> v1:172.21.15.71:6789/0 conn(0x7f1d3c072090 legacy=0x7f1d3c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d39400640 1 --2- 172.21.15.71:0/1881274885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d1c003a00 0x7f1d1c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d39400640 1 --2- 172.21.15.71:0/1881274885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d1c004800 0x7f1d1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d39400640 1 --2- 172.21.15.71:0/1881274885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d1c0051c0 0x7f1d1c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c06f1b0 con 0x7f1d1c0051c0 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c00e2d0 con 0x7f1d1c003a00 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1d1c00e4d0 con 0x7f1d1c004800 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d3a800640 1 --2- 172.21.15.71:0/1881274885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d1c0051c0 0x7f1d1c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d33e00640 1 --2- 172.21.15.71:0/1881274885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d1c004800 0x7f1d1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d3a800640 1 -- 172.21.15.71:0/1881274885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d1c004800 msgr2=0x7f1d1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d3a800640 1 --2- 172.21.15.71:0/1881274885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d1c004800 0x7f1d1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d3a800640 1 -- 172.21.15.71:0/1881274885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d1c003a00 msgr2=0x7f1d1c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d3a800640 1 --2- 172.21.15.71:0/1881274885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d1c003a00 0x7f1d1c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d3a800640 1 -- 172.21.15.71:0/1881274885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c003520 con 0x7f1d1c0051c0 2024-04-20T21:19:49.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.661+0000 7f1d33e00640 1 --2- 172.21.15.71:0/1881274885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d1c004800 0x7f1d1c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:49.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.662+0000 7f1d3a800640 1 -- 172.21.15.71:0/1881274885 reap_dead start 2024-04-20T21:19:49.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.662+0000 7f1d3a800640 1 --2- 172.21.15.71:0/1881274885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d1c0051c0 0x7f1d1c00dbd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400a7b0 tx=0x7f1d1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febede654efe1148 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:49.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.663+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3400a3d0 con 0x7f1d1c0051c0 2024-04-20T21:19:49.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.663+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d34034670 con 0x7f1d1c0051c0 2024-04-20T21:19:49.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.663+0000 7f1d39400640 1 -- 172.21.15.71:0/1881274885 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34034a60 con 0x7f1d1c0051c0 2024-04-20T21:19:49.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.663+0000 7f1d41000640 1 -- 172.21.15.71:0/1881274885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d1c0051c0 msgr2=0x7f1d1c00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.663+0000 7f1d41000640 1 --2- 172.21.15.71:0/1881274885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d1c0051c0 0x7f1d1c00dbd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400a7b0 tx=0x7f1d1c005830 comp rx=0 tx=0).stop 2024-04-20T21:19:49.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.663+0000 7f1d41000640 1 -- 172.21.15.71:0/1881274885 shutdown_connections 2024-04-20T21:19:49.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.663+0000 7f1d41000640 1 --2- 172.21.15.71:0/1881274885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d1c0051c0 0x7f1d1c00dbd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.663+0000 7f1d41000640 1 -- 172.21.15.71:0/1881274885 >> 172.21.15.71:0/1881274885 conn(0x7f1d3c0b3350 msgr2=0x7f1d3c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:49.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.663+0000 7f1d41000640 1 -- 172.21.15.71:0/1881274885 shutdown_connections 2024-04-20T21:19:49.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.664+0000 7f1d41000640 1 -- 172.21.15.71:0/1881274885 wait complete. 2024-04-20T21:19:49.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.665+0000 7f1d41000640 1 Processor -- start 2024-04-20T21:19:49.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.665+0000 7f1d41000640 1 -- start start 2024-04-20T21:19:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.666+0000 7f1d41000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d1c0051c0 0x7f1d3c143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.666+0000 7f1d41000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d3c14e3f0 0x7f1d3c0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.666+0000 7f1d41000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d3c0b1200 0x7f1d3c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.666+0000 7f1d41000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c0ae940 con 0x7f1d3c0b1200 2024-04-20T21:19:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.666+0000 7f1d41000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c0ae3e0 con 0x7f1d3c14e3f0 2024-04-20T21:19:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.666+0000 7f1d41000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3c0aec20 con 0x7f1d1c0051c0 2024-04-20T21:19:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.666+0000 7f1d3a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d3c0b1200 0x7f1d3c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.666+0000 7f1d3a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d3c0b1200 0x7f1d3c0b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50912/0 (socket says 172.21.15.71:50912) 2024-04-20T21:19:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.666+0000 7f1d3a800640 1 -- 172.21.15.71:0/2756873472 learned_addr learned my addr 172.21.15.71:0/2756873472 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.667+0000 7f1d39e00640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d1c0051c0 0x7f1d3c143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.667+0000 7f1d33e00640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d3c14e3f0 0x7f1d3c0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.667+0000 7f1d3a800640 1 -- 172.21.15.71:0/2756873472 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d1c0051c0 msgr2=0x7f1d3c143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.667+0000 7f1d3a800640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d1c0051c0 0x7f1d3c143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.667+0000 7f1d3a800640 1 -- 172.21.15.71:0/2756873472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d3c14e3f0 msgr2=0x7f1d3c0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.667+0000 7f1d3a800640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d3c14e3f0 0x7f1d3c0af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.667+0000 7f1d3a800640 1 -- 172.21.15.71:0/2756873472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c0b0160 con 0x7f1d3c0b1200 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.667+0000 7f1d39e00640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d1c0051c0 0x7f1d3c143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.667+0000 7f1d3a800640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d3c0b1200 0x7f1d3c0b2170 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400a8d0 tx=0x7f1d34001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.667+0000 7f1d32000640 1 -- 172.21.15.71:0/2756873472 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34039040 con 0x7f1d3c0b1200 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.667+0000 7f1d32000640 1 -- 172.21.15.71:0/2756873472 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d34043070 con 0x7f1d3c0b1200 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.668+0000 7f1d32000640 1 -- 172.21.15.71:0/2756873472 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34004d60 con 0x7f1d3c0b1200 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.668+0000 7f1d41000640 1 -- 172.21.15.71:0/2756873472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3c0b0440 con 0x7f1d3c0b1200 2024-04-20T21:19:49.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.668+0000 7f1d41000640 1 -- 172.21.15.71:0/2756873472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3c0b0a00 con 0x7f1d3c0b1200 2024-04-20T21:19:49.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.669+0000 7f1d41000640 1 -- 172.21.15.71:0/2756873472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3c068980 con 0x7f1d3c0b1200 2024-04-20T21:19:49.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.670+0000 7f1d32000640 1 -- 172.21.15.71:0/2756873472 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d34034670 con 0x7f1d3c0b1200 2024-04-20T21:19:49.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.671+0000 7f1d32000640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1d1806c8f0 0x7f1d1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:49.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.671+0000 7f1d32000640 1 -- 172.21.15.71:0/2756873472 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1d340add00 con 0x7f1d3c0b1200 2024-04-20T21:19:49.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.671+0000 7f1d39e00640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1d1806c8f0 0x7f1d1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:49.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.672+0000 7f1d39e00640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1d1806c8f0 0x7f1d1806edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c000f60 tx=0x7f1d2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:49.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.675+0000 7f1d32000640 1 -- 172.21.15.71:0/2756873472 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1d3407bd50 con 0x7f1d3c0b1200 2024-04-20T21:19:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.881+0000 7f1d41000640 1 -- 172.21.15.71:0/2756873472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d3c151680 con 0x7f1d3c0b1200 2024-04-20T21:19:49.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.883+0000 7f1d32000640 1 -- 172.21.15.71:0/2756873472 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f1d3407b650 con 0x7f1d3c0b1200 2024-04-20T21:19:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:49.884 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:49.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.886+0000 7f1d41000640 1 -- 172.21.15.71:0/2756873472 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1d1806c8f0 msgr2=0x7f1d1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.886+0000 7f1d41000640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1d1806c8f0 0x7f1d1806edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c000f60 tx=0x7f1d2c009040 comp rx=0 tx=0).stop 2024-04-20T21:19:49.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.886+0000 7f1d41000640 1 -- 172.21.15.71:0/2756873472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d3c0b1200 msgr2=0x7f1d3c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:49.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.886+0000 7f1d41000640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d3c0b1200 0x7f1d3c0b2170 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400a8d0 tx=0x7f1d34001cf0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.886+0000 7f1d41000640 1 -- 172.21.15.71:0/2756873472 shutdown_connections 2024-04-20T21:19:49.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.886+0000 7f1d41000640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1d1806c8f0 0x7f1d1806edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.886+0000 7f1d41000640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d3c0b1200 0x7f1d3c0b2170 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.886+0000 7f1d41000640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d3c14e3f0 0x7f1d3c0af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.886+0000 7f1d41000640 1 --2- 172.21.15.71:0/2756873472 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d1c0051c0 0x7f1d3c143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:49.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.886+0000 7f1d41000640 1 -- 172.21.15.71:0/2756873472 >> 172.21.15.71:0/2756873472 conn(0x7f1d3c0b3350 msgr2=0x7f1d3c072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:49.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.886+0000 7f1d41000640 1 -- 172.21.15.71:0/2756873472 shutdown_connections 2024-04-20T21:19:49.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:49.887+0000 7f1d41000640 1 -- 172.21.15.71:0/2756873472 wait complete. 2024-04-20T21:19:49.904 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-20T21:19:50.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.100+0000 7f710d600640 1 Processor -- start 2024-04-20T21:19:50.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.101+0000 7f710d600640 1 -- start start 2024-04-20T21:19:50.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.102+0000 7f710d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f710815a930 0x7f710806cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.102+0000 7f710d600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f710806db90 0x7f71080d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.102+0000 7f710d600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f710806e510 0x7f710806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.102+0000 7f710d600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f710806d2c0 con 0x7f710806e510 2024-04-20T21:19:50.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.102+0000 7f710d600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f710806eea0 con 0x7f710806db90 2024-04-20T21:19:50.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.102+0000 7f710d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f710815be80 con 0x7f710815a930 2024-04-20T21:19:50.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.102+0000 7f710cc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f710806e510 0x7f710806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.103+0000 7f710cc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f710806e510 0x7f710806e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50924/0 (socket says 172.21.15.71:50924) 2024-04-20T21:19:50.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.103+0000 7f710cc00640 1 -- 172.21.15.71:0/3185985851 learned_addr learned my addr 172.21.15.71:0/3185985851 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:50.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.103+0000 7f70ff400640 1 --2- 172.21.15.71:0/3185985851 >> v2:172.21.15.137:3300/0 conn(0x7f710806db90 0x7f71080d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.103+0000 7f7107e00640 1 --2- 172.21.15.71:0/3185985851 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f710815a930 0x7f710806cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.104+0000 7f710cc00640 1 -- 172.21.15.71:0/3185985851 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f710815a930 msgr2=0x7f710806cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:50.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.104+0000 7f710cc00640 1 --2- 172.21.15.71:0/3185985851 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f710815a930 0x7f710806cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.104+0000 7f710cc00640 1 -- 172.21.15.71:0/3185985851 >> v2:172.21.15.137:3300/0 conn(0x7f710806db90 msgr2=0x7f71080d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:50.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.104+0000 7f710cc00640 1 --2- 172.21.15.71:0/3185985851 >> v2:172.21.15.137:3300/0 conn(0x7f710806db90 0x7f71080d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.104+0000 7f710cc00640 1 -- 172.21.15.71:0/3185985851 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710806bce0 con 0x7f710806e510 2024-04-20T21:19:50.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.105+0000 7f710cc00640 1 --2- 172.21.15.71:0/3185985851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710806e510 0x7f710806e960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f71080d1280 tx=0x7f710002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7365d8727affee server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:50.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.106+0000 7f7107400640 1 -- 172.21.15.71:0/3185985851 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71000317d0 con 0x7f710806e510 2024-04-20T21:19:50.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.106+0000 7f7107400640 1 -- 172.21.15.71:0/3185985851 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7100037070 con 0x7f710806e510 2024-04-20T21:19:50.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.106+0000 7f7107400640 1 -- 172.21.15.71:0/3185985851 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100031b90 con 0x7f710806e510 2024-04-20T21:19:50.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.106+0000 7f710d600640 1 -- 172.21.15.71:0/3185985851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710806e510 msgr2=0x7f710806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:50.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.106+0000 7f710d600640 1 --2- 172.21.15.71:0/3185985851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710806e510 0x7f710806e960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f71080d1280 tx=0x7f710002b870 comp rx=0 tx=0).stop 2024-04-20T21:19:50.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.106+0000 7f710d600640 1 -- 172.21.15.71:0/3185985851 shutdown_connections 2024-04-20T21:19:50.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.106+0000 7f710d600640 1 --2- 172.21.15.71:0/3185985851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710806e510 0x7f710806e960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.106+0000 7f710d600640 1 --2- 172.21.15.71:0/3185985851 >> v2:172.21.15.137:3300/0 conn(0x7f710806db90 0x7f71080d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.106+0000 7f710d600640 1 --2- 172.21.15.71:0/3185985851 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f710815a930 0x7f710806cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.106+0000 7f710d600640 1 -- 172.21.15.71:0/3185985851 >> 172.21.15.71:0/3185985851 conn(0x7f71080b5270 msgr2=0x7f71080b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:50.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.107+0000 7f710d600640 1 -- 172.21.15.71:0/3185985851 shutdown_connections 2024-04-20T21:19:50.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.107+0000 7f710d600640 1 -- 172.21.15.71:0/3185985851 wait complete. 2024-04-20T21:19:50.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.108+0000 7f710d600640 1 Processor -- start 2024-04-20T21:19:50.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.108+0000 7f710d600640 1 -- start start 2024-04-20T21:19:50.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.109+0000 7f710d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f710806db90 0x7f71080b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.109+0000 7f710d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f710806e510 0x7f71081547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.109+0000 7f710d600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710815a930 0x7f71080cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.109+0000 7f710d600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f710806c580 con 0x7f710815a930 2024-04-20T21:19:50.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.109+0000 7f710d600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f710806c2a0 con 0x7f710806e510 2024-04-20T21:19:50.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.109+0000 7f710d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f710815ad10 con 0x7f710806db90 2024-04-20T21:19:50.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f710cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710815a930 0x7f71080cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f710cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710815a930 0x7f71080cead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50926/0 (socket says 172.21.15.71:50926) 2024-04-20T21:19:50.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f710cc00640 1 -- 172.21.15.71:0/2548754200 learned_addr learned my addr 172.21.15.71:0/2548754200 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:50.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f70ff400640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f710806e510 0x7f71081547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f7107e00640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f710806db90 0x7f71080b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f710cc00640 1 -- 172.21.15.71:0/2548754200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f710806db90 msgr2=0x7f71080b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:50.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f710cc00640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f710806db90 0x7f71080b0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f710cc00640 1 -- 172.21.15.71:0/2548754200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f710806e510 msgr2=0x7f71081547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:50.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f710cc00640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f710806e510 0x7f71081547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f710cc00640 1 -- 172.21.15.71:0/2548754200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7108154d30 con 0x7f710815a930 2024-04-20T21:19:50.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f70ff400640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f710806e510 0x7f71081547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:50.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.110+0000 7f710cc00640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710815a930 0x7f71080cead0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f71000090b0 tx=0x7f71000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:50.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.111+0000 7f7104c00640 1 -- 172.21.15.71:0/2548754200 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100032660 con 0x7f710815a930 2024-04-20T21:19:50.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.111+0000 7f7104c00640 1 -- 172.21.15.71:0/2548754200 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7100032800 con 0x7f710815a930 2024-04-20T21:19:50.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.111+0000 7f7104c00640 1 -- 172.21.15.71:0/2548754200 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100032bf0 con 0x7f710815a930 2024-04-20T21:19:50.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.111+0000 7f710d600640 1 -- 172.21.15.71:0/2548754200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71080ccc30 con 0x7f710815a930 2024-04-20T21:19:50.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.111+0000 7f710d600640 1 -- 172.21.15.71:0/2548754200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71080b1030 con 0x7f710815a930 2024-04-20T21:19:50.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.112+0000 7f710d600640 1 -- 172.21.15.71:0/2548754200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71080cce00 con 0x7f710815a930 2024-04-20T21:19:50.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.113+0000 7f7104c00640 1 -- 172.21.15.71:0/2548754200 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71000453f0 con 0x7f710815a930 2024-04-20T21:19:50.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.115+0000 7f7104c00640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70e406c8f0 0x7f70e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.115+0000 7f7104c00640 1 -- 172.21.15.71:0/2548754200 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f71000adf30 con 0x7f710815a930 2024-04-20T21:19:50.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.116+0000 7f7107e00640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70e406c8f0 0x7f70e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.117+0000 7f7107e00640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70e406c8f0 0x7f70e406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009f30 tx=0x7f70f800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:50.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.120+0000 7f7104c00640 1 -- 172.21.15.71:0/2548754200 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7108154d30 con 0x7f710815a930 2024-04-20T21:19:50.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.363+0000 7f710d600640 1 -- 172.21.15.71:0/2548754200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7108075b30 con 0x7f710815a930 2024-04-20T21:19:50.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.704+0000 7f7104c00640 1 -- 172.21.15.71:0/2548754200 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f7100040070 con 0x7f710815a930 2024-04-20T21:19:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.708+0000 7f710d600640 1 -- 172.21.15.71:0/2548754200 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70e406c8f0 msgr2=0x7f70e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.708+0000 7f710d600640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70e406c8f0 0x7f70e406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009f30 tx=0x7f70f800b040 comp rx=0 tx=0).stop 2024-04-20T21:19:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.708+0000 7f710d600640 1 -- 172.21.15.71:0/2548754200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710815a930 msgr2=0x7f71080cead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.708+0000 7f710d600640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710815a930 0x7f71080cead0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f71000090b0 tx=0x7f71000046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.708+0000 7f710d600640 1 -- 172.21.15.71:0/2548754200 shutdown_connections 2024-04-20T21:19:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.708+0000 7f710d600640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70e406c8f0 0x7f70e406edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.708+0000 7f710d600640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710815a930 0x7f71080cead0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.708+0000 7f710d600640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f710806e510 0x7f71081547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.708+0000 7f710d600640 1 --2- 172.21.15.71:0/2548754200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f710806db90 0x7f71080b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.708+0000 7f710d600640 1 -- 172.21.15.71:0/2548754200 >> 172.21.15.71:0/2548754200 conn(0x7f71080b5270 msgr2=0x7f710815d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:50.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.709+0000 7f710d600640 1 -- 172.21.15.71:0/2548754200 shutdown_connections 2024-04-20T21:19:50.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.709+0000 7f710d600640 1 -- 172.21.15.71:0/2548754200 wait complete. 2024-04-20T21:19:50.731 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-20T21:19:50.732 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-20T21:19:50.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.938+0000 7f1613200640 1 Processor -- start 2024-04-20T21:19:50.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.938+0000 7f1613200640 1 -- start start 2024-04-20T21:19:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.940+0000 7f1613200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160c0aee60 0x7f160c0af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.940+0000 7f1613200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f160c06e060 0x7f160c06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.940+0000 7f1613200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f160c0af780 con 0x7f160c15d4f0 2024-04-20T21:19:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.940+0000 7f1613200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f160c06c510 con 0x7f160c06e060 2024-04-20T21:19:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.940+0000 7f1613200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f160c06b900 con 0x7f160c0aee60 2024-04-20T21:19:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.940+0000 7f1612800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f160c06e060 0x7f160c06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.940+0000 7f1612800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f160c06e060 0x7f160c06e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50942/0 (socket says 172.21.15.71:50942) 2024-04-20T21:19:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.940+0000 7f1612800640 1 -- 172.21.15.71:0/1520803352 learned_addr learned my addr 172.21.15.71:0/1520803352 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.940+0000 7f1611e00640 1 --2- 172.21.15.71:0/1520803352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160c0aee60 0x7f160c0af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.941+0000 7f1612800640 1 -- 172.21.15.71:0/1520803352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160c0aee60 msgr2=0x7f160c0af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:50.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.941+0000 7f1612800640 1 --2- 172.21.15.71:0/1520803352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160c0aee60 0x7f160c0af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.941+0000 7f1612800640 1 -- 172.21.15.71:0/1520803352 >> v1:172.21.15.137:6789/0 conn(0x7f160c15d4f0 legacy=0x7f160c0ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:50.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.941+0000 7f1612800640 1 -- 172.21.15.71:0/1520803352 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c06bbe0 con 0x7f160c06e060 2024-04-20T21:19:50.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.942+0000 7f1612800640 1 --2- 172.21.15.71:0/1520803352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f160c06e060 0x7f160c06e4c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1608009e50 tx=0x7f160802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc84ab01a1f4f51 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:50.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.942+0000 7f1610a00640 1 -- 172.21.15.71:0/1520803352 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160802cb00 con 0x7f160c06e060 2024-04-20T21:19:50.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.942+0000 7f1610a00640 1 -- 172.21.15.71:0/1520803352 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160802cca0 con 0x7f160c06e060 2024-04-20T21:19:50.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.942+0000 7f1610a00640 1 -- 172.21.15.71:0/1520803352 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608034610 con 0x7f160c06e060 2024-04-20T21:19:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.943+0000 7f1613200640 1 -- 172.21.15.71:0/1520803352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f160c06e060 msgr2=0x7f160c06e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.943+0000 7f1613200640 1 --2- 172.21.15.71:0/1520803352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f160c06e060 0x7f160c06e4c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1608009e50 tx=0x7f160802bf60 comp rx=0 tx=0).stop 2024-04-20T21:19:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.943+0000 7f1613200640 1 -- 172.21.15.71:0/1520803352 shutdown_connections 2024-04-20T21:19:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.943+0000 7f1613200640 1 --2- 172.21.15.71:0/1520803352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f160c06e060 0x7f160c06e4c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.943+0000 7f1613200640 1 --2- 172.21.15.71:0/1520803352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160c0aee60 0x7f160c0af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.943+0000 7f1613200640 1 -- 172.21.15.71:0/1520803352 >> 172.21.15.71:0/1520803352 conn(0x7f160c0b5270 msgr2=0x7f160c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.943+0000 7f1613200640 1 -- 172.21.15.71:0/1520803352 shutdown_connections 2024-04-20T21:19:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.943+0000 7f1613200640 1 -- 172.21.15.71:0/1520803352 wait complete. 2024-04-20T21:19:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.945+0000 7f1613200640 1 Processor -- start 2024-04-20T21:19:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.945+0000 7f1613200640 1 -- start start 2024-04-20T21:19:50.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.946+0000 7f1613200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f160c06e060 0x7f160c1f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.946+0000 7f1613200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160c0aee60 0x7f160c1f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.946+0000 7f1613200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160c15d4f0 0x7f160c1f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.946+0000 7f1613200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f160c06c9a0 con 0x7f160c06e060 2024-04-20T21:19:50.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.946+0000 7f1613200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f160c06c1a0 con 0x7f160c15d4f0 2024-04-20T21:19:50.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.946+0000 7f1613200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f160c06ea00 con 0x7f160c0aee60 2024-04-20T21:19:50.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.946+0000 7f1611e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f160c06e060 0x7f160c1f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.946+0000 7f1611e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f160c06e060 0x7f160c1f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50944/0 (socket says 172.21.15.71:50944) 2024-04-20T21:19:50.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.946+0000 7f1611e00640 1 -- 172.21.15.71:0/2683526919 learned_addr learned my addr 172.21.15.71:0/2683526919 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1611e00640 1 -- 172.21.15.71:0/2683526919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160c0aee60 msgr2=0x7f160c1f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1611400640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160c0aee60 0x7f160c1f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1612800640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160c15d4f0 0x7f160c1f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1611e00640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160c0aee60 0x7f160c1f5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1611e00640 1 -- 172.21.15.71:0/2683526919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160c15d4f0 msgr2=0x7f160c1f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1611e00640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160c15d4f0 0x7f160c1f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1611e00640 1 -- 172.21.15.71:0/2683526919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c0736c0 con 0x7f160c06e060 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1612800640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160c15d4f0 0x7f160c1f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1611e00640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f160c06e060 0x7f160c1f5c60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f160000d800 tx=0x7f160000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1606000640 1 -- 172.21.15.71:0/2683526919 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160000b6c0 con 0x7f160c06e060 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1606000640 1 -- 172.21.15.71:0/2683526919 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1600019070 con 0x7f160c06e060 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1606000640 1 -- 172.21.15.71:0/2683526919 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160000ba80 con 0x7f160c06e060 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.947+0000 7f1613200640 1 -- 172.21.15.71:0/2683526919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160c1f7df0 con 0x7f160c06e060 2024-04-20T21:19:50.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.948+0000 7f1613200640 1 -- 172.21.15.71:0/2683526919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c072350 con 0x7f160c06e060 2024-04-20T21:19:50.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.949+0000 7f1613200640 1 -- 172.21.15.71:0/2683526919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f160c075b30 con 0x7f160c06e060 2024-04-20T21:19:50.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.950+0000 7f1606000640 1 -- 172.21.15.71:0/2683526919 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f160000bc20 con 0x7f160c06e060 2024-04-20T21:19:50.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.950+0000 7f1606000640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15f006c8f0 0x7f15f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:50.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.951+0000 7f1606000640 1 -- 172.21.15.71:0/2683526919 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f160008c390 con 0x7f160c06e060 2024-04-20T21:19:50.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.951+0000 7f1611400640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15f006c8f0 0x7f15f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:50.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.951+0000 7f1611400640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15f006c8f0 0x7f15f006edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f160c073dc0 tx=0x7f15fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:50.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:50.955+0000 7f1606000640 1 -- 172.21.15.71:0/2683526919 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f160001c360 con 0x7f160c06e060 2024-04-20T21:19:51.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.193+0000 7f1613200640 1 -- 172.21.15.71:0/2683526919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f160c15eee0 con 0x7f160c06e060 2024-04-20T21:19:51.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.708+0000 7f1606000640 1 -- 172.21.15.71:0/2683526919 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f160005a470 con 0x7f160c06e060 2024-04-20T21:19:51.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.712+0000 7f1613200640 1 -- 172.21.15.71:0/2683526919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15f006c8f0 msgr2=0x7f15f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:51.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.712+0000 7f1613200640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15f006c8f0 0x7f15f006edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f160c073dc0 tx=0x7f15fc009040 comp rx=0 tx=0).stop 2024-04-20T21:19:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.712+0000 7f1613200640 1 -- 172.21.15.71:0/2683526919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f160c06e060 msgr2=0x7f160c1f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.712+0000 7f1613200640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f160c06e060 0x7f160c1f5c60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f160000d800 tx=0x7f160000dcc0 comp rx=0 tx=0).stop 2024-04-20T21:19:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.712+0000 7f1613200640 1 -- 172.21.15.71:0/2683526919 shutdown_connections 2024-04-20T21:19:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.712+0000 7f1613200640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15f006c8f0 0x7f15f006edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.712+0000 7f1613200640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160c15d4f0 0x7f160c1f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.712+0000 7f1613200640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160c0aee60 0x7f160c1f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.712+0000 7f1613200640 1 --2- 172.21.15.71:0/2683526919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f160c06e060 0x7f160c1f5c60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.712+0000 7f1613200640 1 -- 172.21.15.71:0/2683526919 >> 172.21.15.71:0/2683526919 conn(0x7f160c0b5270 msgr2=0x7f160c0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.713+0000 7f1613200640 1 -- 172.21.15.71:0/2683526919 shutdown_connections 2024-04-20T21:19:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.713+0000 7f1613200640 1 -- 172.21.15.71:0/2683526919 wait complete. 2024-04-20T21:19:51.733 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-20T21:19:51.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:19:51.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.932+0000 7f68e5200640 1 Processor -- start 2024-04-20T21:19:51.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.932+0000 7f68e5200640 1 -- start start 2024-04-20T21:19:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68e5200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68e0159e10 0x7f68e0071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68e5200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f68e006da90 0x7f68e0071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68e5200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68e015cc90 con 0x7f68e015a1f0 2024-04-20T21:19:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68e5200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f68e0072900 con 0x7f68e0159e10 2024-04-20T21:19:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68e5200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f68e015ca40 con 0x7f68e006da90 2024-04-20T21:19:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68df400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68e0159e10 0x7f68e0071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68df400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68e0159e10 0x7f68e0071a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50950/0 (socket says 172.21.15.71:50950) 2024-04-20T21:19:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68df400640 1 -- 172.21.15.71:0/390575595 learned_addr learned my addr 172.21.15.71:0/390575595 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:51.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68df400640 1 -- 172.21.15.71:0/390575595 >> v2:172.21.15.137:3300/0 conn(0x7f68e006da90 msgr2=0x7f68e0071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:51.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68df400640 1 --2- 172.21.15.71:0/390575595 >> v2:172.21.15.137:3300/0 conn(0x7f68e006da90 0x7f68e0071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:51.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68df400640 1 -- 172.21.15.71:0/390575595 >> v1:172.21.15.137:6789/0 conn(0x7f68e015a1f0 legacy=0x7f68e0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:51.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.934+0000 7f68df400640 1 -- 172.21.15.71:0/390575595 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e015cf70 con 0x7f68e0159e10 2024-04-20T21:19:51.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.936+0000 7f68df400640 1 --2- 172.21.15.71:0/390575595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68e0159e10 0x7f68e0071a80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68e0050430 tx=0x7f68d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b4c14b932c44c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:51.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.936+0000 7f68de000640 1 -- 172.21.15.71:0/390575595 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0035020 con 0x7f68e0159e10 2024-04-20T21:19:51.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.936+0000 7f68de000640 1 -- 172.21.15.71:0/390575595 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d0031870 con 0x7f68e0159e10 2024-04-20T21:19:51.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.936+0000 7f68de000640 1 -- 172.21.15.71:0/390575595 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0031c40 con 0x7f68e0159e10 2024-04-20T21:19:51.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.936+0000 7f68e5200640 1 -- 172.21.15.71:0/390575595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68e0159e10 msgr2=0x7f68e0071a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:51.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.936+0000 7f68e5200640 1 --2- 172.21.15.71:0/390575595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68e0159e10 0x7f68e0071a80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68e0050430 tx=0x7f68d002b910 comp rx=0 tx=0).stop 2024-04-20T21:19:51.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.937+0000 7f68e5200640 1 -- 172.21.15.71:0/390575595 shutdown_connections 2024-04-20T21:19:51.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.937+0000 7f68e5200640 1 --2- 172.21.15.71:0/390575595 >> v2:172.21.15.137:3300/0 conn(0x7f68e006da90 0x7f68e0071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:51.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.937+0000 7f68e5200640 1 --2- 172.21.15.71:0/390575595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68e0159e10 0x7f68e0071a80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:51.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.937+0000 7f68e5200640 1 -- 172.21.15.71:0/390575595 >> 172.21.15.71:0/390575595 conn(0x7f68e00d0040 msgr2=0x7f68e00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:51.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.937+0000 7f68e5200640 1 -- 172.21.15.71:0/390575595 shutdown_connections 2024-04-20T21:19:51.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.937+0000 7f68e5200640 1 -- 172.21.15.71:0/390575595 wait complete. 2024-04-20T21:19:51.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.938+0000 7f68e5200640 1 Processor -- start 2024-04-20T21:19:51.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.938+0000 7f68e5200640 1 -- start start 2024-04-20T21:19:51.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.939+0000 7f68e5200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68e006da90 0x7f68e0146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:51.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.939+0000 7f68e5200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e0159e10 0x7f68e00ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:51.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.939+0000 7f68e5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68e015a1f0 0x7f68e00ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:51.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.939+0000 7f68e5200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f68e015d810 con 0x7f68e006da90 2024-04-20T21:19:51.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.939+0000 7f68e5200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68e015d530 con 0x7f68e015a1f0 2024-04-20T21:19:51.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.939+0000 7f68e5200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f68e006b900 con 0x7f68e0159e10 2024-04-20T21:19:51.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.940+0000 7f68df400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68e006da90 0x7f68e0146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:51.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.940+0000 7f68df400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68e006da90 0x7f68e0146670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50962/0 (socket says 172.21.15.71:50962) 2024-04-20T21:19:51.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.940+0000 7f68df400640 1 -- 172.21.15.71:0/3844599528 learned_addr learned my addr 172.21.15.71:0/3844599528 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:51.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.940+0000 7f68dea00640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e0159e10 0x7f68e00ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:51.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.940+0000 7f68df400640 1 -- 172.21.15.71:0/3844599528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e0159e10 msgr2=0x7f68e00ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:51.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.940+0000 7f68df400640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e0159e10 0x7f68e00ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:51.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.940+0000 7f68df400640 1 -- 172.21.15.71:0/3844599528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68e015a1f0 msgr2=0x7f68e00ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:51.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.940+0000 7f68df400640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68e015a1f0 0x7f68e00ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:51.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.940+0000 7f68df400640 1 -- 172.21.15.71:0/3844599528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e009cc50 con 0x7f68e006da90 2024-04-20T21:19:51.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.940+0000 7f68df400640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68e006da90 0x7f68e0146670 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68d0000c00 tx=0x7f68d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:51.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.941+0000 7f68d7400640 1 -- 172.21.15.71:0/3844599528 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d00443f0 con 0x7f68e006da90 2024-04-20T21:19:51.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.941+0000 7f68d7400640 1 -- 172.21.15.71:0/3844599528 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d00445b0 con 0x7f68e006da90 2024-04-20T21:19:51.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.941+0000 7f68d7400640 1 -- 172.21.15.71:0/3844599528 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d00449a0 con 0x7f68e006da90 2024-04-20T21:19:51.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.941+0000 7f68e5200640 1 -- 172.21.15.71:0/3844599528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e009cf30 con 0x7f68e006da90 2024-04-20T21:19:51.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.941+0000 7f68e5200640 1 -- 172.21.15.71:0/3844599528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e009d4f0 con 0x7f68e006da90 2024-04-20T21:19:51.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.942+0000 7f68e5200640 1 -- 172.21.15.71:0/3844599528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68e0075b60 con 0x7f68e006da90 2024-04-20T21:19:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.943+0000 7f68d7400640 1 -- 172.21.15.71:0/3844599528 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f68d004b060 con 0x7f68e006da90 2024-04-20T21:19:51.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.944+0000 7f68d7400640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f68c006c920 0x7f68c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:51.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.944+0000 7f68d7400640 1 -- 172.21.15.71:0/3844599528 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f68d00ae190 con 0x7f68e006da90 2024-04-20T21:19:51.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.944+0000 7f68dea00640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f68c006c920 0x7f68c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:51.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.945+0000 7f68dea00640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f68c006c920 0x7f68c006ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f68cc006fd0 tx=0x7f68cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:51.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:51.948+0000 7f68d7400640 1 -- 172.21.15.71:0/3844599528 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f68d003f070 con 0x7f68e006da90 2024-04-20T21:19:52.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.187+0000 7f68e5200640 1 -- 172.21.15.71:0/3844599528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68e00b0ef0 con 0x7f68e006da90 2024-04-20T21:19:52.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.188+0000 7f68d7400640 1 -- 172.21.15.71:0/3844599528 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5201 (secure 0 0 0) 0x7f68d002f320 con 0x7f68e006da90 2024-04-20T21:19:52.188 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:52.188 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3502151495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3502151495},{"type":"v1","addr":"172.21.15.137:6833","nonce":3502151495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2603023903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2603023903},{"type":"v1","addr":"172.21.15.137:6835","nonce":2603023903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3246613850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3246613850},{"type":"v1","addr":"172.21.15.71:6835","nonce":3246613850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:19:28.763862+0000","modified":"2024-04-20T21:19:51.195122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/4085222328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":4085222328},{"type":"v1","addr":"172.21.15.71:6837","nonce":4085222328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-20T21:19:52.188 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 -- 172.21.15.71:0/3844599528 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f68c006c920 msgr2=0x7f68c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f68c006c920 0x7f68c006ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f68cc006fd0 tx=0x7f68cc008040 comp rx=0 tx=0).stop 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 -- 172.21.15.71:0/3844599528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68e006da90 msgr2=0x7f68e0146670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68e006da90 0x7f68e0146670 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68d0000c00 tx=0x7f68d00046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 -- 172.21.15.71:0/3844599528 shutdown_connections 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f68c006c920 0x7f68c006ede0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68e015a1f0 0x7f68e00ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e0159e10 0x7f68e00ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 --2- 172.21.15.71:0/3844599528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68e006da90 0x7f68e0146670 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 -- 172.21.15.71:0/3844599528 >> 172.21.15.71:0/3844599528 conn(0x7f68e00d0040 msgr2=0x7f68e0071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 -- 172.21.15.71:0/3844599528 shutdown_connections 2024-04-20T21:19:52.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.191+0000 7f68e5200640 1 -- 172.21.15.71:0/3844599528 wait complete. 2024-04-20T21:19:52.210 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:52.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.403+0000 7f8035600640 1 Processor -- start 2024-04-20T21:19:52.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.403+0000 7f8035600640 1 -- start start 2024-04-20T21:19:52.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.404+0000 7f8035600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8030072cc0 0x7f80300ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.404+0000 7f8035600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f803006e840 con 0x7f803015abb0 2024-04-20T21:19:52.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.404+0000 7f8035600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f803015b350 con 0x7f8030071b50 2024-04-20T21:19:52.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.404+0000 7f8035600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f803006eb00 con 0x7f8030072cc0 2024-04-20T21:19:52.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.405+0000 7f802ea00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f803015abb0 0x7f80300725b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52844/0 (socket says 172.21.15.71:52844) 2024-04-20T21:19:52.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.405+0000 7f802ea00640 1 -- 172.21.15.71:0/4132735609 learned_addr learned my addr 172.21.15.71:0/4132735609 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:52.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.405+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1619839 0 0) 0x7f803006e840 con 0x7f803015abb0 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.405+0000 7f802e000640 1 --2- 172.21.15.71:0/4132735609 >> v2:172.21.15.137:3300/0 conn(0x7f8030072cc0 0x7f80300ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.405+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8014003440 con 0x7f803015abb0 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.405+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2466910211 0 0) 0x7f8014003440 con 0x7f803015abb0 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.405+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 >> v2:172.21.15.137:3300/0 conn(0x7f8030072cc0 msgr2=0x7f80300ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.405+0000 7f802d600640 1 --2- 172.21.15.71:0/4132735609 >> v2:172.21.15.137:3300/0 conn(0x7f8030072cc0 0x7f80300ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.405+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 >> v1:172.21.15.137:6789/0 conn(0x7f8030071b50 legacy=0x7f80300adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803015b630 con 0x7f803015abb0 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f8020001670 con 0x7f803015abb0 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 >> v1:172.21.15.71:6789/0 conn(0x7f803015abb0 legacy=0x7f80300725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802d600640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8014003aa0 0x7f8014003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802d600640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8014008900 0x7f801400ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802d600640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f801400b570 0x7f801400da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f801400e2e0 con 0x7f8014008900 2024-04-20T21:19:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f801400e490 con 0x7f8014003aa0 2024-04-20T21:19:52.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f801400e690 con 0x7f801400b570 2024-04-20T21:19:52.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802e000640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8014008900 0x7f801400ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802ea00640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8014003aa0 0x7f8014003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802f400640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f801400b570 0x7f801400da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802e000640 1 -- 172.21.15.71:0/4132735609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f801400b570 msgr2=0x7f801400da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:52.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802e000640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f801400b570 0x7f801400da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802e000640 1 -- 172.21.15.71:0/4132735609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8014003aa0 msgr2=0x7f8014003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802e000640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8014003aa0 0x7f8014003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802e000640 1 -- 172.21.15.71:0/4132735609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8014003440 con 0x7f8014008900 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802f400640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f801400b570 0x7f801400da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.406+0000 7f802f400640 1 -- 172.21.15.71:0/4132735609 reap_dead start 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.408+0000 7f802e000640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8014008900 0x7f801400ad70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f801c00ba30 tx=0x7f8014003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f3f1cf0d4327c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.408+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c036020 con 0x7f8014008900 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.408+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801c032630 con 0x7f8014008900 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.408+0000 7f802d600640 1 -- 172.21.15.71:0/4132735609 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c00b600 con 0x7f8014008900 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.408+0000 7f8035600640 1 -- 172.21.15.71:0/4132735609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8014008900 msgr2=0x7f801400ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.408+0000 7f8035600640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8014008900 0x7f801400ad70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f801c00ba30 tx=0x7f8014003730 comp rx=0 tx=0).stop 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.408+0000 7f8035600640 1 -- 172.21.15.71:0/4132735609 shutdown_connections 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.408+0000 7f8035600640 1 --2- 172.21.15.71:0/4132735609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8014008900 0x7f801400ad70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.408+0000 7f8035600640 1 -- 172.21.15.71:0/4132735609 >> 172.21.15.71:0/4132735609 conn(0x7f80300b3350 msgr2=0x7f80300b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.408+0000 7f8035600640 1 -- 172.21.15.71:0/4132735609 shutdown_connections 2024-04-20T21:19:52.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.409+0000 7f8035600640 1 -- 172.21.15.71:0/4132735609 wait complete. 2024-04-20T21:19:52.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.410+0000 7f8035600640 1 Processor -- start 2024-04-20T21:19:52.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.410+0000 7f8035600640 1 -- start start 2024-04-20T21:19:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.411+0000 7f8035600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8014008900 0x7f80300b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.411+0000 7f8035600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80301f7340 0x7f80301f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.411+0000 7f8035600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f803009bff0 0x7f803009c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.411+0000 7f8035600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f803015bbf0 con 0x7f80301f7340 2024-04-20T21:19:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.411+0000 7f8035600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f803015bf60 con 0x7f8014008900 2024-04-20T21:19:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.411+0000 7f8035600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f803015af90 con 0x7f803009bff0 2024-04-20T21:19:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.411+0000 7f802e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80301f7340 0x7f80301f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.412+0000 7f802e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80301f7340 0x7f80301f77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50990/0 (socket says 172.21.15.71:50990) 2024-04-20T21:19:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.412+0000 7f802e000640 1 -- 172.21.15.71:0/2353845253 learned_addr learned my addr 172.21.15.71:0/2353845253 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.412+0000 7f802ea00640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8014008900 0x7f80300b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.412+0000 7f802f400640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f803009bff0 0x7f803009c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.412+0000 7f802e000640 1 -- 172.21.15.71:0/2353845253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f803009bff0 msgr2=0x7f803009c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.412+0000 7f802e000640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f803009bff0 0x7f803009c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.412+0000 7f802e000640 1 -- 172.21.15.71:0/2353845253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8014008900 msgr2=0x7f80300b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.412+0000 7f802e000640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8014008900 0x7f80300b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.412+0000 7f802e000640 1 -- 172.21.15.71:0/2353845253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80300b0830 con 0x7f80301f7340 2024-04-20T21:19:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.412+0000 7f802e000640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80301f7340 0x7f80301f77c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f801c035040 tx=0x7f801c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.413+0000 7f8026a00640 1 -- 172.21.15.71:0/2353845253 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c041070 con 0x7f80301f7340 2024-04-20T21:19:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.413+0000 7f8026a00640 1 -- 172.21.15.71:0/2353845253 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801c030a40 con 0x7f80301f7340 2024-04-20T21:19:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.413+0000 7f8026a00640 1 -- 172.21.15.71:0/2353845253 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c036040 con 0x7f80301f7340 2024-04-20T21:19:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.413+0000 7f8035600640 1 -- 172.21.15.71:0/2353845253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80300af790 con 0x7f80301f7340 2024-04-20T21:19:52.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.413+0000 7f8035600640 1 -- 172.21.15.71:0/2353845253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80300afd50 con 0x7f80301f7340 2024-04-20T21:19:52.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.414+0000 7f8035600640 1 -- 172.21.15.71:0/2353845253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f803006cdd0 con 0x7f80301f7340 2024-04-20T21:19:52.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.415+0000 7f8026a00640 1 -- 172.21.15.71:0/2353845253 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f801c039020 con 0x7f80301f7340 2024-04-20T21:19:52.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.416+0000 7f8026a00640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f801006c920 0x7f801006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.416+0000 7f8026a00640 1 -- 172.21.15.71:0/2353845253 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f801c0ae200 con 0x7f80301f7340 2024-04-20T21:19:52.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.416+0000 7f802ea00640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f801006c920 0x7f801006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.416+0000 7f802ea00640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f801006c920 0x7f801006ede0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8020001050 tx=0x7f8020009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:52.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.420+0000 7f8026a00640 1 -- 172.21.15.71:0/2353845253 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f801c07c250 con 0x7f80301f7340 2024-04-20T21:19:52.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:19:52.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:19:52.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.627+0000 7f8035600640 1 -- 172.21.15.71:0/2353845253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80300cfe90 con 0x7f80301f7340 2024-04-20T21:19:52.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.630+0000 7f8026a00640 1 -- 172.21.15.71:0/2353845253 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f801c07bb50 con 0x7f80301f7340 2024-04-20T21:19:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:52.630 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.633+0000 7f8035600640 1 -- 172.21.15.71:0/2353845253 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f801006c920 msgr2=0x7f801006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.633+0000 7f8035600640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f801006c920 0x7f801006ede0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8020001050 tx=0x7f8020009040 comp rx=0 tx=0).stop 2024-04-20T21:19:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.633+0000 7f8035600640 1 -- 172.21.15.71:0/2353845253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80301f7340 msgr2=0x7f80301f77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.633+0000 7f8035600640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80301f7340 0x7f80301f77c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f801c035040 tx=0x7f801c004730 comp rx=0 tx=0).stop 2024-04-20T21:19:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.633+0000 7f8035600640 1 -- 172.21.15.71:0/2353845253 shutdown_connections 2024-04-20T21:19:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.633+0000 7f8035600640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f801006c920 0x7f801006ede0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.633+0000 7f8035600640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f803009bff0 0x7f803009c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.633+0000 7f8035600640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80301f7340 0x7f80301f77c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.633+0000 7f8035600640 1 --2- 172.21.15.71:0/2353845253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8014008900 0x7f80300b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.633+0000 7f8035600640 1 -- 172.21.15.71:0/2353845253 >> 172.21.15.71:0/2353845253 conn(0x7f80300b3350 msgr2=0x7f8030155850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.634+0000 7f8035600640 1 -- 172.21.15.71:0/2353845253 shutdown_connections 2024-04-20T21:19:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.634+0000 7f8035600640 1 -- 172.21.15.71:0/2353845253 wait complete. 2024-04-20T21:19:52.651 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-20T21:19:52.652 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T21:19:52.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.850+0000 7f3639400640 1 Processor -- start 2024-04-20T21:19:52.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.851+0000 7f3639400640 1 -- start start 2024-04-20T21:19:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.852+0000 7f3639400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3634161d50 0x7f36340d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.852+0000 7f3639400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f36340b3330 0x7f36340b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.852+0000 7f3639400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f363406c6d0 0x7f363406cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.852+0000 7f3639400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3634162130 con 0x7f36340b3330 2024-04-20T21:19:52.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.852+0000 7f3639400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f363406c190 con 0x7f3634161d50 2024-04-20T21:19:52.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.852+0000 7f3639400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f363406c470 con 0x7f363406c6d0 2024-04-20T21:19:52.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.853+0000 7f3633400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f36340b3330 0x7f36340b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.853+0000 7f3633400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f36340b3330 0x7f36340b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51006/0 (socket says 172.21.15.71:51006) 2024-04-20T21:19:52.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.853+0000 7f3633400640 1 -- 172.21.15.71:0/3151494797 learned_addr learned my addr 172.21.15.71:0/3151494797 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:52.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.853+0000 7f3633e00640 1 --2- 172.21.15.71:0/3151494797 >> v2:172.21.15.137:3300/0 conn(0x7f3634161d50 0x7f36340d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.853+0000 7f3638a00640 1 --2- 172.21.15.71:0/3151494797 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f363406c6d0 0x7f363406cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.853+0000 7f3633400640 1 -- 172.21.15.71:0/3151494797 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f363406c6d0 msgr2=0x7f363406cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:52.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.853+0000 7f3633400640 1 --2- 172.21.15.71:0/3151494797 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f363406c6d0 0x7f363406cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.853+0000 7f3633400640 1 -- 172.21.15.71:0/3151494797 >> v2:172.21.15.137:3300/0 conn(0x7f3634161d50 msgr2=0x7f36340d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:52.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.853+0000 7f3633400640 1 --2- 172.21.15.71:0/3151494797 >> v2:172.21.15.137:3300/0 conn(0x7f3634161d50 0x7f36340d38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.853+0000 7f3633400640 1 -- 172.21.15.71:0/3151494797 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36340d2e00 con 0x7f36340b3330 2024-04-20T21:19:52.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.854+0000 7f3633400640 1 --2- 172.21.15.71:0/3151494797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36340b3330 0x7f36340b3880 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36340b6f50 tx=0x7f362002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b41838d6742d39b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:52.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.854+0000 7f3632a00640 1 -- 172.21.15.71:0/3151494797 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620035020 con 0x7f36340b3330 2024-04-20T21:19:52.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.855+0000 7f3632a00640 1 -- 172.21.15.71:0/3151494797 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3620031870 con 0x7f36340b3330 2024-04-20T21:19:52.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.855+0000 7f3632a00640 1 -- 172.21.15.71:0/3151494797 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620031c40 con 0x7f36340b3330 2024-04-20T21:19:52.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.855+0000 7f3639400640 1 -- 172.21.15.71:0/3151494797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36340b3330 msgr2=0x7f36340b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.855+0000 7f3639400640 1 --2- 172.21.15.71:0/3151494797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36340b3330 0x7f36340b3880 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36340b6f50 tx=0x7f362002b910 comp rx=0 tx=0).stop 2024-04-20T21:19:52.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.855+0000 7f3639400640 1 -- 172.21.15.71:0/3151494797 shutdown_connections 2024-04-20T21:19:52.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.855+0000 7f3639400640 1 --2- 172.21.15.71:0/3151494797 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f363406c6d0 0x7f363406cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.855+0000 7f3639400640 1 --2- 172.21.15.71:0/3151494797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36340b3330 0x7f36340b3880 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.855+0000 7f3639400640 1 --2- 172.21.15.71:0/3151494797 >> v2:172.21.15.137:3300/0 conn(0x7f3634161d50 0x7f36340d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.855+0000 7f3639400640 1 -- 172.21.15.71:0/3151494797 >> 172.21.15.71:0/3151494797 conn(0x7f36340d4450 msgr2=0x7f36340d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:52.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.855+0000 7f3639400640 1 -- 172.21.15.71:0/3151494797 shutdown_connections 2024-04-20T21:19:52.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.855+0000 7f3639400640 1 -- 172.21.15.71:0/3151494797 wait complete. 2024-04-20T21:19:52.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.857+0000 7f3639400640 1 Processor -- start 2024-04-20T21:19:52.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.857+0000 7f3639400640 1 -- start start 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.858+0000 7f3639400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f363406c6d0 0x7f363414c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.858+0000 7f3639400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36340b3330 0x7f36340c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.858+0000 7f3639400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3634161d50 0x7f36340ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.858+0000 7f3639400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36340cfa00 con 0x7f3634161d50 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.858+0000 7f3639400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f36340d33c0 con 0x7f36340b3330 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.858+0000 7f3639400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f36340cfb80 con 0x7f363406c6d0 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.859+0000 7f3638a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3634161d50 0x7f36340ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.859+0000 7f3638a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3634161d50 0x7f36340ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51018/0 (socket says 172.21.15.71:51018) 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.859+0000 7f3638a00640 1 -- 172.21.15.71:0/416436984 learned_addr learned my addr 172.21.15.71:0/416436984 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.859+0000 7f3633e00640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f363406c6d0 0x7f363414c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.859+0000 7f3633400640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36340b3330 0x7f36340c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.859+0000 7f3638a00640 1 -- 172.21.15.71:0/416436984 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f363406c6d0 msgr2=0x7f363414c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.859+0000 7f3638a00640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f363406c6d0 0x7f363414c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.859+0000 7f3638a00640 1 -- 172.21.15.71:0/416436984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36340b3330 msgr2=0x7f36340c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.859+0000 7f3638a00640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36340b3330 0x7f36340c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.859+0000 7f3638a00640 1 -- 172.21.15.71:0/416436984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36340c81b0 con 0x7f3634161d50 2024-04-20T21:19:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.859+0000 7f3638a00640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3634161d50 0x7f36340ca290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f362c007e90 tx=0x7f362c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.860+0000 7f362be00640 1 -- 172.21.15.71:0/416436984 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c014420 con 0x7f3634161d50 2024-04-20T21:19:52.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.860+0000 7f362be00640 1 -- 172.21.15.71:0/416436984 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c019070 con 0x7f3634161d50 2024-04-20T21:19:52.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.860+0000 7f362be00640 1 -- 172.21.15.71:0/416436984 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c014820 con 0x7f3634161d50 2024-04-20T21:19:52.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.860+0000 7f3639400640 1 -- 172.21.15.71:0/416436984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36340c8490 con 0x7f3634161d50 2024-04-20T21:19:52.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.860+0000 7f3639400640 1 -- 172.21.15.71:0/416436984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36340c8a50 con 0x7f3634161d50 2024-04-20T21:19:52.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.861+0000 7f3639400640 1 -- 172.21.15.71:0/416436984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3634075b60 con 0x7f3634161d50 2024-04-20T21:19:52.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.862+0000 7f362be00640 1 -- 172.21.15.71:0/416436984 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f362c0149c0 con 0x7f3634161d50 2024-04-20T21:19:52.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.863+0000 7f362be00640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f361406c920 0x7f361406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:52.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.863+0000 7f362be00640 1 -- 172.21.15.71:0/416436984 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f362c08c640 con 0x7f3634161d50 2024-04-20T21:19:52.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.863+0000 7f3633e00640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f361406c920 0x7f361406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:52.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.864+0000 7f3633e00640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f361406c920 0x7f361406ede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3624006fd0 tx=0x7f3624008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:52.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:52.867+0000 7f362be00640 1 -- 172.21.15.71:0/416436984 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f362c05a7c0 con 0x7f3634161d50 2024-04-20T21:19:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.052+0000 7f3639400640 1 -- 172.21.15.71:0/416436984 --> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36340c7f60 con 0x7f361406c920 2024-04-20T21:19:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.067+0000 7f362be00640 1 -- 172.21.15.71:0/416436984 <== mgr.4110 v2:172.21.15.71:6832/1511456036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332570 (secure 0 0 0) 0x7f36340c7f60 con 0x7f361406c920 2024-04-20T21:19:53.070 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:53.073 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-20T21:19:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.074+0000 7f3639400640 1 -- 172.21.15.71:0/416436984 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f361406c920 msgr2=0x7f361406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.074+0000 7f3639400640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f361406c920 0x7f361406ede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3624006fd0 tx=0x7f3624008040 comp rx=0 tx=0).stop 2024-04-20T21:19:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.074+0000 7f3639400640 1 -- 172.21.15.71:0/416436984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3634161d50 msgr2=0x7f36340ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.074+0000 7f3639400640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3634161d50 0x7f36340ca290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f362c007e90 tx=0x7f362c00e4b0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.075+0000 7f3639400640 1 -- 172.21.15.71:0/416436984 shutdown_connections 2024-04-20T21:19:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.075+0000 7f3639400640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f361406c920 0x7f361406ede0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.075+0000 7f3639400640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3634161d50 0x7f36340ca290 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.075+0000 7f3639400640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36340b3330 0x7f36340c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.075+0000 7f3639400640 1 --2- 172.21.15.71:0/416436984 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f363406c6d0 0x7f363414c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.075+0000 7f3639400640 1 -- 172.21.15.71:0/416436984 >> 172.21.15.71:0/416436984 conn(0x7f36340d4450 msgr2=0x7f36340d4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.075+0000 7f3639400640 1 -- 172.21.15.71:0/416436984 shutdown_connections 2024-04-20T21:19:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.075+0000 7f3639400640 1 -- 172.21.15.71:0/416436984 wait complete. 2024-04-20T21:19:53.093 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-20T21:19:51.801451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2048878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005508"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250445+0000","last_change":"2024-04-20T21:19:28.364884+0000","last_active":"2024-04-20T21:19:36.250445+0000","last_peered":"2024-04-20T21:19:36.250445+0000","last_clean":"2024-04-20T21:19:36.250445+0000","last_became_active":"2024-04-20T21:19:28.364515+0000","last_became_peered":"2024-04-20T21:19:28.364515+0000","last_unstale":"2024-04-20T21:19:36.250445+0000","last_undegraded":"2024-04-20T21:19:36.250445+0000","last_fullsized":"2024-04-20T21:19:36.250445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622903+0000","last_change":"2024-04-20T21:19:29.381382+0000","last_active":"2024-04-20T21:19:35.622903+0000","last_peered":"2024-04-20T21:19:35.622903+0000","last_clean":"2024-04-20T21:19:35.622903+0000","last_became_active":"2024-04-20T21:19:29.381086+0000","last_became_peered":"2024-04-20T21:19:29.381086+0000","last_unstale":"2024-04-20T21:19:35.622903+0000","last_undegraded":"2024-04-20T21:19:35.622903+0000","last_fullsized":"2024-04-20T21:19:35.622903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:24:23.709381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622136+0000","last_change":"2024-04-20T21:19:34.116039+0000","last_active":"2024-04-20T21:19:35.622136+0000","last_peered":"2024-04-20T21:19:35.622136+0000","last_clean":"2024-04-20T21:19:35.622136+0000","last_became_active":"2024-04-20T21:19:34.114870+0000","last_became_peered":"2024-04-20T21:19:34.114870+0000","last_unstale":"2024-04-20T21:19:35.622136+0000","last_undegraded":"2024-04-20T21:19:35.622136+0000","last_fullsized":"2024-04-20T21:19:35.622136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:11:39.317180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623062+0000","last_change":"2024-04-20T21:19:28.356358+0000","last_active":"2024-04-20T21:19:35.623062+0000","last_peered":"2024-04-20T21:19:35.623062+0000","last_clean":"2024-04-20T21:19:35.623062+0000","last_became_active":"2024-04-20T21:19:28.355376+0000","last_became_peered":"2024-04-20T21:19:28.355376+0000","last_unstale":"2024-04-20T21:19:35.623062+0000","last_undegraded":"2024-04-20T21:19:35.623062+0000","last_fullsized":"2024-04-20T21:19:35.623062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:12:37.534140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250065+0000","last_change":"2024-04-20T21:19:29.393098+0000","last_active":"2024-04-20T21:19:36.250065+0000","last_peered":"2024-04-20T21:19:36.250065+0000","last_clean":"2024-04-20T21:19:36.250065+0000","last_became_active":"2024-04-20T21:19:29.392267+0000","last_became_peered":"2024-04-20T21:19:29.392267+0000","last_unstale":"2024-04-20T21:19:36.250065+0000","last_undegraded":"2024-04-20T21:19:36.250065+0000","last_fullsized":"2024-04-20T21:19:36.250065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626812+0000","last_change":"2024-04-20T21:19:33.632986+0000","last_active":"2024-04-20T21:19:35.626812+0000","last_peered":"2024-04-20T21:19:35.626812+0000","last_clean":"2024-04-20T21:19:35.626812+0000","last_became_active":"2024-04-20T21:19:33.632489+0000","last_became_peered":"2024-04-20T21:19:33.632489+0000","last_unstale":"2024-04-20T21:19:35.626812+0000","last_undegraded":"2024-04-20T21:19:35.626812+0000","last_fullsized":"2024-04-20T21:19:35.626812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:25.396766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251112+0000","last_change":"2024-04-20T21:19:28.370372+0000","last_active":"2024-04-20T21:19:36.251112+0000","last_peered":"2024-04-20T21:19:36.251112+0000","last_clean":"2024-04-20T21:19:36.251112+0000","last_became_active":"2024-04-20T21:19:28.369998+0000","last_became_peered":"2024-04-20T21:19:28.369998+0000","last_unstale":"2024-04-20T21:19:36.251112+0000","last_undegraded":"2024-04-20T21:19:36.251112+0000","last_fullsized":"2024-04-20T21:19:36.251112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:49:21.426416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777896+0000","last_change":"2024-04-20T21:19:29.383743+0000","last_active":"2024-04-20T21:19:35.777896+0000","last_peered":"2024-04-20T21:19:35.777896+0000","last_clean":"2024-04-20T21:19:35.777896+0000","last_became_active":"2024-04-20T21:19:29.383451+0000","last_became_peered":"2024-04-20T21:19:29.383451+0000","last_unstale":"2024-04-20T21:19:35.777896+0000","last_undegraded":"2024-04-20T21:19:35.777896+0000","last_fullsized":"2024-04-20T21:19:35.777896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:21.125011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630668+0000","last_change":"2024-04-20T21:19:33.632955+0000","last_active":"2024-04-20T21:19:35.630668+0000","last_peered":"2024-04-20T21:19:35.630668+0000","last_clean":"2024-04-20T21:19:35.630668+0000","last_became_active":"2024-04-20T21:19:33.632418+0000","last_became_peered":"2024-04-20T21:19:33.632418+0000","last_unstale":"2024-04-20T21:19:35.630668+0000","last_undegraded":"2024-04-20T21:19:35.630668+0000","last_fullsized":"2024-04-20T21:19:35.630668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250671+0000","last_change":"2024-04-20T21:19:28.367835+0000","last_active":"2024-04-20T21:19:36.250671+0000","last_peered":"2024-04-20T21:19:36.250671+0000","last_clean":"2024-04-20T21:19:36.250671+0000","last_became_active":"2024-04-20T21:19:28.367516+0000","last_became_peered":"2024-04-20T21:19:28.367516+0000","last_unstale":"2024-04-20T21:19:36.250671+0000","last_undegraded":"2024-04-20T21:19:36.250671+0000","last_fullsized":"2024-04-20T21:19:36.250671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:03:38.483955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778252+0000","last_change":"2024-04-20T21:19:29.382022+0000","last_active":"2024-04-20T21:19:35.778252+0000","last_peered":"2024-04-20T21:19:35.778252+0000","last_clean":"2024-04-20T21:19:35.778252+0000","last_became_active":"2024-04-20T21:19:29.381441+0000","last_became_peered":"2024-04-20T21:19:29.381441+0000","last_unstale":"2024-04-20T21:19:35.778252+0000","last_undegraded":"2024-04-20T21:19:35.778252+0000","last_fullsized":"2024-04-20T21:19:35.778252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:10:56.546673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629810+0000","last_change":"2024-04-20T21:19:33.623830+0000","last_active":"2024-04-20T21:19:35.629810+0000","last_peered":"2024-04-20T21:19:35.629810+0000","last_clean":"2024-04-20T21:19:35.629810+0000","last_became_active":"2024-04-20T21:19:33.623367+0000","last_became_peered":"2024-04-20T21:19:33.623367+0000","last_unstale":"2024-04-20T21:19:35.629810+0000","last_undegraded":"2024-04-20T21:19:35.629810+0000","last_fullsized":"2024-04-20T21:19:35.629810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:35.626728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627137+0000","last_change":"2024-04-20T21:19:29.362406+0000","last_active":"2024-04-20T21:19:35.627137+0000","last_peered":"2024-04-20T21:19:35.627137+0000","last_clean":"2024-04-20T21:19:35.627137+0000","last_became_active":"2024-04-20T21:19:29.361949+0000","last_became_peered":"2024-04-20T21:19:29.361949+0000","last_unstale":"2024-04-20T21:19:35.627137+0000","last_undegraded":"2024-04-20T21:19:35.627137+0000","last_fullsized":"2024-04-20T21:19:35.627137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250473+0000","last_change":"2024-04-20T21:19:28.366445+0000","last_active":"2024-04-20T21:19:36.250473+0000","last_peered":"2024-04-20T21:19:36.250473+0000","last_clean":"2024-04-20T21:19:36.250473+0000","last_became_active":"2024-04-20T21:19:28.365983+0000","last_became_peered":"2024-04-20T21:19:28.365983+0000","last_unstale":"2024-04-20T21:19:36.250473+0000","last_undegraded":"2024-04-20T21:19:36.250473+0000","last_fullsized":"2024-04-20T21:19:36.250473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:19:13.843410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.632337+0000","last_change":"2024-04-20T21:19:33.633939+0000","last_active":"2024-04-20T21:19:35.632337+0000","last_peered":"2024-04-20T21:19:35.632337+0000","last_clean":"2024-04-20T21:19:35.632337+0000","last_became_active":"2024-04-20T21:19:33.633480+0000","last_became_peered":"2024-04-20T21:19:33.633480+0000","last_unstale":"2024-04-20T21:19:35.632337+0000","last_undegraded":"2024-04-20T21:19:35.632337+0000","last_fullsized":"2024-04-20T21:19:35.632337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622549+0000","last_change":"2024-04-20T21:19:29.396467+0000","last_active":"2024-04-20T21:19:35.622549+0000","last_peered":"2024-04-20T21:19:35.622549+0000","last_clean":"2024-04-20T21:19:35.622549+0000","last_became_active":"2024-04-20T21:19:29.396096+0000","last_became_peered":"2024-04-20T21:19:29.396096+0000","last_unstale":"2024-04-20T21:19:35.622549+0000","last_undegraded":"2024-04-20T21:19:35.622549+0000","last_fullsized":"2024-04-20T21:19:35.622549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248714+0000","last_change":"2024-04-20T21:19:28.354943+0000","last_active":"2024-04-20T21:19:36.248714+0000","last_peered":"2024-04-20T21:19:36.248714+0000","last_clean":"2024-04-20T21:19:36.248714+0000","last_became_active":"2024-04-20T21:19:28.354543+0000","last_became_peered":"2024-04-20T21:19:28.354543+0000","last_unstale":"2024-04-20T21:19:36.248714+0000","last_undegraded":"2024-04-20T21:19:36.248714+0000","last_fullsized":"2024-04-20T21:19:36.248714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631184+0000","last_change":"2024-04-20T21:19:33.630390+0000","last_active":"2024-04-20T21:19:35.631184+0000","last_peered":"2024-04-20T21:19:35.631184+0000","last_clean":"2024-04-20T21:19:35.631184+0000","last_became_active":"2024-04-20T21:19:33.629932+0000","last_became_peered":"2024-04-20T21:19:33.629932+0000","last_unstale":"2024-04-20T21:19:35.631184+0000","last_undegraded":"2024-04-20T21:19:35.631184+0000","last_fullsized":"2024-04-20T21:19:35.631184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621975+0000","last_change":"2024-04-20T21:19:29.389415+0000","last_active":"2024-04-20T21:19:35.621975+0000","last_peered":"2024-04-20T21:19:35.621975+0000","last_clean":"2024-04-20T21:19:35.621975+0000","last_became_active":"2024-04-20T21:19:29.381155+0000","last_became_peered":"2024-04-20T21:19:29.381155+0000","last_unstale":"2024-04-20T21:19:35.621975+0000","last_undegraded":"2024-04-20T21:19:35.621975+0000","last_fullsized":"2024-04-20T21:19:35.621975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249623+0000","last_change":"2024-04-20T21:19:28.364622+0000","last_active":"2024-04-20T21:19:36.249623+0000","last_peered":"2024-04-20T21:19:36.249623+0000","last_clean":"2024-04-20T21:19:36.249623+0000","last_became_active":"2024-04-20T21:19:28.364315+0000","last_became_peered":"2024-04-20T21:19:28.364315+0000","last_unstale":"2024-04-20T21:19:36.249623+0000","last_undegraded":"2024-04-20T21:19:36.249623+0000","last_fullsized":"2024-04-20T21:19:36.249623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:18.220229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248334+0000","last_change":"2024-04-20T21:19:34.113879+0000","last_active":"2024-04-20T21:19:36.248334+0000","last_peered":"2024-04-20T21:19:36.248334+0000","last_clean":"2024-04-20T21:19:36.248334+0000","last_became_active":"2024-04-20T21:19:34.112094+0000","last_became_peered":"2024-04-20T21:19:34.112094+0000","last_unstale":"2024-04-20T21:19:36.248334+0000","last_undegraded":"2024-04-20T21:19:36.248334+0000","last_fullsized":"2024-04-20T21:19:36.248334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629286+0000","last_change":"2024-04-20T21:19:29.380675+0000","last_active":"2024-04-20T21:19:35.629286+0000","last_peered":"2024-04-20T21:19:35.629286+0000","last_clean":"2024-04-20T21:19:35.629286+0000","last_became_active":"2024-04-20T21:19:29.380380+0000","last_became_peered":"2024-04-20T21:19:29.380380+0000","last_unstale":"2024-04-20T21:19:35.629286+0000","last_undegraded":"2024-04-20T21:19:35.629286+0000","last_fullsized":"2024-04-20T21:19:35.629286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:28.311170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249614+0000","last_change":"2024-04-20T21:19:28.368079+0000","last_active":"2024-04-20T21:19:36.249614+0000","last_peered":"2024-04-20T21:19:36.249614+0000","last_clean":"2024-04-20T21:19:36.249614+0000","last_became_active":"2024-04-20T21:19:28.367750+0000","last_became_peered":"2024-04-20T21:19:28.367750+0000","last_unstale":"2024-04-20T21:19:36.249614+0000","last_undegraded":"2024-04-20T21:19:36.249614+0000","last_fullsized":"2024-04-20T21:19:36.249614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:45.962672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630326+0000","last_change":"2024-04-20T21:19:33.631284+0000","last_active":"2024-04-20T21:19:35.630326+0000","last_peered":"2024-04-20T21:19:35.630326+0000","last_clean":"2024-04-20T21:19:35.630326+0000","last_became_active":"2024-04-20T21:19:33.630971+0000","last_became_peered":"2024-04-20T21:19:33.630971+0000","last_unstale":"2024-04-20T21:19:35.630326+0000","last_undegraded":"2024-04-20T21:19:35.630326+0000","last_fullsized":"2024-04-20T21:19:35.630326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:18:37.532799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249846+0000","last_change":"2024-04-20T21:19:29.391566+0000","last_active":"2024-04-20T21:19:36.249846+0000","last_peered":"2024-04-20T21:19:36.249846+0000","last_clean":"2024-04-20T21:19:36.249846+0000","last_became_active":"2024-04-20T21:19:29.391250+0000","last_became_peered":"2024-04-20T21:19:29.391250+0000","last_unstale":"2024-04-20T21:19:36.249846+0000","last_undegraded":"2024-04-20T21:19:36.249846+0000","last_fullsized":"2024-04-20T21:19:36.249846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628809+0000","last_change":"2024-04-20T21:19:28.364547+0000","last_active":"2024-04-20T21:19:35.628809+0000","last_peered":"2024-04-20T21:19:35.628809+0000","last_clean":"2024-04-20T21:19:35.628809+0000","last_became_active":"2024-04-20T21:19:28.364221+0000","last_became_peered":"2024-04-20T21:19:28.364221+0000","last_unstale":"2024-04-20T21:19:35.628809+0000","last_undegraded":"2024-04-20T21:19:35.628809+0000","last_fullsized":"2024-04-20T21:19:35.628809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628201+0000","last_change":"2024-04-20T21:19:34.113755+0000","last_active":"2024-04-20T21:19:35.628201+0000","last_peered":"2024-04-20T21:19:35.628201+0000","last_clean":"2024-04-20T21:19:35.628201+0000","last_became_active":"2024-04-20T21:19:34.112491+0000","last_became_peered":"2024-04-20T21:19:34.112491+0000","last_unstale":"2024-04-20T21:19:35.628201+0000","last_undegraded":"2024-04-20T21:19:35.628201+0000","last_fullsized":"2024-04-20T21:19:35.628201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:34.563292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623247+0000","last_change":"2024-04-20T21:19:29.398876+0000","last_active":"2024-04-20T21:19:35.623247+0000","last_peered":"2024-04-20T21:19:35.623247+0000","last_clean":"2024-04-20T21:19:35.623247+0000","last_became_active":"2024-04-20T21:19:29.398650+0000","last_became_peered":"2024-04-20T21:19:29.398650+0000","last_unstale":"2024-04-20T21:19:35.623247+0000","last_undegraded":"2024-04-20T21:19:35.623247+0000","last_fullsized":"2024-04-20T21:19:35.623247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249435+0000","last_change":"2024-04-20T21:19:28.360068+0000","last_active":"2024-04-20T21:19:36.249435+0000","last_peered":"2024-04-20T21:19:36.249435+0000","last_clean":"2024-04-20T21:19:36.249435+0000","last_became_active":"2024-04-20T21:19:28.359752+0000","last_became_peered":"2024-04-20T21:19:28.359752+0000","last_unstale":"2024-04-20T21:19:36.249435+0000","last_undegraded":"2024-04-20T21:19:36.249435+0000","last_fullsized":"2024-04-20T21:19:36.249435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:45.962672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622011+0000","last_change":"2024-04-20T21:19:34.104484+0000","last_active":"2024-04-20T21:19:35.622011+0000","last_peered":"2024-04-20T21:19:35.622011+0000","last_clean":"2024-04-20T21:19:35.622011+0000","last_became_active":"2024-04-20T21:19:34.103724+0000","last_became_peered":"2024-04-20T21:19:34.103724+0000","last_unstale":"2024-04-20T21:19:35.622011+0000","last_undegraded":"2024-04-20T21:19:35.622011+0000","last_fullsized":"2024-04-20T21:19:35.622011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:46:20.508257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248977+0000","last_change":"2024-04-20T21:19:29.383418+0000","last_active":"2024-04-20T21:19:36.248977+0000","last_peered":"2024-04-20T21:19:36.248977+0000","last_clean":"2024-04-20T21:19:36.248977+0000","last_became_active":"2024-04-20T21:19:29.383070+0000","last_became_peered":"2024-04-20T21:19:29.383070+0000","last_unstale":"2024-04-20T21:19:36.248977+0000","last_undegraded":"2024-04-20T21:19:36.248977+0000","last_fullsized":"2024-04-20T21:19:36.248977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251419+0000","last_change":"2024-04-20T21:19:28.368850+0000","last_active":"2024-04-20T21:19:36.251419+0000","last_peered":"2024-04-20T21:19:36.251419+0000","last_clean":"2024-04-20T21:19:36.251419+0000","last_became_active":"2024-04-20T21:19:28.368537+0000","last_became_peered":"2024-04-20T21:19:28.368537+0000","last_unstale":"2024-04-20T21:19:36.251419+0000","last_undegraded":"2024-04-20T21:19:36.251419+0000","last_fullsized":"2024-04-20T21:19:36.251419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:39:59.354904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248012+0000","last_change":"2024-04-20T21:19:34.104458+0000","last_active":"2024-04-20T21:19:36.248012+0000","last_peered":"2024-04-20T21:19:36.248012+0000","last_clean":"2024-04-20T21:19:36.248012+0000","last_became_active":"2024-04-20T21:19:34.103757+0000","last_became_peered":"2024-04-20T21:19:34.103757+0000","last_unstale":"2024-04-20T21:19:36.248012+0000","last_undegraded":"2024-04-20T21:19:36.248012+0000","last_fullsized":"2024-04-20T21:19:36.248012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778559+0000","last_change":"2024-04-20T21:19:29.397580+0000","last_active":"2024-04-20T21:19:35.778559+0000","last_peered":"2024-04-20T21:19:35.778559+0000","last_clean":"2024-04-20T21:19:35.778559+0000","last_became_active":"2024-04-20T21:19:29.396682+0000","last_became_peered":"2024-04-20T21:19:29.396682+0000","last_unstale":"2024-04-20T21:19:35.778559+0000","last_undegraded":"2024-04-20T21:19:35.778559+0000","last_fullsized":"2024-04-20T21:19:35.778559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:30.291536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249055+0000","last_change":"2024-04-20T21:19:28.355329+0000","last_active":"2024-04-20T21:19:36.249055+0000","last_peered":"2024-04-20T21:19:36.249055+0000","last_clean":"2024-04-20T21:19:36.249055+0000","last_became_active":"2024-04-20T21:19:28.354650+0000","last_became_peered":"2024-04-20T21:19:28.354650+0000","last_unstale":"2024-04-20T21:19:36.249055+0000","last_undegraded":"2024-04-20T21:19:36.249055+0000","last_fullsized":"2024-04-20T21:19:36.249055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248349+0000","last_change":"2024-04-20T21:19:33.629808+0000","last_active":"2024-04-20T21:19:36.248349+0000","last_peered":"2024-04-20T21:19:36.248349+0000","last_clean":"2024-04-20T21:19:36.248349+0000","last_became_active":"2024-04-20T21:19:33.628655+0000","last_became_peered":"2024-04-20T21:19:33.628655+0000","last_unstale":"2024-04-20T21:19:36.248349+0000","last_undegraded":"2024-04-20T21:19:36.248349+0000","last_fullsized":"2024-04-20T21:19:36.248349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631211+0000","last_change":"2024-04-20T21:19:29.369139+0000","last_active":"2024-04-20T21:19:35.631211+0000","last_peered":"2024-04-20T21:19:35.631211+0000","last_clean":"2024-04-20T21:19:35.631211+0000","last_became_active":"2024-04-20T21:19:29.368508+0000","last_became_peered":"2024-04-20T21:19:29.368508+0000","last_unstale":"2024-04-20T21:19:35.631211+0000","last_undegraded":"2024-04-20T21:19:35.631211+0000","last_fullsized":"2024-04-20T21:19:35.631211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:50.979376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777730+0000","last_change":"2024-04-20T21:19:28.361884+0000","last_active":"2024-04-20T21:19:35.777730+0000","last_peered":"2024-04-20T21:19:35.777730+0000","last_clean":"2024-04-20T21:19:35.777730+0000","last_became_active":"2024-04-20T21:19:28.361455+0000","last_became_peered":"2024-04-20T21:19:28.361455+0000","last_unstale":"2024-04-20T21:19:35.777730+0000","last_undegraded":"2024-04-20T21:19:35.777730+0000","last_fullsized":"2024-04-20T21:19:35.777730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248902+0000","last_change":"2024-04-20T21:19:33.628385+0000","last_active":"2024-04-20T21:19:36.248902+0000","last_peered":"2024-04-20T21:19:36.248902+0000","last_clean":"2024-04-20T21:19:36.248902+0000","last_became_active":"2024-04-20T21:19:33.627925+0000","last_became_peered":"2024-04-20T21:19:33.627925+0000","last_unstale":"2024-04-20T21:19:36.248902+0000","last_undegraded":"2024-04-20T21:19:36.248902+0000","last_fullsized":"2024-04-20T21:19:36.248902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247403+0000","last_change":"2024-04-20T21:19:29.383757+0000","last_active":"2024-04-20T21:19:36.247403+0000","last_peered":"2024-04-20T21:19:36.247403+0000","last_clean":"2024-04-20T21:19:36.247403+0000","last_became_active":"2024-04-20T21:19:29.383265+0000","last_became_peered":"2024-04-20T21:19:29.383265+0000","last_unstale":"2024-04-20T21:19:36.247403+0000","last_undegraded":"2024-04-20T21:19:36.247403+0000","last_fullsized":"2024-04-20T21:19:36.247403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249184+0000","last_change":"2024-04-20T21:19:28.333272+0000","last_active":"2024-04-20T21:19:36.249184+0000","last_peered":"2024-04-20T21:19:36.249184+0000","last_clean":"2024-04-20T21:19:36.249184+0000","last_became_active":"2024-04-20T21:19:28.332869+0000","last_became_peered":"2024-04-20T21:19:28.332869+0000","last_unstale":"2024-04-20T21:19:36.249184+0000","last_undegraded":"2024-04-20T21:19:36.249184+0000","last_fullsized":"2024-04-20T21:19:36.249184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248513+0000","last_change":"2024-04-20T21:19:33.629923+0000","last_active":"2024-04-20T21:19:36.248513+0000","last_peered":"2024-04-20T21:19:36.248513+0000","last_clean":"2024-04-20T21:19:36.248513+0000","last_became_active":"2024-04-20T21:19:33.627690+0000","last_became_peered":"2024-04-20T21:19:33.627690+0000","last_unstale":"2024-04-20T21:19:36.248513+0000","last_undegraded":"2024-04-20T21:19:36.248513+0000","last_fullsized":"2024-04-20T21:19:36.248513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247676+0000","last_change":"2024-04-20T21:19:29.361370+0000","last_active":"2024-04-20T21:19:36.247676+0000","last_peered":"2024-04-20T21:19:36.247676+0000","last_clean":"2024-04-20T21:19:36.247676+0000","last_became_active":"2024-04-20T21:19:29.360654+0000","last_became_peered":"2024-04-20T21:19:29.360654+0000","last_unstale":"2024-04-20T21:19:36.247676+0000","last_undegraded":"2024-04-20T21:19:36.247676+0000","last_fullsized":"2024-04-20T21:19:36.247676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:08:35.086557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249697+0000","last_change":"2024-04-20T21:19:28.367397+0000","last_active":"2024-04-20T21:19:36.249697+0000","last_peered":"2024-04-20T21:19:36.249697+0000","last_clean":"2024-04-20T21:19:36.249697+0000","last_became_active":"2024-04-20T21:19:28.367133+0000","last_became_peered":"2024-04-20T21:19:28.367133+0000","last_unstale":"2024-04-20T21:19:36.249697+0000","last_undegraded":"2024-04-20T21:19:36.249697+0000","last_fullsized":"2024-04-20T21:19:36.249697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:18.220229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249641+0000","last_change":"2024-04-20T21:19:34.117121+0000","last_active":"2024-04-20T21:19:36.249641+0000","last_peered":"2024-04-20T21:19:36.249641+0000","last_clean":"2024-04-20T21:19:36.249641+0000","last_became_active":"2024-04-20T21:19:34.116147+0000","last_became_peered":"2024-04-20T21:19:34.116147+0000","last_unstale":"2024-04-20T21:19:36.249641+0000","last_undegraded":"2024-04-20T21:19:36.249641+0000","last_fullsized":"2024-04-20T21:19:36.249641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621863+0000","last_change":"2024-04-20T21:19:29.396033+0000","last_active":"2024-04-20T21:19:35.621863+0000","last_peered":"2024-04-20T21:19:35.621863+0000","last_clean":"2024-04-20T21:19:35.621863+0000","last_became_active":"2024-04-20T21:19:29.395741+0000","last_became_peered":"2024-04-20T21:19:29.395741+0000","last_unstale":"2024-04-20T21:19:35.621863+0000","last_undegraded":"2024-04-20T21:19:35.621863+0000","last_fullsized":"2024-04-20T21:19:35.621863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777536+0000","last_change":"2024-04-20T21:19:28.352100+0000","last_active":"2024-04-20T21:19:35.777536+0000","last_peered":"2024-04-20T21:19:35.777536+0000","last_clean":"2024-04-20T21:19:35.777536+0000","last_became_active":"2024-04-20T21:19:28.351795+0000","last_became_peered":"2024-04-20T21:19:28.351795+0000","last_unstale":"2024-04-20T21:19:35.777536+0000","last_undegraded":"2024-04-20T21:19:35.777536+0000","last_fullsized":"2024-04-20T21:19:35.777536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249911+0000","last_change":"2024-04-20T21:19:19.292405+0000","last_active":"2024-04-20T21:19:36.249911+0000","last_peered":"2024-04-20T21:19:36.249911+0000","last_clean":"2024-04-20T21:19:36.249911+0000","last_became_active":"2024-04-20T21:19:19.290107+0000","last_became_peered":"2024-04-20T21:19:19.290107+0000","last_unstale":"2024-04-20T21:19:36.249911+0000","last_undegraded":"2024-04-20T21:19:36.249911+0000","last_fullsized":"2024-04-20T21:19:36.249911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_clean_scrub_stamp":"2024-04-20T21:19:18.230829+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:48:44.146278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627341+0000","last_change":"2024-04-20T21:19:34.118317+0000","last_active":"2024-04-20T21:19:35.627341+0000","last_peered":"2024-04-20T21:19:35.627341+0000","last_clean":"2024-04-20T21:19:35.627341+0000","last_became_active":"2024-04-20T21:19:34.114435+0000","last_became_peered":"2024-04-20T21:19:34.114435+0000","last_unstale":"2024-04-20T21:19:35.627341+0000","last_undegraded":"2024-04-20T21:19:35.627341+0000","last_fullsized":"2024-04-20T21:19:35.627341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:11:00.818429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250762+0000","last_change":"2024-04-20T21:19:29.393324+0000","last_active":"2024-04-20T21:19:36.250762+0000","last_peered":"2024-04-20T21:19:36.250762+0000","last_clean":"2024-04-20T21:19:36.250762+0000","last_became_active":"2024-04-20T21:19:29.393007+0000","last_became_peered":"2024-04-20T21:19:29.393007+0000","last_unstale":"2024-04-20T21:19:36.250762+0000","last_undegraded":"2024-04-20T21:19:36.250762+0000","last_fullsized":"2024-04-20T21:19:36.250762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:30.291536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249830+0000","last_change":"2024-04-20T21:19:28.351503+0000","last_active":"2024-04-20T21:19:36.249830+0000","last_peered":"2024-04-20T21:19:36.249830+0000","last_clean":"2024-04-20T21:19:36.249830+0000","last_became_active":"2024-04-20T21:19:28.351160+0000","last_became_peered":"2024-04-20T21:19:28.351160+0000","last_unstale":"2024-04-20T21:19:36.249830+0000","last_undegraded":"2024-04-20T21:19:36.249830+0000","last_fullsized":"2024-04-20T21:19:36.249830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627263+0000","last_change":"2024-04-20T21:19:34.110398+0000","last_active":"2024-04-20T21:19:35.627263+0000","last_peered":"2024-04-20T21:19:35.627263+0000","last_clean":"2024-04-20T21:19:35.627263+0000","last_became_active":"2024-04-20T21:19:34.105383+0000","last_became_peered":"2024-04-20T21:19:34.105383+0000","last_unstale":"2024-04-20T21:19:35.627263+0000","last_undegraded":"2024-04-20T21:19:35.627263+0000","last_fullsized":"2024-04-20T21:19:35.627263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:25.396766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778001+0000","last_change":"2024-04-20T21:19:29.397544+0000","last_active":"2024-04-20T21:19:35.778001+0000","last_peered":"2024-04-20T21:19:35.778001+0000","last_clean":"2024-04-20T21:19:35.778001+0000","last_became_active":"2024-04-20T21:19:29.396795+0000","last_became_peered":"2024-04-20T21:19:29.396795+0000","last_unstale":"2024-04-20T21:19:35.778001+0000","last_undegraded":"2024-04-20T21:19:35.778001+0000","last_fullsized":"2024-04-20T21:19:35.778001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:31.354972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247918+0000","last_change":"2024-04-20T21:19:28.356719+0000","last_active":"2024-04-20T21:19:36.247918+0000","last_peered":"2024-04-20T21:19:36.247918+0000","last_clean":"2024-04-20T21:19:36.247918+0000","last_became_active":"2024-04-20T21:19:28.356151+0000","last_became_peered":"2024-04-20T21:19:28.356151+0000","last_unstale":"2024-04-20T21:19:36.247918+0000","last_undegraded":"2024-04-20T21:19:36.247918+0000","last_fullsized":"2024-04-20T21:19:36.247918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248274+0000","last_change":"2024-04-20T21:19:33.633098+0000","last_active":"2024-04-20T21:19:36.248274+0000","last_peered":"2024-04-20T21:19:36.248274+0000","last_clean":"2024-04-20T21:19:36.248274+0000","last_became_active":"2024-04-20T21:19:33.632668+0000","last_became_peered":"2024-04-20T21:19:33.632668+0000","last_unstale":"2024-04-20T21:19:36.248274+0000","last_undegraded":"2024-04-20T21:19:36.248274+0000","last_fullsized":"2024-04-20T21:19:36.248274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251856+0000","last_change":"2024-04-20T21:19:29.390579+0000","last_active":"2024-04-20T21:19:36.251856+0000","last_peered":"2024-04-20T21:19:36.251856+0000","last_clean":"2024-04-20T21:19:36.251856+0000","last_became_active":"2024-04-20T21:19:29.389845+0000","last_became_peered":"2024-04-20T21:19:29.389845+0000","last_unstale":"2024-04-20T21:19:36.251856+0000","last_undegraded":"2024-04-20T21:19:36.251856+0000","last_fullsized":"2024-04-20T21:19:36.251856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.785469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249746+0000","last_change":"2024-04-20T21:19:28.337225+0000","last_active":"2024-04-20T21:19:36.249746+0000","last_peered":"2024-04-20T21:19:36.249746+0000","last_clean":"2024-04-20T21:19:36.249746+0000","last_became_active":"2024-04-20T21:19:28.336562+0000","last_became_peered":"2024-04-20T21:19:28.336562+0000","last_unstale":"2024-04-20T21:19:36.249746+0000","last_undegraded":"2024-04-20T21:19:36.249746+0000","last_fullsized":"2024-04-20T21:19:36.249746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.776960+0000","last_change":"2024-04-20T21:19:34.106520+0000","last_active":"2024-04-20T21:19:35.776960+0000","last_peered":"2024-04-20T21:19:35.776960+0000","last_clean":"2024-04-20T21:19:35.776960+0000","last_became_active":"2024-04-20T21:19:34.105183+0000","last_became_peered":"2024-04-20T21:19:34.105183+0000","last_unstale":"2024-04-20T21:19:35.776960+0000","last_undegraded":"2024-04-20T21:19:35.776960+0000","last_fullsized":"2024-04-20T21:19:35.776960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251226+0000","last_change":"2024-04-20T21:19:29.388099+0000","last_active":"2024-04-20T21:19:36.251226+0000","last_peered":"2024-04-20T21:19:36.251226+0000","last_clean":"2024-04-20T21:19:36.251226+0000","last_became_active":"2024-04-20T21:19:29.387720+0000","last_became_peered":"2024-04-20T21:19:29.387720+0000","last_unstale":"2024-04-20T21:19:36.251226+0000","last_undegraded":"2024-04-20T21:19:36.251226+0000","last_fullsized":"2024-04-20T21:19:36.251226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:10:56.546673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630817+0000","last_change":"2024-04-20T21:19:28.351346+0000","last_active":"2024-04-20T21:19:35.630817+0000","last_peered":"2024-04-20T21:19:35.630817+0000","last_clean":"2024-04-20T21:19:35.630817+0000","last_became_active":"2024-04-20T21:19:28.350181+0000","last_became_peered":"2024-04-20T21:19:28.350181+0000","last_unstale":"2024-04-20T21:19:35.630817+0000","last_undegraded":"2024-04-20T21:19:35.630817+0000","last_fullsized":"2024-04-20T21:19:35.630817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:28:58.801546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627521+0000","last_change":"2024-04-20T21:19:33.633495+0000","last_active":"2024-04-20T21:19:35.627521+0000","last_peered":"2024-04-20T21:19:35.627521+0000","last_clean":"2024-04-20T21:19:35.627521+0000","last_became_active":"2024-04-20T21:19:33.632961+0000","last_became_peered":"2024-04-20T21:19:33.632961+0000","last_unstale":"2024-04-20T21:19:35.627521+0000","last_undegraded":"2024-04-20T21:19:35.627521+0000","last_fullsized":"2024-04-20T21:19:35.627521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:11:00.818429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249980+0000","last_change":"2024-04-20T21:19:29.386658+0000","last_active":"2024-04-20T21:19:36.249980+0000","last_peered":"2024-04-20T21:19:36.249980+0000","last_clean":"2024-04-20T21:19:36.249980+0000","last_became_active":"2024-04-20T21:19:29.385316+0000","last_became_peered":"2024-04-20T21:19:29.385316+0000","last_unstale":"2024-04-20T21:19:36.249980+0000","last_undegraded":"2024-04-20T21:19:36.249980+0000","last_fullsized":"2024-04-20T21:19:36.249980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248902+0000","last_change":"2024-04-20T21:19:28.346894+0000","last_active":"2024-04-20T21:19:36.248902+0000","last_peered":"2024-04-20T21:19:36.248902+0000","last_clean":"2024-04-20T21:19:36.248902+0000","last_became_active":"2024-04-20T21:19:28.346501+0000","last_became_peered":"2024-04-20T21:19:28.346501+0000","last_unstale":"2024-04-20T21:19:36.248902+0000","last_undegraded":"2024-04-20T21:19:36.248902+0000","last_fullsized":"2024-04-20T21:19:36.248902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249377+0000","last_change":"2024-04-20T21:19:33.624256+0000","last_active":"2024-04-20T21:19:36.249377+0000","last_peered":"2024-04-20T21:19:36.249377+0000","last_clean":"2024-04-20T21:19:36.249377+0000","last_became_active":"2024-04-20T21:19:33.623535+0000","last_became_peered":"2024-04-20T21:19:33.623535+0000","last_unstale":"2024-04-20T21:19:36.249377+0000","last_undegraded":"2024-04-20T21:19:36.249377+0000","last_fullsized":"2024-04-20T21:19:36.249377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626744+0000","last_change":"2024-04-20T21:19:29.365502+0000","last_active":"2024-04-20T21:19:35.626744+0000","last_peered":"2024-04-20T21:19:35.626744+0000","last_clean":"2024-04-20T21:19:35.626744+0000","last_became_active":"2024-04-20T21:19:29.364467+0000","last_became_peered":"2024-04-20T21:19:29.364467+0000","last_unstale":"2024-04-20T21:19:35.626744+0000","last_undegraded":"2024-04-20T21:19:35.626744+0000","last_fullsized":"2024-04-20T21:19:35.626744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626909+0000","last_change":"2024-04-20T21:19:28.344379+0000","last_active":"2024-04-20T21:19:35.626909+0000","last_peered":"2024-04-20T21:19:35.626909+0000","last_clean":"2024-04-20T21:19:35.626909+0000","last_became_active":"2024-04-20T21:19:28.343961+0000","last_became_peered":"2024-04-20T21:19:28.343961+0000","last_unstale":"2024-04-20T21:19:35.626909+0000","last_undegraded":"2024-04-20T21:19:35.626909+0000","last_fullsized":"2024-04-20T21:19:35.626909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623180+0000","last_change":"2024-04-20T21:19:34.117654+0000","last_active":"2024-04-20T21:19:35.623180+0000","last_peered":"2024-04-20T21:19:35.623180+0000","last_clean":"2024-04-20T21:19:35.623180+0000","last_became_active":"2024-04-20T21:19:34.116853+0000","last_became_peered":"2024-04-20T21:19:34.116853+0000","last_unstale":"2024-04-20T21:19:35.623180+0000","last_undegraded":"2024-04-20T21:19:35.623180+0000","last_fullsized":"2024-04-20T21:19:35.623180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:52:51.896627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250332+0000","last_change":"2024-04-20T21:19:29.382869+0000","last_active":"2024-04-20T21:19:36.250332+0000","last_peered":"2024-04-20T21:19:36.250332+0000","last_clean":"2024-04-20T21:19:36.250332+0000","last_became_active":"2024-04-20T21:19:29.382468+0000","last_became_peered":"2024-04-20T21:19:29.382468+0000","last_unstale":"2024-04-20T21:19:36.250332+0000","last_undegraded":"2024-04-20T21:19:36.250332+0000","last_fullsized":"2024-04-20T21:19:36.250332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:21.125011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777629+0000","last_change":"2024-04-20T21:19:28.357934+0000","last_active":"2024-04-20T21:19:35.777629+0000","last_peered":"2024-04-20T21:19:35.777629+0000","last_clean":"2024-04-20T21:19:35.777629+0000","last_became_active":"2024-04-20T21:19:28.357449+0000","last_became_peered":"2024-04-20T21:19:28.357449+0000","last_unstale":"2024-04-20T21:19:35.777629+0000","last_undegraded":"2024-04-20T21:19:35.777629+0000","last_fullsized":"2024-04-20T21:19:35.777629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622808+0000","last_change":"2024-04-20T21:19:34.105481+0000","last_active":"2024-04-20T21:19:35.622808+0000","last_peered":"2024-04-20T21:19:35.622808+0000","last_clean":"2024-04-20T21:19:35.622808+0000","last_became_active":"2024-04-20T21:19:34.104398+0000","last_became_peered":"2024-04-20T21:19:34.104398+0000","last_unstale":"2024-04-20T21:19:35.622808+0000","last_undegraded":"2024-04-20T21:19:35.622808+0000","last_fullsized":"2024-04-20T21:19:35.622808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:00:47.266412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248125+0000","last_change":"2024-04-20T21:19:29.387882+0000","last_active":"2024-04-20T21:19:36.248125+0000","last_peered":"2024-04-20T21:19:36.248125+0000","last_clean":"2024-04-20T21:19:36.248125+0000","last_became_active":"2024-04-20T21:19:29.387548+0000","last_became_peered":"2024-04-20T21:19:29.387548+0000","last_unstale":"2024-04-20T21:19:36.248125+0000","last_undegraded":"2024-04-20T21:19:36.248125+0000","last_fullsized":"2024-04-20T21:19:36.248125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:33:55.067533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248579+0000","last_change":"2024-04-20T21:19:28.350496+0000","last_active":"2024-04-20T21:19:36.248579+0000","last_peered":"2024-04-20T21:19:36.248579+0000","last_clean":"2024-04-20T21:19:36.248579+0000","last_became_active":"2024-04-20T21:19:28.350170+0000","last_became_peered":"2024-04-20T21:19:28.350170+0000","last_unstale":"2024-04-20T21:19:36.248579+0000","last_undegraded":"2024-04-20T21:19:36.248579+0000","last_fullsized":"2024-04-20T21:19:36.248579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:12:37.534140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778364+0000","last_change":"2024-04-20T21:19:34.117079+0000","last_active":"2024-04-20T21:19:35.778364+0000","last_peered":"2024-04-20T21:19:35.778364+0000","last_clean":"2024-04-20T21:19:35.778364+0000","last_became_active":"2024-04-20T21:19:34.116404+0000","last_became_peered":"2024-04-20T21:19:34.116404+0000","last_unstale":"2024-04-20T21:19:35.778364+0000","last_undegraded":"2024-04-20T21:19:35.778364+0000","last_fullsized":"2024-04-20T21:19:35.778364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:26:28.450644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250605+0000","last_change":"2024-04-20T21:19:29.378275+0000","last_active":"2024-04-20T21:19:36.250605+0000","last_peered":"2024-04-20T21:19:36.250605+0000","last_clean":"2024-04-20T21:19:36.250605+0000","last_became_active":"2024-04-20T21:19:29.377896+0000","last_became_peered":"2024-04-20T21:19:29.377896+0000","last_unstale":"2024-04-20T21:19:36.250605+0000","last_undegraded":"2024-04-20T21:19:36.250605+0000","last_fullsized":"2024-04-20T21:19:36.250605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:18:33.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:41.372651+0000","last_change":"2024-04-20T21:19:28.357217+0000","last_active":"2024-04-20T21:19:41.372651+0000","last_peered":"2024-04-20T21:19:41.372651+0000","last_clean":"2024-04-20T21:19:41.372651+0000","last_became_active":"2024-04-20T21:19:28.356914+0000","last_became_peered":"2024-04-20T21:19:28.356914+0000","last_unstale":"2024-04-20T21:19:41.372651+0000","last_undegraded":"2024-04-20T21:19:41.372651+0000","last_fullsized":"2024-04-20T21:19:41.372651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248585+0000","last_change":"2024-04-20T21:19:33.629911+0000","last_active":"2024-04-20T21:19:36.248585+0000","last_peered":"2024-04-20T21:19:36.248585+0000","last_clean":"2024-04-20T21:19:36.248585+0000","last_became_active":"2024-04-20T21:19:33.627809+0000","last_became_peered":"2024-04-20T21:19:33.627809+0000","last_unstale":"2024-04-20T21:19:36.248585+0000","last_undegraded":"2024-04-20T21:19:36.248585+0000","last_fullsized":"2024-04-20T21:19:36.248585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631585+0000","last_change":"2024-04-20T21:19:29.393393+0000","last_active":"2024-04-20T21:19:35.631585+0000","last_peered":"2024-04-20T21:19:35.631585+0000","last_clean":"2024-04-20T21:19:35.631585+0000","last_became_active":"2024-04-20T21:19:29.390071+0000","last_became_peered":"2024-04-20T21:19:29.390071+0000","last_unstale":"2024-04-20T21:19:35.631585+0000","last_undegraded":"2024-04-20T21:19:35.631585+0000","last_fullsized":"2024-04-20T21:19:35.631585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:46.967851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247809+0000","last_change":"2024-04-20T21:19:28.356567+0000","last_active":"2024-04-20T21:19:36.247809+0000","last_peered":"2024-04-20T21:19:36.247809+0000","last_clean":"2024-04-20T21:19:36.247809+0000","last_became_active":"2024-04-20T21:19:28.355822+0000","last_became_peered":"2024-04-20T21:19:28.355822+0000","last_unstale":"2024-04-20T21:19:36.247809+0000","last_undegraded":"2024-04-20T21:19:36.247809+0000","last_fullsized":"2024-04-20T21:19:36.247809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630778+0000","last_change":"2024-04-20T21:19:33.630542+0000","last_active":"2024-04-20T21:19:35.630778+0000","last_peered":"2024-04-20T21:19:35.630778+0000","last_clean":"2024-04-20T21:19:35.630778+0000","last_became_active":"2024-04-20T21:19:33.630162+0000","last_became_peered":"2024-04-20T21:19:33.630162+0000","last_unstale":"2024-04-20T21:19:35.630778+0000","last_undegraded":"2024-04-20T21:19:35.630778+0000","last_fullsized":"2024-04-20T21:19:35.630778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250252+0000","last_change":"2024-04-20T21:19:29.381811+0000","last_active":"2024-04-20T21:19:36.250252+0000","last_peered":"2024-04-20T21:19:36.250252+0000","last_clean":"2024-04-20T21:19:36.250252+0000","last_became_active":"2024-04-20T21:19:29.381476+0000","last_became_peered":"2024-04-20T21:19:29.381476+0000","last_unstale":"2024-04-20T21:19:36.250252+0000","last_undegraded":"2024-04-20T21:19:36.250252+0000","last_fullsized":"2024-04-20T21:19:36.250252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778382+0000","last_change":"2024-04-20T21:19:28.362269+0000","last_active":"2024-04-20T21:19:35.778382+0000","last_peered":"2024-04-20T21:19:35.778382+0000","last_clean":"2024-04-20T21:19:35.778382+0000","last_became_active":"2024-04-20T21:19:28.361977+0000","last_became_peered":"2024-04-20T21:19:28.361977+0000","last_unstale":"2024-04-20T21:19:35.778382+0000","last_undegraded":"2024-04-20T21:19:35.778382+0000","last_fullsized":"2024-04-20T21:19:35.778382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621838+0000","last_change":"2024-04-20T21:19:33.628173+0000","last_active":"2024-04-20T21:19:35.621838+0000","last_peered":"2024-04-20T21:19:35.621838+0000","last_clean":"2024-04-20T21:19:35.621838+0000","last_became_active":"2024-04-20T21:19:33.627775+0000","last_became_peered":"2024-04-20T21:19:33.627775+0000","last_unstale":"2024-04-20T21:19:35.621838+0000","last_undegraded":"2024-04-20T21:19:35.621838+0000","last_fullsized":"2024-04-20T21:19:35.621838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:10:39.630401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778156+0000","last_change":"2024-04-20T21:19:29.395176+0000","last_active":"2024-04-20T21:19:35.778156+0000","last_peered":"2024-04-20T21:19:35.778156+0000","last_clean":"2024-04-20T21:19:35.778156+0000","last_became_active":"2024-04-20T21:19:29.394888+0000","last_became_peered":"2024-04-20T21:19:29.394888+0000","last_unstale":"2024-04-20T21:19:35.778156+0000","last_undegraded":"2024-04-20T21:19:35.778156+0000","last_fullsized":"2024-04-20T21:19:35.778156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:04:32.875201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628548+0000","last_change":"2024-04-20T21:19:28.365114+0000","last_active":"2024-04-20T21:19:35.628548+0000","last_peered":"2024-04-20T21:19:35.628548+0000","last_clean":"2024-04-20T21:19:35.628548+0000","last_became_active":"2024-04-20T21:19:28.364582+0000","last_became_peered":"2024-04-20T21:19:28.364582+0000","last_unstale":"2024-04-20T21:19:35.628548+0000","last_undegraded":"2024-04-20T21:19:35.628548+0000","last_fullsized":"2024-04-20T21:19:35.628548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622261+0000","last_change":"2024-04-20T21:19:34.106093+0000","last_active":"2024-04-20T21:19:35.622261+0000","last_peered":"2024-04-20T21:19:35.622261+0000","last_clean":"2024-04-20T21:19:35.622261+0000","last_became_active":"2024-04-20T21:19:34.104164+0000","last_became_peered":"2024-04-20T21:19:34.104164+0000","last_unstale":"2024-04-20T21:19:35.622261+0000","last_undegraded":"2024-04-20T21:19:35.622261+0000","last_fullsized":"2024-04-20T21:19:35.622261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:59:46.407601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249367+0000","last_change":"2024-04-20T21:19:34.114115+0000","last_active":"2024-04-20T21:19:36.249367+0000","last_peered":"2024-04-20T21:19:36.249367+0000","last_clean":"2024-04-20T21:19:36.249367+0000","last_became_active":"2024-04-20T21:19:34.113101+0000","last_became_peered":"2024-04-20T21:19:34.113101+0000","last_unstale":"2024-04-20T21:19:36.249367+0000","last_undegraded":"2024-04-20T21:19:36.249367+0000","last_fullsized":"2024-04-20T21:19:36.249367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247565+0000","last_change":"2024-04-20T21:19:29.393883+0000","last_active":"2024-04-20T21:19:36.247565+0000","last_peered":"2024-04-20T21:19:36.247565+0000","last_clean":"2024-04-20T21:19:36.247565+0000","last_became_active":"2024-04-20T21:19:29.386937+0000","last_became_peered":"2024-04-20T21:19:29.386937+0000","last_unstale":"2024-04-20T21:19:36.247565+0000","last_undegraded":"2024-04-20T21:19:36.247565+0000","last_fullsized":"2024-04-20T21:19:36.247565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777355+0000","last_change":"2024-04-20T21:19:28.354817+0000","last_active":"2024-04-20T21:19:35.777355+0000","last_peered":"2024-04-20T21:19:35.777355+0000","last_clean":"2024-04-20T21:19:35.777355+0000","last_became_active":"2024-04-20T21:19:28.354434+0000","last_became_peered":"2024-04-20T21:19:28.354434+0000","last_unstale":"2024-04-20T21:19:35.777355+0000","last_undegraded":"2024-04-20T21:19:35.777355+0000","last_fullsized":"2024-04-20T21:19:35.777355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628259+0000","last_change":"2024-04-20T21:19:33.633277+0000","last_active":"2024-04-20T21:19:35.628259+0000","last_peered":"2024-04-20T21:19:35.628259+0000","last_clean":"2024-04-20T21:19:35.628259+0000","last_became_active":"2024-04-20T21:19:33.632836+0000","last_became_peered":"2024-04-20T21:19:33.632836+0000","last_unstale":"2024-04-20T21:19:35.628259+0000","last_undegraded":"2024-04-20T21:19:35.628259+0000","last_fullsized":"2024-04-20T21:19:35.628259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:34.563292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621917+0000","last_change":"2024-04-20T21:19:29.398015+0000","last_active":"2024-04-20T21:19:35.621917+0000","last_peered":"2024-04-20T21:19:35.621917+0000","last_clean":"2024-04-20T21:19:35.621917+0000","last_became_active":"2024-04-20T21:19:29.395864+0000","last_became_peered":"2024-04-20T21:19:29.395864+0000","last_unstale":"2024-04-20T21:19:35.621917+0000","last_undegraded":"2024-04-20T21:19:35.621917+0000","last_fullsized":"2024-04-20T21:19:35.621917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622466+0000","last_change":"2024-04-20T21:19:28.344162+0000","last_active":"2024-04-20T21:19:35.622466+0000","last_peered":"2024-04-20T21:19:35.622466+0000","last_clean":"2024-04-20T21:19:35.622466+0000","last_became_active":"2024-04-20T21:19:28.343750+0000","last_became_peered":"2024-04-20T21:19:28.343750+0000","last_unstale":"2024-04-20T21:19:35.622466+0000","last_undegraded":"2024-04-20T21:19:35.622466+0000","last_fullsized":"2024-04-20T21:19:35.622466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627612+0000","last_change":"2024-04-20T21:19:28.351320+0000","last_active":"2024-04-20T21:19:35.627612+0000","last_peered":"2024-04-20T21:19:35.627612+0000","last_clean":"2024-04-20T21:19:35.627612+0000","last_became_active":"2024-04-20T21:19:28.350995+0000","last_became_peered":"2024-04-20T21:19:28.350995+0000","last_unstale":"2024-04-20T21:19:35.627612+0000","last_undegraded":"2024-04-20T21:19:35.627612+0000","last_fullsized":"2024-04-20T21:19:35.627612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248483+0000","last_change":"2024-04-20T21:19:29.362059+0000","last_active":"2024-04-20T21:19:36.248483+0000","last_peered":"2024-04-20T21:19:36.248483+0000","last_clean":"2024-04-20T21:19:36.248483+0000","last_became_active":"2024-04-20T21:19:29.361382+0000","last_became_peered":"2024-04-20T21:19:29.361382+0000","last_unstale":"2024-04-20T21:19:36.248483+0000","last_undegraded":"2024-04-20T21:19:36.248483+0000","last_fullsized":"2024-04-20T21:19:36.248483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249695+0000","last_change":"2024-04-20T21:19:33.628104+0000","last_active":"2024-04-20T21:19:36.249695+0000","last_peered":"2024-04-20T21:19:36.249695+0000","last_clean":"2024-04-20T21:19:36.249695+0000","last_became_active":"2024-04-20T21:19:33.627676+0000","last_became_peered":"2024-04-20T21:19:33.627676+0000","last_unstale":"2024-04-20T21:19:36.249695+0000","last_undegraded":"2024-04-20T21:19:36.249695+0000","last_fullsized":"2024-04-20T21:19:36.249695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:08:39.358313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622581+0000","last_change":"2024-04-20T21:19:28.365916+0000","last_active":"2024-04-20T21:19:35.622581+0000","last_peered":"2024-04-20T21:19:35.622581+0000","last_clean":"2024-04-20T21:19:35.622581+0000","last_became_active":"2024-04-20T21:19:28.365502+0000","last_became_peered":"2024-04-20T21:19:28.365502+0000","last_unstale":"2024-04-20T21:19:35.622581+0000","last_undegraded":"2024-04-20T21:19:35.622581+0000","last_fullsized":"2024-04-20T21:19:35.622581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629989+0000","last_change":"2024-04-20T21:19:29.387418+0000","last_active":"2024-04-20T21:19:35.629989+0000","last_peered":"2024-04-20T21:19:35.629989+0000","last_clean":"2024-04-20T21:19:35.629989+0000","last_became_active":"2024-04-20T21:19:29.387044+0000","last_became_peered":"2024-04-20T21:19:29.387044+0000","last_unstale":"2024-04-20T21:19:35.629989+0000","last_undegraded":"2024-04-20T21:19:35.629989+0000","last_fullsized":"2024-04-20T21:19:35.629989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:29.867631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622991+0000","last_change":"2024-04-20T21:19:33.633365+0000","last_active":"2024-04-20T21:19:35.622991+0000","last_peered":"2024-04-20T21:19:35.622991+0000","last_clean":"2024-04-20T21:19:35.622991+0000","last_became_active":"2024-04-20T21:19:33.631294+0000","last_became_peered":"2024-04-20T21:19:33.631294+0000","last_unstale":"2024-04-20T21:19:35.622991+0000","last_undegraded":"2024-04-20T21:19:35.622991+0000","last_fullsized":"2024-04-20T21:19:35.622991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:44.969195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626471+0000","last_change":"2024-04-20T21:19:29.374532+0000","last_active":"2024-04-20T21:19:35.626471+0000","last_peered":"2024-04-20T21:19:35.626471+0000","last_clean":"2024-04-20T21:19:35.626471+0000","last_became_active":"2024-04-20T21:19:29.370664+0000","last_became_peered":"2024-04-20T21:19:29.370664+0000","last_unstale":"2024-04-20T21:19:35.626471+0000","last_undegraded":"2024-04-20T21:19:35.626471+0000","last_fullsized":"2024-04-20T21:19:35.626471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249094+0000","last_change":"2024-04-20T21:19:29.391603+0000","last_active":"2024-04-20T21:19:36.249094+0000","last_peered":"2024-04-20T21:19:36.249094+0000","last_clean":"2024-04-20T21:19:36.249094+0000","last_became_active":"2024-04-20T21:19:29.391336+0000","last_became_peered":"2024-04-20T21:19:29.391336+0000","last_unstale":"2024-04-20T21:19:36.249094+0000","last_undegraded":"2024-04-20T21:19:36.249094+0000","last_fullsized":"2024-04-20T21:19:36.249094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:40:00.360083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777450+0000","last_change":"2024-04-20T21:19:29.397118+0000","last_active":"2024-04-20T21:19:35.777450+0000","last_peered":"2024-04-20T21:19:35.777450+0000","last_clean":"2024-04-20T21:19:35.777450+0000","last_became_active":"2024-04-20T21:19:29.396809+0000","last_became_peered":"2024-04-20T21:19:29.396809+0000","last_unstale":"2024-04-20T21:19:35.777450+0000","last_undegraded":"2024-04-20T21:19:35.777450+0000","last_fullsized":"2024-04-20T21:19:35.777450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248383+0000","last_change":"2024-04-20T21:19:29.380740+0000","last_active":"2024-04-20T21:19:36.248383+0000","last_peered":"2024-04-20T21:19:36.248383+0000","last_clean":"2024-04-20T21:19:36.248383+0000","last_became_active":"2024-04-20T21:19:29.378870+0000","last_became_peered":"2024-04-20T21:19:29.378870+0000","last_unstale":"2024-04-20T21:19:36.248383+0000","last_undegraded":"2024-04-20T21:19:36.248383+0000","last_fullsized":"2024-04-20T21:19:36.248383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622922+0000","last_change":"2024-04-20T21:19:29.376821+0000","last_active":"2024-04-20T21:19:35.622922+0000","last_peered":"2024-04-20T21:19:35.622922+0000","last_clean":"2024-04-20T21:19:35.622922+0000","last_became_active":"2024-04-20T21:19:29.372264+0000","last_became_peered":"2024-04-20T21:19:29.372264+0000","last_unstale":"2024-04-20T21:19:35.622922+0000","last_undegraded":"2024-04-20T21:19:35.622922+0000","last_fullsized":"2024-04-20T21:19:35.622922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247633+0000","last_change":"2024-04-20T21:19:29.380388+0000","last_active":"2024-04-20T21:19:36.247633+0000","last_peered":"2024-04-20T21:19:36.247633+0000","last_clean":"2024-04-20T21:19:36.247633+0000","last_became_active":"2024-04-20T21:19:29.380055+0000","last_became_peered":"2024-04-20T21:19:29.380055+0000","last_unstale":"2024-04-20T21:19:36.247633+0000","last_undegraded":"2024-04-20T21:19:36.247633+0000","last_fullsized":"2024-04-20T21:19:36.247633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628752+0000","last_change":"2024-04-20T21:19:29.392961+0000","last_active":"2024-04-20T21:19:35.628752+0000","last_peered":"2024-04-20T21:19:35.628752+0000","last_clean":"2024-04-20T21:19:35.628752+0000","last_became_active":"2024-04-20T21:19:29.392692+0000","last_became_peered":"2024-04-20T21:19:29.392692+0000","last_unstale":"2024-04-20T21:19:35.628752+0000","last_undegraded":"2024-04-20T21:19:35.628752+0000","last_fullsized":"2024-04-20T21:19:35.628752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623208+0000","last_change":"2024-04-20T21:19:29.380591+0000","last_active":"2024-04-20T21:19:35.623208+0000","last_peered":"2024-04-20T21:19:35.623208+0000","last_clean":"2024-04-20T21:19:35.623208+0000","last_became_active":"2024-04-20T21:19:29.380070+0000","last_became_peered":"2024-04-20T21:19:29.380070+0000","last_unstale":"2024-04-20T21:19:35.623208+0000","last_undegraded":"2024-04-20T21:19:35.623208+0000","last_fullsized":"2024-04-20T21:19:35.623208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:04:32.875201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777341+0000","last_change":"2024-04-20T21:19:29.384690+0000","last_active":"2024-04-20T21:19:35.777341+0000","last_peered":"2024-04-20T21:19:35.777341+0000","last_clean":"2024-04-20T21:19:35.777341+0000","last_became_active":"2024-04-20T21:19:29.383536+0000","last_became_peered":"2024-04-20T21:19:29.383536+0000","last_unstale":"2024-04-20T21:19:35.777341+0000","last_undegraded":"2024-04-20T21:19:35.777341+0000","last_fullsized":"2024-04-20T21:19:35.777341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622322+0000","last_change":"2024-04-20T21:19:29.380657+0000","last_active":"2024-04-20T21:19:35.622322+0000","last_peered":"2024-04-20T21:19:35.622322+0000","last_clean":"2024-04-20T21:19:35.622322+0000","last_became_active":"2024-04-20T21:19:29.380107+0000","last_became_peered":"2024-04-20T21:19:29.380107+0000","last_unstale":"2024-04-20T21:19:35.622322+0000","last_undegraded":"2024-04-20T21:19:35.622322+0000","last_fullsized":"2024-04-20T21:19:35.622322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777381+0000","last_change":"2024-04-20T21:19:29.388441+0000","last_active":"2024-04-20T21:19:35.777381+0000","last_peered":"2024-04-20T21:19:35.777381+0000","last_clean":"2024-04-20T21:19:35.777381+0000","last_became_active":"2024-04-20T21:19:29.388153+0000","last_became_peered":"2024-04-20T21:19:29.388153+0000","last_unstale":"2024-04-20T21:19:35.777381+0000","last_undegraded":"2024-04-20T21:19:35.777381+0000","last_fullsized":"2024-04-20T21:19:35.777381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:24:23.709381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248119+0000","last_change":"2024-04-20T21:19:29.381637+0000","last_active":"2024-04-20T21:19:36.248119+0000","last_peered":"2024-04-20T21:19:36.248119+0000","last_clean":"2024-04-20T21:19:36.248119+0000","last_became_active":"2024-04-20T21:19:29.380117+0000","last_became_peered":"2024-04-20T21:19:29.380117+0000","last_unstale":"2024-04-20T21:19:36.248119+0000","last_undegraded":"2024-04-20T21:19:36.248119+0000","last_fullsized":"2024-04-20T21:19:36.248119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628156+0000","last_change":"2024-04-20T21:19:29.371702+0000","last_active":"2024-04-20T21:19:35.628156+0000","last_peered":"2024-04-20T21:19:35.628156+0000","last_clean":"2024-04-20T21:19:35.628156+0000","last_became_active":"2024-04-20T21:19:29.371414+0000","last_became_peered":"2024-04-20T21:19:29.371414+0000","last_unstale":"2024-04-20T21:19:35.628156+0000","last_undegraded":"2024-04-20T21:19:35.628156+0000","last_fullsized":"2024-04-20T21:19:35.628156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251098+0000","last_change":"2024-04-20T21:19:29.389612+0000","last_active":"2024-04-20T21:19:36.251098+0000","last_peered":"2024-04-20T21:19:36.251098+0000","last_clean":"2024-04-20T21:19:36.251098+0000","last_became_active":"2024-04-20T21:19:29.389324+0000","last_became_peered":"2024-04-20T21:19:29.389324+0000","last_unstale":"2024-04-20T21:19:36.251098+0000","last_undegraded":"2024-04-20T21:19:36.251098+0000","last_fullsized":"2024-04-20T21:19:36.251098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:33.262857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249637+0000","last_change":"2024-04-20T21:19:29.382113+0000","last_active":"2024-04-20T21:19:36.249637+0000","last_peered":"2024-04-20T21:19:36.249637+0000","last_clean":"2024-04-20T21:19:36.249637+0000","last_became_active":"2024-04-20T21:19:29.381256+0000","last_became_peered":"2024-04-20T21:19:29.381256+0000","last_unstale":"2024-04-20T21:19:36.249637+0000","last_undegraded":"2024-04-20T21:19:36.249637+0000","last_fullsized":"2024-04-20T21:19:36.249637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:03:39.489134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778694+0000","last_change":"2024-04-20T21:19:29.395827+0000","last_active":"2024-04-20T21:19:35.778694+0000","last_peered":"2024-04-20T21:19:35.778694+0000","last_clean":"2024-04-20T21:19:35.778694+0000","last_became_active":"2024-04-20T21:19:29.395560+0000","last_became_peered":"2024-04-20T21:19:29.395560+0000","last_unstale":"2024-04-20T21:19:35.778694+0000","last_undegraded":"2024-04-20T21:19:35.778694+0000","last_fullsized":"2024-04-20T21:19:35.778694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:27:55.214090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.776970+0000","last_change":"2024-04-20T21:19:29.389510+0000","last_active":"2024-04-20T21:19:35.776970+0000","last_peered":"2024-04-20T21:19:35.776970+0000","last_clean":"2024-04-20T21:19:35.776970+0000","last_became_active":"2024-04-20T21:19:29.389143+0000","last_became_peered":"2024-04-20T21:19:29.389143+0000","last_unstale":"2024-04-20T21:19:35.776970+0000","last_undegraded":"2024-04-20T21:19:35.776970+0000","last_fullsized":"2024-04-20T21:19:35.776970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249525+0000","last_change":"2024-04-20T21:19:29.374703+0000","last_active":"2024-04-20T21:19:36.249525+0000","last_peered":"2024-04-20T21:19:36.249525+0000","last_clean":"2024-04-20T21:19:36.249525+0000","last_became_active":"2024-04-20T21:19:29.374027+0000","last_became_peered":"2024-04-20T21:19:29.374027+0000","last_unstale":"2024-04-20T21:19:36.249525+0000","last_undegraded":"2024-04-20T21:19:36.249525+0000","last_fullsized":"2024-04-20T21:19:36.249525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248059+0000","last_change":"2024-04-20T21:19:29.377330+0000","last_active":"2024-04-20T21:19:36.248059+0000","last_peered":"2024-04-20T21:19:36.248059+0000","last_clean":"2024-04-20T21:19:36.248059+0000","last_became_active":"2024-04-20T21:19:29.377054+0000","last_became_peered":"2024-04-20T21:19:29.377054+0000","last_unstale":"2024-04-20T21:19:36.248059+0000","last_undegraded":"2024-04-20T21:19:36.248059+0000","last_fullsized":"2024-04-20T21:19:36.248059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621838+0000","last_change":"2024-04-20T21:19:29.379509+0000","last_active":"2024-04-20T21:19:35.621838+0000","last_peered":"2024-04-20T21:19:35.621838+0000","last_clean":"2024-04-20T21:19:35.621838+0000","last_became_active":"2024-04-20T21:19:29.379077+0000","last_became_peered":"2024-04-20T21:19:29.379077+0000","last_unstale":"2024-04-20T21:19:35.621838+0000","last_undegraded":"2024-04-20T21:19:35.621838+0000","last_fullsized":"2024-04-20T21:19:35.621838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631470+0000","last_change":"2024-04-20T21:19:29.371610+0000","last_active":"2024-04-20T21:19:35.631470+0000","last_peered":"2024-04-20T21:19:35.631470+0000","last_clean":"2024-04-20T21:19:35.631470+0000","last_became_active":"2024-04-20T21:19:29.371194+0000","last_became_peered":"2024-04-20T21:19:29.371194+0000","last_unstale":"2024-04-20T21:19:35.631470+0000","last_undegraded":"2024-04-20T21:19:35.631470+0000","last_fullsized":"2024-04-20T21:19:35.631470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:19.225408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627705+0000","last_change":"2024-04-20T21:19:29.381261+0000","last_active":"2024-04-20T21:19:35.627705+0000","last_peered":"2024-04-20T21:19:35.627705+0000","last_clean":"2024-04-20T21:19:35.627705+0000","last_became_active":"2024-04-20T21:19:29.380856+0000","last_became_peered":"2024-04-20T21:19:29.380856+0000","last_unstale":"2024-04-20T21:19:35.627705+0000","last_undegraded":"2024-04-20T21:19:35.627705+0000","last_fullsized":"2024-04-20T21:19:35.627705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628482+0000","last_change":"2024-04-20T21:19:29.388748+0000","last_active":"2024-04-20T21:19:35.628482+0000","last_peered":"2024-04-20T21:19:35.628482+0000","last_clean":"2024-04-20T21:19:35.628482+0000","last_became_active":"2024-04-20T21:19:29.388227+0000","last_became_peered":"2024-04-20T21:19:29.388227+0000","last_unstale":"2024-04-20T21:19:35.628482+0000","last_undegraded":"2024-04-20T21:19:35.628482+0000","last_fullsized":"2024-04-20T21:19:35.628482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251764+0000","last_change":"2024-04-20T21:19:29.392148+0000","last_active":"2024-04-20T21:19:36.251764+0000","last_peered":"2024-04-20T21:19:36.251764+0000","last_clean":"2024-04-20T21:19:36.251764+0000","last_became_active":"2024-04-20T21:19:29.391719+0000","last_became_peered":"2024-04-20T21:19:29.391719+0000","last_unstale":"2024-04-20T21:19:36.251764+0000","last_undegraded":"2024-04-20T21:19:36.251764+0000","last_fullsized":"2024-04-20T21:19:36.251764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:31.354972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621658+0000","last_change":"2024-04-20T21:19:29.401358+0000","last_active":"2024-04-20T21:19:35.621658+0000","last_peered":"2024-04-20T21:19:35.621658+0000","last_clean":"2024-04-20T21:19:35.621658+0000","last_became_active":"2024-04-20T21:19:29.401015+0000","last_became_peered":"2024-04-20T21:19:29.401015+0000","last_unstale":"2024-04-20T21:19:35.621658+0000","last_undegraded":"2024-04-20T21:19:35.621658+0000","last_fullsized":"2024-04-20T21:19:35.621658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249862+0000","last_change":"2024-04-20T21:19:29.378374+0000","last_active":"2024-04-20T21:19:36.249862+0000","last_peered":"2024-04-20T21:19:36.249862+0000","last_clean":"2024-04-20T21:19:36.249862+0000","last_became_active":"2024-04-20T21:19:29.377992+0000","last_became_peered":"2024-04-20T21:19:29.377992+0000","last_unstale":"2024-04-20T21:19:36.249862+0000","last_undegraded":"2024-04-20T21:19:36.249862+0000","last_fullsized":"2024-04-20T21:19:36.249862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:01:25.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777114+0000","last_change":"2024-04-20T21:19:29.388283+0000","last_active":"2024-04-20T21:19:35.777114+0000","last_peered":"2024-04-20T21:19:35.777114+0000","last_clean":"2024-04-20T21:19:35.777114+0000","last_became_active":"2024-04-20T21:19:29.386243+0000","last_became_peered":"2024-04-20T21:19:29.386243+0000","last_unstale":"2024-04-20T21:19:35.777114+0000","last_undegraded":"2024-04-20T21:19:35.777114+0000","last_fullsized":"2024-04-20T21:19:35.777114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249862+0000","last_change":"2024-04-20T21:19:29.387887+0000","last_active":"2024-04-20T21:19:36.249862+0000","last_peered":"2024-04-20T21:19:36.249862+0000","last_clean":"2024-04-20T21:19:36.249862+0000","last_became_active":"2024-04-20T21:19:29.387481+0000","last_became_peered":"2024-04-20T21:19:29.387481+0000","last_unstale":"2024-04-20T21:19:36.249862+0000","last_undegraded":"2024-04-20T21:19:36.249862+0000","last_fullsized":"2024-04-20T21:19:36.249862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:27:55.214090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777684+0000","last_change":"2024-04-20T21:19:29.397568+0000","last_active":"2024-04-20T21:19:35.777684+0000","last_peered":"2024-04-20T21:19:35.777684+0000","last_clean":"2024-04-20T21:19:35.777684+0000","last_became_active":"2024-04-20T21:19:29.397258+0000","last_became_peered":"2024-04-20T21:19:29.397258+0000","last_unstale":"2024-04-20T21:19:35.777684+0000","last_undegraded":"2024-04-20T21:19:35.777684+0000","last_fullsized":"2024-04-20T21:19:35.777684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:01:25.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249144+0000","last_change":"2024-04-20T21:19:29.391755+0000","last_active":"2024-04-20T21:19:36.249144+0000","last_peered":"2024-04-20T21:19:36.249144+0000","last_clean":"2024-04-20T21:19:36.249144+0000","last_became_active":"2024-04-20T21:19:29.389939+0000","last_became_peered":"2024-04-20T21:19:29.389939+0000","last_unstale":"2024-04-20T21:19:36.249144+0000","last_undegraded":"2024-04-20T21:19:36.249144+0000","last_fullsized":"2024-04-20T21:19:36.249144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249430+0000","last_change":"2024-04-20T21:19:29.383237+0000","last_active":"2024-04-20T21:19:36.249430+0000","last_peered":"2024-04-20T21:19:36.249430+0000","last_clean":"2024-04-20T21:19:36.249430+0000","last_became_active":"2024-04-20T21:19:29.382910+0000","last_became_peered":"2024-04-20T21:19:29.382910+0000","last_unstale":"2024-04-20T21:19:36.249430+0000","last_undegraded":"2024-04-20T21:19:36.249430+0000","last_fullsized":"2024-04-20T21:19:36.249430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251604+0000","last_change":"2024-04-20T21:19:29.382459+0000","last_active":"2024-04-20T21:19:36.251604+0000","last_peered":"2024-04-20T21:19:36.251604+0000","last_clean":"2024-04-20T21:19:36.251604+0000","last_became_active":"2024-04-20T21:19:29.382142+0000","last_became_peered":"2024-04-20T21:19:29.382142+0000","last_unstale":"2024-04-20T21:19:36.251604+0000","last_undegraded":"2024-04-20T21:19:36.251604+0000","last_fullsized":"2024-04-20T21:19:36.251604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:01.897496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T21:19:53.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T21:19:53.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.329+0000 7f8e13e00640 1 Processor -- start 2024-04-20T21:19:53.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.329+0000 7f8e13e00640 1 -- start start 2024-04-20T21:19:53.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.331+0000 7f8e13e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8e1415a7b0 0x7f8e1406da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.331+0000 7f8e13e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406dfd0 0x7f8e1406c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.331+0000 7f8e13e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8e1406cea0 0x7f8e14071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.331+0000 7f8e13e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8e140b50a0 con 0x7f8e1415a7b0 2024-04-20T21:19:53.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.331+0000 7f8e13e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8e1406b900 con 0x7f8e1406cea0 2024-04-20T21:19:53.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.331+0000 7f8e13e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1406bba0 con 0x7f8e1406dfd0 2024-04-20T21:19:53.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.331+0000 7f8e12a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8e1415a7b0 0x7f8e1406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.331+0000 7f8e12a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8e1415a7b0 0x7f8e1406da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44668/0 (socket says 172.21.15.71:44668) 2024-04-20T21:19:53.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.331+0000 7f8e12a00640 1 -- 172.21.15.71:0/971356735 learned_addr learned my addr 172.21.15.71:0/971356735 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:53.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.331+0000 7f8e12000640 1 --2- 172.21.15.71:0/971356735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406dfd0 0x7f8e1406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.332+0000 7f8e12a00640 1 -- 172.21.15.71:0/971356735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406dfd0 msgr2=0x7f8e1406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:53.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.332+0000 7f8e12a00640 1 --2- 172.21.15.71:0/971356735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406dfd0 0x7f8e1406c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.332+0000 7f8e12a00640 1 -- 172.21.15.71:0/971356735 >> v2:172.21.15.137:3300/0 conn(0x7f8e1406cea0 msgr2=0x7f8e14071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:53.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.332+0000 7f8e13400640 1 --2- 172.21.15.71:0/971356735 >> v2:172.21.15.137:3300/0 conn(0x7f8e1406cea0 0x7f8e14071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.332+0000 7f8e12a00640 1 --2- 172.21.15.71:0/971356735 >> v2:172.21.15.137:3300/0 conn(0x7f8e1406cea0 0x7f8e14071c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.332+0000 7f8e12a00640 1 -- 172.21.15.71:0/971356735 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1406be80 con 0x7f8e1415a7b0 2024-04-20T21:19:53.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.332+0000 7f8e12000640 1 --2- 172.21.15.71:0/971356735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406dfd0 0x7f8e1406c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:53.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.333+0000 7f8e12a00640 1 --2- 172.21.15.71:0/971356735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e1415a7b0 0x7f8e1406da90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8e140cfd20 tx=0x7f8e0402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8a6356bad8573b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:53.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.333+0000 7f8e11600640 1 -- 172.21.15.71:0/971356735 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0402ca70 con 0x7f8e1415a7b0 2024-04-20T21:19:53.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.333+0000 7f8e11600640 1 -- 172.21.15.71:0/971356735 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e0402cc10 con 0x7f8e1415a7b0 2024-04-20T21:19:53.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.333+0000 7f8e11600640 1 -- 172.21.15.71:0/971356735 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e040343f0 con 0x7f8e1415a7b0 2024-04-20T21:19:53.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.334+0000 7f8e13e00640 1 -- 172.21.15.71:0/971356735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e1415a7b0 msgr2=0x7f8e1406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.334+0000 7f8e13e00640 1 --2- 172.21.15.71:0/971356735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e1415a7b0 0x7f8e1406da90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8e140cfd20 tx=0x7f8e0402bed0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.334+0000 7f8e13e00640 1 -- 172.21.15.71:0/971356735 shutdown_connections 2024-04-20T21:19:53.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.334+0000 7f8e13e00640 1 --2- 172.21.15.71:0/971356735 >> v2:172.21.15.137:3300/0 conn(0x7f8e1406cea0 0x7f8e14071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.334+0000 7f8e13e00640 1 --2- 172.21.15.71:0/971356735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406dfd0 0x7f8e1406c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.334+0000 7f8e13e00640 1 --2- 172.21.15.71:0/971356735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e1415a7b0 0x7f8e1406da90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.334+0000 7f8e13e00640 1 -- 172.21.15.71:0/971356735 >> 172.21.15.71:0/971356735 conn(0x7f8e140d0040 msgr2=0x7f8e140d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:53.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.334+0000 7f8e13e00640 1 -- 172.21.15.71:0/971356735 shutdown_connections 2024-04-20T21:19:53.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.334+0000 7f8e13e00640 1 -- 172.21.15.71:0/971356735 wait complete. 2024-04-20T21:19:53.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.336+0000 7f8e13e00640 1 Processor -- start 2024-04-20T21:19:53.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.336+0000 7f8e13e00640 1 -- start start 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e13e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406cea0 0x7f8e14148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e13e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e1406dfd0 0x7f8e140b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e13e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e1415a7b0 0x7f8e140b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e13e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1415ab90 con 0x7f8e1406dfd0 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e13e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1406c440 con 0x7f8e1415a7b0 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e13e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1415ad10 con 0x7f8e1406cea0 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e12000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e1406dfd0 0x7f8e140b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e12000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e1406dfd0 0x7f8e140b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44674/0 (socket says 172.21.15.71:44674) 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e12000640 1 -- 172.21.15.71:0/2967630592 learned_addr learned my addr 172.21.15.71:0/2967630592 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e12a00640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406cea0 0x7f8e14148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e12000640 1 -- 172.21.15.71:0/2967630592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406cea0 msgr2=0x7f8e14148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e12000640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406cea0 0x7f8e14148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e13400640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e1415a7b0 0x7f8e140b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e12000640 1 -- 172.21.15.71:0/2967630592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e1415a7b0 msgr2=0x7f8e140b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e12000640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e1415a7b0 0x7f8e140b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e12000640 1 -- 172.21.15.71:0/2967630592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1414a280 con 0x7f8e1406dfd0 2024-04-20T21:19:53.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.337+0000 7f8e12a00640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406cea0 0x7f8e14148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:53.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.338+0000 7f8e12000640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e1406dfd0 0x7f8e140b33c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000c7f0 tx=0x7f8e0000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:53.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.338+0000 7f8e0aa00640 1 -- 172.21.15.71:0/2967630592 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e00015070 con 0x7f8e1406dfd0 2024-04-20T21:19:53.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.338+0000 7f8e0aa00640 1 -- 172.21.15.71:0/2967630592 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e00007a30 con 0x7f8e1406dfd0 2024-04-20T21:19:53.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.338+0000 7f8e13e00640 1 -- 172.21.15.71:0/2967630592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1414a560 con 0x7f8e1406dfd0 2024-04-20T21:19:53.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.338+0000 7f8e0aa00640 1 -- 172.21.15.71:0/2967630592 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e00007e00 con 0x7f8e1406dfd0 2024-04-20T21:19:53.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.338+0000 7f8e13e00640 1 -- 172.21.15.71:0/2967630592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e14149f30 con 0x7f8e1406dfd0 2024-04-20T21:19:53.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.339+0000 7f8e13e00640 1 -- 172.21.15.71:0/2967630592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e14075b60 con 0x7f8e1406dfd0 2024-04-20T21:19:53.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.340+0000 7f8e0aa00640 1 -- 172.21.15.71:0/2967630592 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e00018070 con 0x7f8e1406dfd0 2024-04-20T21:19:53.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.342+0000 7f8e0aa00640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8df406c8f0 0x7f8df406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.342+0000 7f8e0aa00640 1 -- 172.21.15.71:0/2967630592 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8e0008be60 con 0x7f8e1406dfd0 2024-04-20T21:19:53.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.342+0000 7f8e12a00640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8df406c8f0 0x7f8df406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.343+0000 7f8e12a00640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8df406c8f0 0x7f8df406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e04035000 tx=0x7f8e04030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:53.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.346+0000 7f8e0aa00640 1 -- 172.21.15.71:0/2967630592 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8e00059f40 con 0x7f8e1406dfd0 2024-04-20T21:19:53.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.547+0000 7f8e13e00640 1 -- 172.21.15.71:0/2967630592 --> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e140ad3d0 con 0x7f8df406c8f0 2024-04-20T21:19:53.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.557+0000 7f8e0aa00640 1 -- 172.21.15.71:0/2967630592 <== mgr.4110 v2:172.21.15.71:6832/1511456036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332570 (secure 0 0 0) 0x7f8e140ad3d0 con 0x7f8df406c8f0 2024-04-20T21:19:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:53.563 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-20T21:19:53.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.564+0000 7f8e13e00640 1 -- 172.21.15.71:0/2967630592 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8df406c8f0 msgr2=0x7f8df406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.564+0000 7f8e13e00640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8df406c8f0 0x7f8df406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e04035000 tx=0x7f8e04030000 comp rx=0 tx=0).stop 2024-04-20T21:19:53.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.564+0000 7f8e13e00640 1 -- 172.21.15.71:0/2967630592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e1406dfd0 msgr2=0x7f8e140b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.564+0000 7f8e13e00640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e1406dfd0 0x7f8e140b33c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000c7f0 tx=0x7f8e0000cbf0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.564+0000 7f8e13e00640 1 -- 172.21.15.71:0/2967630592 shutdown_connections 2024-04-20T21:19:53.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.564+0000 7f8e13e00640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8df406c8f0 0x7f8df406edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.564+0000 7f8e13e00640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e1415a7b0 0x7f8e140b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.564+0000 7f8e13e00640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e1406dfd0 0x7f8e140b33c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.564+0000 7f8e13e00640 1 --2- 172.21.15.71:0/2967630592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8e1406cea0 0x7f8e14148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.564+0000 7f8e13e00640 1 -- 172.21.15.71:0/2967630592 >> 172.21.15.71:0/2967630592 conn(0x7f8e140d0040 msgr2=0x7f8e140b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.565+0000 7f8e13e00640 1 -- 172.21.15.71:0/2967630592 shutdown_connections 2024-04-20T21:19:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.565+0000 7f8e13e00640 1 -- 172.21.15.71:0/2967630592 wait complete. 2024-04-20T21:19:53.583 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-20T21:19:51.801451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2048878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005508"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250445+0000","last_change":"2024-04-20T21:19:28.364884+0000","last_active":"2024-04-20T21:19:36.250445+0000","last_peered":"2024-04-20T21:19:36.250445+0000","last_clean":"2024-04-20T21:19:36.250445+0000","last_became_active":"2024-04-20T21:19:28.364515+0000","last_became_peered":"2024-04-20T21:19:28.364515+0000","last_unstale":"2024-04-20T21:19:36.250445+0000","last_undegraded":"2024-04-20T21:19:36.250445+0000","last_fullsized":"2024-04-20T21:19:36.250445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622903+0000","last_change":"2024-04-20T21:19:29.381382+0000","last_active":"2024-04-20T21:19:35.622903+0000","last_peered":"2024-04-20T21:19:35.622903+0000","last_clean":"2024-04-20T21:19:35.622903+0000","last_became_active":"2024-04-20T21:19:29.381086+0000","last_became_peered":"2024-04-20T21:19:29.381086+0000","last_unstale":"2024-04-20T21:19:35.622903+0000","last_undegraded":"2024-04-20T21:19:35.622903+0000","last_fullsized":"2024-04-20T21:19:35.622903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:24:23.709381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622136+0000","last_change":"2024-04-20T21:19:34.116039+0000","last_active":"2024-04-20T21:19:35.622136+0000","last_peered":"2024-04-20T21:19:35.622136+0000","last_clean":"2024-04-20T21:19:35.622136+0000","last_became_active":"2024-04-20T21:19:34.114870+0000","last_became_peered":"2024-04-20T21:19:34.114870+0000","last_unstale":"2024-04-20T21:19:35.622136+0000","last_undegraded":"2024-04-20T21:19:35.622136+0000","last_fullsized":"2024-04-20T21:19:35.622136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:11:39.317180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623062+0000","last_change":"2024-04-20T21:19:28.356358+0000","last_active":"2024-04-20T21:19:35.623062+0000","last_peered":"2024-04-20T21:19:35.623062+0000","last_clean":"2024-04-20T21:19:35.623062+0000","last_became_active":"2024-04-20T21:19:28.355376+0000","last_became_peered":"2024-04-20T21:19:28.355376+0000","last_unstale":"2024-04-20T21:19:35.623062+0000","last_undegraded":"2024-04-20T21:19:35.623062+0000","last_fullsized":"2024-04-20T21:19:35.623062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:12:37.534140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250065+0000","last_change":"2024-04-20T21:19:29.393098+0000","last_active":"2024-04-20T21:19:36.250065+0000","last_peered":"2024-04-20T21:19:36.250065+0000","last_clean":"2024-04-20T21:19:36.250065+0000","last_became_active":"2024-04-20T21:19:29.392267+0000","last_became_peered":"2024-04-20T21:19:29.392267+0000","last_unstale":"2024-04-20T21:19:36.250065+0000","last_undegraded":"2024-04-20T21:19:36.250065+0000","last_fullsized":"2024-04-20T21:19:36.250065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626812+0000","last_change":"2024-04-20T21:19:33.632986+0000","last_active":"2024-04-20T21:19:35.626812+0000","last_peered":"2024-04-20T21:19:35.626812+0000","last_clean":"2024-04-20T21:19:35.626812+0000","last_became_active":"2024-04-20T21:19:33.632489+0000","last_became_peered":"2024-04-20T21:19:33.632489+0000","last_unstale":"2024-04-20T21:19:35.626812+0000","last_undegraded":"2024-04-20T21:19:35.626812+0000","last_fullsized":"2024-04-20T21:19:35.626812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:25.396766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251112+0000","last_change":"2024-04-20T21:19:28.370372+0000","last_active":"2024-04-20T21:19:36.251112+0000","last_peered":"2024-04-20T21:19:36.251112+0000","last_clean":"2024-04-20T21:19:36.251112+0000","last_became_active":"2024-04-20T21:19:28.369998+0000","last_became_peered":"2024-04-20T21:19:28.369998+0000","last_unstale":"2024-04-20T21:19:36.251112+0000","last_undegraded":"2024-04-20T21:19:36.251112+0000","last_fullsized":"2024-04-20T21:19:36.251112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:49:21.426416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777896+0000","last_change":"2024-04-20T21:19:29.383743+0000","last_active":"2024-04-20T21:19:35.777896+0000","last_peered":"2024-04-20T21:19:35.777896+0000","last_clean":"2024-04-20T21:19:35.777896+0000","last_became_active":"2024-04-20T21:19:29.383451+0000","last_became_peered":"2024-04-20T21:19:29.383451+0000","last_unstale":"2024-04-20T21:19:35.777896+0000","last_undegraded":"2024-04-20T21:19:35.777896+0000","last_fullsized":"2024-04-20T21:19:35.777896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:21.125011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630668+0000","last_change":"2024-04-20T21:19:33.632955+0000","last_active":"2024-04-20T21:19:35.630668+0000","last_peered":"2024-04-20T21:19:35.630668+0000","last_clean":"2024-04-20T21:19:35.630668+0000","last_became_active":"2024-04-20T21:19:33.632418+0000","last_became_peered":"2024-04-20T21:19:33.632418+0000","last_unstale":"2024-04-20T21:19:35.630668+0000","last_undegraded":"2024-04-20T21:19:35.630668+0000","last_fullsized":"2024-04-20T21:19:35.630668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250671+0000","last_change":"2024-04-20T21:19:28.367835+0000","last_active":"2024-04-20T21:19:36.250671+0000","last_peered":"2024-04-20T21:19:36.250671+0000","last_clean":"2024-04-20T21:19:36.250671+0000","last_became_active":"2024-04-20T21:19:28.367516+0000","last_became_peered":"2024-04-20T21:19:28.367516+0000","last_unstale":"2024-04-20T21:19:36.250671+0000","last_undegraded":"2024-04-20T21:19:36.250671+0000","last_fullsized":"2024-04-20T21:19:36.250671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:03:38.483955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778252+0000","last_change":"2024-04-20T21:19:29.382022+0000","last_active":"2024-04-20T21:19:35.778252+0000","last_peered":"2024-04-20T21:19:35.778252+0000","last_clean":"2024-04-20T21:19:35.778252+0000","last_became_active":"2024-04-20T21:19:29.381441+0000","last_became_peered":"2024-04-20T21:19:29.381441+0000","last_unstale":"2024-04-20T21:19:35.778252+0000","last_undegraded":"2024-04-20T21:19:35.778252+0000","last_fullsized":"2024-04-20T21:19:35.778252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:10:56.546673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629810+0000","last_change":"2024-04-20T21:19:33.623830+0000","last_active":"2024-04-20T21:19:35.629810+0000","last_peered":"2024-04-20T21:19:35.629810+0000","last_clean":"2024-04-20T21:19:35.629810+0000","last_became_active":"2024-04-20T21:19:33.623367+0000","last_became_peered":"2024-04-20T21:19:33.623367+0000","last_unstale":"2024-04-20T21:19:35.629810+0000","last_undegraded":"2024-04-20T21:19:35.629810+0000","last_fullsized":"2024-04-20T21:19:35.629810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:35.626728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627137+0000","last_change":"2024-04-20T21:19:29.362406+0000","last_active":"2024-04-20T21:19:35.627137+0000","last_peered":"2024-04-20T21:19:35.627137+0000","last_clean":"2024-04-20T21:19:35.627137+0000","last_became_active":"2024-04-20T21:19:29.361949+0000","last_became_peered":"2024-04-20T21:19:29.361949+0000","last_unstale":"2024-04-20T21:19:35.627137+0000","last_undegraded":"2024-04-20T21:19:35.627137+0000","last_fullsized":"2024-04-20T21:19:35.627137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250473+0000","last_change":"2024-04-20T21:19:28.366445+0000","last_active":"2024-04-20T21:19:36.250473+0000","last_peered":"2024-04-20T21:19:36.250473+0000","last_clean":"2024-04-20T21:19:36.250473+0000","last_became_active":"2024-04-20T21:19:28.365983+0000","last_became_peered":"2024-04-20T21:19:28.365983+0000","last_unstale":"2024-04-20T21:19:36.250473+0000","last_undegraded":"2024-04-20T21:19:36.250473+0000","last_fullsized":"2024-04-20T21:19:36.250473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:19:13.843410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.632337+0000","last_change":"2024-04-20T21:19:33.633939+0000","last_active":"2024-04-20T21:19:35.632337+0000","last_peered":"2024-04-20T21:19:35.632337+0000","last_clean":"2024-04-20T21:19:35.632337+0000","last_became_active":"2024-04-20T21:19:33.633480+0000","last_became_peered":"2024-04-20T21:19:33.633480+0000","last_unstale":"2024-04-20T21:19:35.632337+0000","last_undegraded":"2024-04-20T21:19:35.632337+0000","last_fullsized":"2024-04-20T21:19:35.632337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622549+0000","last_change":"2024-04-20T21:19:29.396467+0000","last_active":"2024-04-20T21:19:35.622549+0000","last_peered":"2024-04-20T21:19:35.622549+0000","last_clean":"2024-04-20T21:19:35.622549+0000","last_became_active":"2024-04-20T21:19:29.396096+0000","last_became_peered":"2024-04-20T21:19:29.396096+0000","last_unstale":"2024-04-20T21:19:35.622549+0000","last_undegraded":"2024-04-20T21:19:35.622549+0000","last_fullsized":"2024-04-20T21:19:35.622549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248714+0000","last_change":"2024-04-20T21:19:28.354943+0000","last_active":"2024-04-20T21:19:36.248714+0000","last_peered":"2024-04-20T21:19:36.248714+0000","last_clean":"2024-04-20T21:19:36.248714+0000","last_became_active":"2024-04-20T21:19:28.354543+0000","last_became_peered":"2024-04-20T21:19:28.354543+0000","last_unstale":"2024-04-20T21:19:36.248714+0000","last_undegraded":"2024-04-20T21:19:36.248714+0000","last_fullsized":"2024-04-20T21:19:36.248714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631184+0000","last_change":"2024-04-20T21:19:33.630390+0000","last_active":"2024-04-20T21:19:35.631184+0000","last_peered":"2024-04-20T21:19:35.631184+0000","last_clean":"2024-04-20T21:19:35.631184+0000","last_became_active":"2024-04-20T21:19:33.629932+0000","last_became_peered":"2024-04-20T21:19:33.629932+0000","last_unstale":"2024-04-20T21:19:35.631184+0000","last_undegraded":"2024-04-20T21:19:35.631184+0000","last_fullsized":"2024-04-20T21:19:35.631184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621975+0000","last_change":"2024-04-20T21:19:29.389415+0000","last_active":"2024-04-20T21:19:35.621975+0000","last_peered":"2024-04-20T21:19:35.621975+0000","last_clean":"2024-04-20T21:19:35.621975+0000","last_became_active":"2024-04-20T21:19:29.381155+0000","last_became_peered":"2024-04-20T21:19:29.381155+0000","last_unstale":"2024-04-20T21:19:35.621975+0000","last_undegraded":"2024-04-20T21:19:35.621975+0000","last_fullsized":"2024-04-20T21:19:35.621975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249623+0000","last_change":"2024-04-20T21:19:28.364622+0000","last_active":"2024-04-20T21:19:36.249623+0000","last_peered":"2024-04-20T21:19:36.249623+0000","last_clean":"2024-04-20T21:19:36.249623+0000","last_became_active":"2024-04-20T21:19:28.364315+0000","last_became_peered":"2024-04-20T21:19:28.364315+0000","last_unstale":"2024-04-20T21:19:36.249623+0000","last_undegraded":"2024-04-20T21:19:36.249623+0000","last_fullsized":"2024-04-20T21:19:36.249623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:18.220229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248334+0000","last_change":"2024-04-20T21:19:34.113879+0000","last_active":"2024-04-20T21:19:36.248334+0000","last_peered":"2024-04-20T21:19:36.248334+0000","last_clean":"2024-04-20T21:19:36.248334+0000","last_became_active":"2024-04-20T21:19:34.112094+0000","last_became_peered":"2024-04-20T21:19:34.112094+0000","last_unstale":"2024-04-20T21:19:36.248334+0000","last_undegraded":"2024-04-20T21:19:36.248334+0000","last_fullsized":"2024-04-20T21:19:36.248334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629286+0000","last_change":"2024-04-20T21:19:29.380675+0000","last_active":"2024-04-20T21:19:35.629286+0000","last_peered":"2024-04-20T21:19:35.629286+0000","last_clean":"2024-04-20T21:19:35.629286+0000","last_became_active":"2024-04-20T21:19:29.380380+0000","last_became_peered":"2024-04-20T21:19:29.380380+0000","last_unstale":"2024-04-20T21:19:35.629286+0000","last_undegraded":"2024-04-20T21:19:35.629286+0000","last_fullsized":"2024-04-20T21:19:35.629286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:28.311170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249614+0000","last_change":"2024-04-20T21:19:28.368079+0000","last_active":"2024-04-20T21:19:36.249614+0000","last_peered":"2024-04-20T21:19:36.249614+0000","last_clean":"2024-04-20T21:19:36.249614+0000","last_became_active":"2024-04-20T21:19:28.367750+0000","last_became_peered":"2024-04-20T21:19:28.367750+0000","last_unstale":"2024-04-20T21:19:36.249614+0000","last_undegraded":"2024-04-20T21:19:36.249614+0000","last_fullsized":"2024-04-20T21:19:36.249614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:45.962672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630326+0000","last_change":"2024-04-20T21:19:33.631284+0000","last_active":"2024-04-20T21:19:35.630326+0000","last_peered":"2024-04-20T21:19:35.630326+0000","last_clean":"2024-04-20T21:19:35.630326+0000","last_became_active":"2024-04-20T21:19:33.630971+0000","last_became_peered":"2024-04-20T21:19:33.630971+0000","last_unstale":"2024-04-20T21:19:35.630326+0000","last_undegraded":"2024-04-20T21:19:35.630326+0000","last_fullsized":"2024-04-20T21:19:35.630326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:18:37.532799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249846+0000","last_change":"2024-04-20T21:19:29.391566+0000","last_active":"2024-04-20T21:19:36.249846+0000","last_peered":"2024-04-20T21:19:36.249846+0000","last_clean":"2024-04-20T21:19:36.249846+0000","last_became_active":"2024-04-20T21:19:29.391250+0000","last_became_peered":"2024-04-20T21:19:29.391250+0000","last_unstale":"2024-04-20T21:19:36.249846+0000","last_undegraded":"2024-04-20T21:19:36.249846+0000","last_fullsized":"2024-04-20T21:19:36.249846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628809+0000","last_change":"2024-04-20T21:19:28.364547+0000","last_active":"2024-04-20T21:19:35.628809+0000","last_peered":"2024-04-20T21:19:35.628809+0000","last_clean":"2024-04-20T21:19:35.628809+0000","last_became_active":"2024-04-20T21:19:28.364221+0000","last_became_peered":"2024-04-20T21:19:28.364221+0000","last_unstale":"2024-04-20T21:19:35.628809+0000","last_undegraded":"2024-04-20T21:19:35.628809+0000","last_fullsized":"2024-04-20T21:19:35.628809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628201+0000","last_change":"2024-04-20T21:19:34.113755+0000","last_active":"2024-04-20T21:19:35.628201+0000","last_peered":"2024-04-20T21:19:35.628201+0000","last_clean":"2024-04-20T21:19:35.628201+0000","last_became_active":"2024-04-20T21:19:34.112491+0000","last_became_peered":"2024-04-20T21:19:34.112491+0000","last_unstale":"2024-04-20T21:19:35.628201+0000","last_undegraded":"2024-04-20T21:19:35.628201+0000","last_fullsized":"2024-04-20T21:19:35.628201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:34.563292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623247+0000","last_change":"2024-04-20T21:19:29.398876+0000","last_active":"2024-04-20T21:19:35.623247+0000","last_peered":"2024-04-20T21:19:35.623247+0000","last_clean":"2024-04-20T21:19:35.623247+0000","last_became_active":"2024-04-20T21:19:29.398650+0000","last_became_peered":"2024-04-20T21:19:29.398650+0000","last_unstale":"2024-04-20T21:19:35.623247+0000","last_undegraded":"2024-04-20T21:19:35.623247+0000","last_fullsized":"2024-04-20T21:19:35.623247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249435+0000","last_change":"2024-04-20T21:19:28.360068+0000","last_active":"2024-04-20T21:19:36.249435+0000","last_peered":"2024-04-20T21:19:36.249435+0000","last_clean":"2024-04-20T21:19:36.249435+0000","last_became_active":"2024-04-20T21:19:28.359752+0000","last_became_peered":"2024-04-20T21:19:28.359752+0000","last_unstale":"2024-04-20T21:19:36.249435+0000","last_undegraded":"2024-04-20T21:19:36.249435+0000","last_fullsized":"2024-04-20T21:19:36.249435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:45.962672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622011+0000","last_change":"2024-04-20T21:19:34.104484+0000","last_active":"2024-04-20T21:19:35.622011+0000","last_peered":"2024-04-20T21:19:35.622011+0000","last_clean":"2024-04-20T21:19:35.622011+0000","last_became_active":"2024-04-20T21:19:34.103724+0000","last_became_peered":"2024-04-20T21:19:34.103724+0000","last_unstale":"2024-04-20T21:19:35.622011+0000","last_undegraded":"2024-04-20T21:19:35.622011+0000","last_fullsized":"2024-04-20T21:19:35.622011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:46:20.508257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248977+0000","last_change":"2024-04-20T21:19:29.383418+0000","last_active":"2024-04-20T21:19:36.248977+0000","last_peered":"2024-04-20T21:19:36.248977+0000","last_clean":"2024-04-20T21:19:36.248977+0000","last_became_active":"2024-04-20T21:19:29.383070+0000","last_became_peered":"2024-04-20T21:19:29.383070+0000","last_unstale":"2024-04-20T21:19:36.248977+0000","last_undegraded":"2024-04-20T21:19:36.248977+0000","last_fullsized":"2024-04-20T21:19:36.248977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251419+0000","last_change":"2024-04-20T21:19:28.368850+0000","last_active":"2024-04-20T21:19:36.251419+0000","last_peered":"2024-04-20T21:19:36.251419+0000","last_clean":"2024-04-20T21:19:36.251419+0000","last_became_active":"2024-04-20T21:19:28.368537+0000","last_became_peered":"2024-04-20T21:19:28.368537+0000","last_unstale":"2024-04-20T21:19:36.251419+0000","last_undegraded":"2024-04-20T21:19:36.251419+0000","last_fullsized":"2024-04-20T21:19:36.251419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:39:59.354904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248012+0000","last_change":"2024-04-20T21:19:34.104458+0000","last_active":"2024-04-20T21:19:36.248012+0000","last_peered":"2024-04-20T21:19:36.248012+0000","last_clean":"2024-04-20T21:19:36.248012+0000","last_became_active":"2024-04-20T21:19:34.103757+0000","last_became_peered":"2024-04-20T21:19:34.103757+0000","last_unstale":"2024-04-20T21:19:36.248012+0000","last_undegraded":"2024-04-20T21:19:36.248012+0000","last_fullsized":"2024-04-20T21:19:36.248012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778559+0000","last_change":"2024-04-20T21:19:29.397580+0000","last_active":"2024-04-20T21:19:35.778559+0000","last_peered":"2024-04-20T21:19:35.778559+0000","last_clean":"2024-04-20T21:19:35.778559+0000","last_became_active":"2024-04-20T21:19:29.396682+0000","last_became_peered":"2024-04-20T21:19:29.396682+0000","last_unstale":"2024-04-20T21:19:35.778559+0000","last_undegraded":"2024-04-20T21:19:35.778559+0000","last_fullsized":"2024-04-20T21:19:35.778559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:30.291536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249055+0000","last_change":"2024-04-20T21:19:28.355329+0000","last_active":"2024-04-20T21:19:36.249055+0000","last_peered":"2024-04-20T21:19:36.249055+0000","last_clean":"2024-04-20T21:19:36.249055+0000","last_became_active":"2024-04-20T21:19:28.354650+0000","last_became_peered":"2024-04-20T21:19:28.354650+0000","last_unstale":"2024-04-20T21:19:36.249055+0000","last_undegraded":"2024-04-20T21:19:36.249055+0000","last_fullsized":"2024-04-20T21:19:36.249055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248349+0000","last_change":"2024-04-20T21:19:33.629808+0000","last_active":"2024-04-20T21:19:36.248349+0000","last_peered":"2024-04-20T21:19:36.248349+0000","last_clean":"2024-04-20T21:19:36.248349+0000","last_became_active":"2024-04-20T21:19:33.628655+0000","last_became_peered":"2024-04-20T21:19:33.628655+0000","last_unstale":"2024-04-20T21:19:36.248349+0000","last_undegraded":"2024-04-20T21:19:36.248349+0000","last_fullsized":"2024-04-20T21:19:36.248349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631211+0000","last_change":"2024-04-20T21:19:29.369139+0000","last_active":"2024-04-20T21:19:35.631211+0000","last_peered":"2024-04-20T21:19:35.631211+0000","last_clean":"2024-04-20T21:19:35.631211+0000","last_became_active":"2024-04-20T21:19:29.368508+0000","last_became_peered":"2024-04-20T21:19:29.368508+0000","last_unstale":"2024-04-20T21:19:35.631211+0000","last_undegraded":"2024-04-20T21:19:35.631211+0000","last_fullsized":"2024-04-20T21:19:35.631211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:50.979376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777730+0000","last_change":"2024-04-20T21:19:28.361884+0000","last_active":"2024-04-20T21:19:35.777730+0000","last_peered":"2024-04-20T21:19:35.777730+0000","last_clean":"2024-04-20T21:19:35.777730+0000","last_became_active":"2024-04-20T21:19:28.361455+0000","last_became_peered":"2024-04-20T21:19:28.361455+0000","last_unstale":"2024-04-20T21:19:35.777730+0000","last_undegraded":"2024-04-20T21:19:35.777730+0000","last_fullsized":"2024-04-20T21:19:35.777730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248902+0000","last_change":"2024-04-20T21:19:33.628385+0000","last_active":"2024-04-20T21:19:36.248902+0000","last_peered":"2024-04-20T21:19:36.248902+0000","last_clean":"2024-04-20T21:19:36.248902+0000","last_became_active":"2024-04-20T21:19:33.627925+0000","last_became_peered":"2024-04-20T21:19:33.627925+0000","last_unstale":"2024-04-20T21:19:36.248902+0000","last_undegraded":"2024-04-20T21:19:36.248902+0000","last_fullsized":"2024-04-20T21:19:36.248902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247403+0000","last_change":"2024-04-20T21:19:29.383757+0000","last_active":"2024-04-20T21:19:36.247403+0000","last_peered":"2024-04-20T21:19:36.247403+0000","last_clean":"2024-04-20T21:19:36.247403+0000","last_became_active":"2024-04-20T21:19:29.383265+0000","last_became_peered":"2024-04-20T21:19:29.383265+0000","last_unstale":"2024-04-20T21:19:36.247403+0000","last_undegraded":"2024-04-20T21:19:36.247403+0000","last_fullsized":"2024-04-20T21:19:36.247403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249184+0000","last_change":"2024-04-20T21:19:28.333272+0000","last_active":"2024-04-20T21:19:36.249184+0000","last_peered":"2024-04-20T21:19:36.249184+0000","last_clean":"2024-04-20T21:19:36.249184+0000","last_became_active":"2024-04-20T21:19:28.332869+0000","last_became_peered":"2024-04-20T21:19:28.332869+0000","last_unstale":"2024-04-20T21:19:36.249184+0000","last_undegraded":"2024-04-20T21:19:36.249184+0000","last_fullsized":"2024-04-20T21:19:36.249184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248513+0000","last_change":"2024-04-20T21:19:33.629923+0000","last_active":"2024-04-20T21:19:36.248513+0000","last_peered":"2024-04-20T21:19:36.248513+0000","last_clean":"2024-04-20T21:19:36.248513+0000","last_became_active":"2024-04-20T21:19:33.627690+0000","last_became_peered":"2024-04-20T21:19:33.627690+0000","last_unstale":"2024-04-20T21:19:36.248513+0000","last_undegraded":"2024-04-20T21:19:36.248513+0000","last_fullsized":"2024-04-20T21:19:36.248513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247676+0000","last_change":"2024-04-20T21:19:29.361370+0000","last_active":"2024-04-20T21:19:36.247676+0000","last_peered":"2024-04-20T21:19:36.247676+0000","last_clean":"2024-04-20T21:19:36.247676+0000","last_became_active":"2024-04-20T21:19:29.360654+0000","last_became_peered":"2024-04-20T21:19:29.360654+0000","last_unstale":"2024-04-20T21:19:36.247676+0000","last_undegraded":"2024-04-20T21:19:36.247676+0000","last_fullsized":"2024-04-20T21:19:36.247676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:08:35.086557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249697+0000","last_change":"2024-04-20T21:19:28.367397+0000","last_active":"2024-04-20T21:19:36.249697+0000","last_peered":"2024-04-20T21:19:36.249697+0000","last_clean":"2024-04-20T21:19:36.249697+0000","last_became_active":"2024-04-20T21:19:28.367133+0000","last_became_peered":"2024-04-20T21:19:28.367133+0000","last_unstale":"2024-04-20T21:19:36.249697+0000","last_undegraded":"2024-04-20T21:19:36.249697+0000","last_fullsized":"2024-04-20T21:19:36.249697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:18.220229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249641+0000","last_change":"2024-04-20T21:19:34.117121+0000","last_active":"2024-04-20T21:19:36.249641+0000","last_peered":"2024-04-20T21:19:36.249641+0000","last_clean":"2024-04-20T21:19:36.249641+0000","last_became_active":"2024-04-20T21:19:34.116147+0000","last_became_peered":"2024-04-20T21:19:34.116147+0000","last_unstale":"2024-04-20T21:19:36.249641+0000","last_undegraded":"2024-04-20T21:19:36.249641+0000","last_fullsized":"2024-04-20T21:19:36.249641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621863+0000","last_change":"2024-04-20T21:19:29.396033+0000","last_active":"2024-04-20T21:19:35.621863+0000","last_peered":"2024-04-20T21:19:35.621863+0000","last_clean":"2024-04-20T21:19:35.621863+0000","last_became_active":"2024-04-20T21:19:29.395741+0000","last_became_peered":"2024-04-20T21:19:29.395741+0000","last_unstale":"2024-04-20T21:19:35.621863+0000","last_undegraded":"2024-04-20T21:19:35.621863+0000","last_fullsized":"2024-04-20T21:19:35.621863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777536+0000","last_change":"2024-04-20T21:19:28.352100+0000","last_active":"2024-04-20T21:19:35.777536+0000","last_peered":"2024-04-20T21:19:35.777536+0000","last_clean":"2024-04-20T21:19:35.777536+0000","last_became_active":"2024-04-20T21:19:28.351795+0000","last_became_peered":"2024-04-20T21:19:28.351795+0000","last_unstale":"2024-04-20T21:19:35.777536+0000","last_undegraded":"2024-04-20T21:19:35.777536+0000","last_fullsized":"2024-04-20T21:19:35.777536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249911+0000","last_change":"2024-04-20T21:19:19.292405+0000","last_active":"2024-04-20T21:19:36.249911+0000","last_peered":"2024-04-20T21:19:36.249911+0000","last_clean":"2024-04-20T21:19:36.249911+0000","last_became_active":"2024-04-20T21:19:19.290107+0000","last_became_peered":"2024-04-20T21:19:19.290107+0000","last_unstale":"2024-04-20T21:19:36.249911+0000","last_undegraded":"2024-04-20T21:19:36.249911+0000","last_fullsized":"2024-04-20T21:19:36.249911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_clean_scrub_stamp":"2024-04-20T21:19:18.230829+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:48:44.146278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627341+0000","last_change":"2024-04-20T21:19:34.118317+0000","last_active":"2024-04-20T21:19:35.627341+0000","last_peered":"2024-04-20T21:19:35.627341+0000","last_clean":"2024-04-20T21:19:35.627341+0000","last_became_active":"2024-04-20T21:19:34.114435+0000","last_became_peered":"2024-04-20T21:19:34.114435+0000","last_unstale":"2024-04-20T21:19:35.627341+0000","last_undegraded":"2024-04-20T21:19:35.627341+0000","last_fullsized":"2024-04-20T21:19:35.627341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:11:00.818429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250762+0000","last_change":"2024-04-20T21:19:29.393324+0000","last_active":"2024-04-20T21:19:36.250762+0000","last_peered":"2024-04-20T21:19:36.250762+0000","last_clean":"2024-04-20T21:19:36.250762+0000","last_became_active":"2024-04-20T21:19:29.393007+0000","last_became_peered":"2024-04-20T21:19:29.393007+0000","last_unstale":"2024-04-20T21:19:36.250762+0000","last_undegraded":"2024-04-20T21:19:36.250762+0000","last_fullsized":"2024-04-20T21:19:36.250762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:30.291536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249830+0000","last_change":"2024-04-20T21:19:28.351503+0000","last_active":"2024-04-20T21:19:36.249830+0000","last_peered":"2024-04-20T21:19:36.249830+0000","last_clean":"2024-04-20T21:19:36.249830+0000","last_became_active":"2024-04-20T21:19:28.351160+0000","last_became_peered":"2024-04-20T21:19:28.351160+0000","last_unstale":"2024-04-20T21:19:36.249830+0000","last_undegraded":"2024-04-20T21:19:36.249830+0000","last_fullsized":"2024-04-20T21:19:36.249830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627263+0000","last_change":"2024-04-20T21:19:34.110398+0000","last_active":"2024-04-20T21:19:35.627263+0000","last_peered":"2024-04-20T21:19:35.627263+0000","last_clean":"2024-04-20T21:19:35.627263+0000","last_became_active":"2024-04-20T21:19:34.105383+0000","last_became_peered":"2024-04-20T21:19:34.105383+0000","last_unstale":"2024-04-20T21:19:35.627263+0000","last_undegraded":"2024-04-20T21:19:35.627263+0000","last_fullsized":"2024-04-20T21:19:35.627263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:25.396766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778001+0000","last_change":"2024-04-20T21:19:29.397544+0000","last_active":"2024-04-20T21:19:35.778001+0000","last_peered":"2024-04-20T21:19:35.778001+0000","last_clean":"2024-04-20T21:19:35.778001+0000","last_became_active":"2024-04-20T21:19:29.396795+0000","last_became_peered":"2024-04-20T21:19:29.396795+0000","last_unstale":"2024-04-20T21:19:35.778001+0000","last_undegraded":"2024-04-20T21:19:35.778001+0000","last_fullsized":"2024-04-20T21:19:35.778001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:31.354972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247918+0000","last_change":"2024-04-20T21:19:28.356719+0000","last_active":"2024-04-20T21:19:36.247918+0000","last_peered":"2024-04-20T21:19:36.247918+0000","last_clean":"2024-04-20T21:19:36.247918+0000","last_became_active":"2024-04-20T21:19:28.356151+0000","last_became_peered":"2024-04-20T21:19:28.356151+0000","last_unstale":"2024-04-20T21:19:36.247918+0000","last_undegraded":"2024-04-20T21:19:36.247918+0000","last_fullsized":"2024-04-20T21:19:36.247918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248274+0000","last_change":"2024-04-20T21:19:33.633098+0000","last_active":"2024-04-20T21:19:36.248274+0000","last_peered":"2024-04-20T21:19:36.248274+0000","last_clean":"2024-04-20T21:19:36.248274+0000","last_became_active":"2024-04-20T21:19:33.632668+0000","last_became_peered":"2024-04-20T21:19:33.632668+0000","last_unstale":"2024-04-20T21:19:36.248274+0000","last_undegraded":"2024-04-20T21:19:36.248274+0000","last_fullsized":"2024-04-20T21:19:36.248274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251856+0000","last_change":"2024-04-20T21:19:29.390579+0000","last_active":"2024-04-20T21:19:36.251856+0000","last_peered":"2024-04-20T21:19:36.251856+0000","last_clean":"2024-04-20T21:19:36.251856+0000","last_became_active":"2024-04-20T21:19:29.389845+0000","last_became_peered":"2024-04-20T21:19:29.389845+0000","last_unstale":"2024-04-20T21:19:36.251856+0000","last_undegraded":"2024-04-20T21:19:36.251856+0000","last_fullsized":"2024-04-20T21:19:36.251856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.785469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249746+0000","last_change":"2024-04-20T21:19:28.337225+0000","last_active":"2024-04-20T21:19:36.249746+0000","last_peered":"2024-04-20T21:19:36.249746+0000","last_clean":"2024-04-20T21:19:36.249746+0000","last_became_active":"2024-04-20T21:19:28.336562+0000","last_became_peered":"2024-04-20T21:19:28.336562+0000","last_unstale":"2024-04-20T21:19:36.249746+0000","last_undegraded":"2024-04-20T21:19:36.249746+0000","last_fullsized":"2024-04-20T21:19:36.249746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.776960+0000","last_change":"2024-04-20T21:19:34.106520+0000","last_active":"2024-04-20T21:19:35.776960+0000","last_peered":"2024-04-20T21:19:35.776960+0000","last_clean":"2024-04-20T21:19:35.776960+0000","last_became_active":"2024-04-20T21:19:34.105183+0000","last_became_peered":"2024-04-20T21:19:34.105183+0000","last_unstale":"2024-04-20T21:19:35.776960+0000","last_undegraded":"2024-04-20T21:19:35.776960+0000","last_fullsized":"2024-04-20T21:19:35.776960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251226+0000","last_change":"2024-04-20T21:19:29.388099+0000","last_active":"2024-04-20T21:19:36.251226+0000","last_peered":"2024-04-20T21:19:36.251226+0000","last_clean":"2024-04-20T21:19:36.251226+0000","last_became_active":"2024-04-20T21:19:29.387720+0000","last_became_peered":"2024-04-20T21:19:29.387720+0000","last_unstale":"2024-04-20T21:19:36.251226+0000","last_undegraded":"2024-04-20T21:19:36.251226+0000","last_fullsized":"2024-04-20T21:19:36.251226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:10:56.546673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630817+0000","last_change":"2024-04-20T21:19:28.351346+0000","last_active":"2024-04-20T21:19:35.630817+0000","last_peered":"2024-04-20T21:19:35.630817+0000","last_clean":"2024-04-20T21:19:35.630817+0000","last_became_active":"2024-04-20T21:19:28.350181+0000","last_became_peered":"2024-04-20T21:19:28.350181+0000","last_unstale":"2024-04-20T21:19:35.630817+0000","last_undegraded":"2024-04-20T21:19:35.630817+0000","last_fullsized":"2024-04-20T21:19:35.630817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:28:58.801546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627521+0000","last_change":"2024-04-20T21:19:33.633495+0000","last_active":"2024-04-20T21:19:35.627521+0000","last_peered":"2024-04-20T21:19:35.627521+0000","last_clean":"2024-04-20T21:19:35.627521+0000","last_became_active":"2024-04-20T21:19:33.632961+0000","last_became_peered":"2024-04-20T21:19:33.632961+0000","last_unstale":"2024-04-20T21:19:35.627521+0000","last_undegraded":"2024-04-20T21:19:35.627521+0000","last_fullsized":"2024-04-20T21:19:35.627521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:11:00.818429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249980+0000","last_change":"2024-04-20T21:19:29.386658+0000","last_active":"2024-04-20T21:19:36.249980+0000","last_peered":"2024-04-20T21:19:36.249980+0000","last_clean":"2024-04-20T21:19:36.249980+0000","last_became_active":"2024-04-20T21:19:29.385316+0000","last_became_peered":"2024-04-20T21:19:29.385316+0000","last_unstale":"2024-04-20T21:19:36.249980+0000","last_undegraded":"2024-04-20T21:19:36.249980+0000","last_fullsized":"2024-04-20T21:19:36.249980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248902+0000","last_change":"2024-04-20T21:19:28.346894+0000","last_active":"2024-04-20T21:19:36.248902+0000","last_peered":"2024-04-20T21:19:36.248902+0000","last_clean":"2024-04-20T21:19:36.248902+0000","last_became_active":"2024-04-20T21:19:28.346501+0000","last_became_peered":"2024-04-20T21:19:28.346501+0000","last_unstale":"2024-04-20T21:19:36.248902+0000","last_undegraded":"2024-04-20T21:19:36.248902+0000","last_fullsized":"2024-04-20T21:19:36.248902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249377+0000","last_change":"2024-04-20T21:19:33.624256+0000","last_active":"2024-04-20T21:19:36.249377+0000","last_peered":"2024-04-20T21:19:36.249377+0000","last_clean":"2024-04-20T21:19:36.249377+0000","last_became_active":"2024-04-20T21:19:33.623535+0000","last_became_peered":"2024-04-20T21:19:33.623535+0000","last_unstale":"2024-04-20T21:19:36.249377+0000","last_undegraded":"2024-04-20T21:19:36.249377+0000","last_fullsized":"2024-04-20T21:19:36.249377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626744+0000","last_change":"2024-04-20T21:19:29.365502+0000","last_active":"2024-04-20T21:19:35.626744+0000","last_peered":"2024-04-20T21:19:35.626744+0000","last_clean":"2024-04-20T21:19:35.626744+0000","last_became_active":"2024-04-20T21:19:29.364467+0000","last_became_peered":"2024-04-20T21:19:29.364467+0000","last_unstale":"2024-04-20T21:19:35.626744+0000","last_undegraded":"2024-04-20T21:19:35.626744+0000","last_fullsized":"2024-04-20T21:19:35.626744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626909+0000","last_change":"2024-04-20T21:19:28.344379+0000","last_active":"2024-04-20T21:19:35.626909+0000","last_peered":"2024-04-20T21:19:35.626909+0000","last_clean":"2024-04-20T21:19:35.626909+0000","last_became_active":"2024-04-20T21:19:28.343961+0000","last_became_peered":"2024-04-20T21:19:28.343961+0000","last_unstale":"2024-04-20T21:19:35.626909+0000","last_undegraded":"2024-04-20T21:19:35.626909+0000","last_fullsized":"2024-04-20T21:19:35.626909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623180+0000","last_change":"2024-04-20T21:19:34.117654+0000","last_active":"2024-04-20T21:19:35.623180+0000","last_peered":"2024-04-20T21:19:35.623180+0000","last_clean":"2024-04-20T21:19:35.623180+0000","last_became_active":"2024-04-20T21:19:34.116853+0000","last_became_peered":"2024-04-20T21:19:34.116853+0000","last_unstale":"2024-04-20T21:19:35.623180+0000","last_undegraded":"2024-04-20T21:19:35.623180+0000","last_fullsized":"2024-04-20T21:19:35.623180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:52:51.896627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250332+0000","last_change":"2024-04-20T21:19:29.382869+0000","last_active":"2024-04-20T21:19:36.250332+0000","last_peered":"2024-04-20T21:19:36.250332+0000","last_clean":"2024-04-20T21:19:36.250332+0000","last_became_active":"2024-04-20T21:19:29.382468+0000","last_became_peered":"2024-04-20T21:19:29.382468+0000","last_unstale":"2024-04-20T21:19:36.250332+0000","last_undegraded":"2024-04-20T21:19:36.250332+0000","last_fullsized":"2024-04-20T21:19:36.250332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:21.125011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777629+0000","last_change":"2024-04-20T21:19:28.357934+0000","last_active":"2024-04-20T21:19:35.777629+0000","last_peered":"2024-04-20T21:19:35.777629+0000","last_clean":"2024-04-20T21:19:35.777629+0000","last_became_active":"2024-04-20T21:19:28.357449+0000","last_became_peered":"2024-04-20T21:19:28.357449+0000","last_unstale":"2024-04-20T21:19:35.777629+0000","last_undegraded":"2024-04-20T21:19:35.777629+0000","last_fullsized":"2024-04-20T21:19:35.777629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622808+0000","last_change":"2024-04-20T21:19:34.105481+0000","last_active":"2024-04-20T21:19:35.622808+0000","last_peered":"2024-04-20T21:19:35.622808+0000","last_clean":"2024-04-20T21:19:35.622808+0000","last_became_active":"2024-04-20T21:19:34.104398+0000","last_became_peered":"2024-04-20T21:19:34.104398+0000","last_unstale":"2024-04-20T21:19:35.622808+0000","last_undegraded":"2024-04-20T21:19:35.622808+0000","last_fullsized":"2024-04-20T21:19:35.622808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:00:47.266412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248125+0000","last_change":"2024-04-20T21:19:29.387882+0000","last_active":"2024-04-20T21:19:36.248125+0000","last_peered":"2024-04-20T21:19:36.248125+0000","last_clean":"2024-04-20T21:19:36.248125+0000","last_became_active":"2024-04-20T21:19:29.387548+0000","last_became_peered":"2024-04-20T21:19:29.387548+0000","last_unstale":"2024-04-20T21:19:36.248125+0000","last_undegraded":"2024-04-20T21:19:36.248125+0000","last_fullsized":"2024-04-20T21:19:36.248125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:33:55.067533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248579+0000","last_change":"2024-04-20T21:19:28.350496+0000","last_active":"2024-04-20T21:19:36.248579+0000","last_peered":"2024-04-20T21:19:36.248579+0000","last_clean":"2024-04-20T21:19:36.248579+0000","last_became_active":"2024-04-20T21:19:28.350170+0000","last_became_peered":"2024-04-20T21:19:28.350170+0000","last_unstale":"2024-04-20T21:19:36.248579+0000","last_undegraded":"2024-04-20T21:19:36.248579+0000","last_fullsized":"2024-04-20T21:19:36.248579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:12:37.534140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778364+0000","last_change":"2024-04-20T21:19:34.117079+0000","last_active":"2024-04-20T21:19:35.778364+0000","last_peered":"2024-04-20T21:19:35.778364+0000","last_clean":"2024-04-20T21:19:35.778364+0000","last_became_active":"2024-04-20T21:19:34.116404+0000","last_became_peered":"2024-04-20T21:19:34.116404+0000","last_unstale":"2024-04-20T21:19:35.778364+0000","last_undegraded":"2024-04-20T21:19:35.778364+0000","last_fullsized":"2024-04-20T21:19:35.778364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:26:28.450644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250605+0000","last_change":"2024-04-20T21:19:29.378275+0000","last_active":"2024-04-20T21:19:36.250605+0000","last_peered":"2024-04-20T21:19:36.250605+0000","last_clean":"2024-04-20T21:19:36.250605+0000","last_became_active":"2024-04-20T21:19:29.377896+0000","last_became_peered":"2024-04-20T21:19:29.377896+0000","last_unstale":"2024-04-20T21:19:36.250605+0000","last_undegraded":"2024-04-20T21:19:36.250605+0000","last_fullsized":"2024-04-20T21:19:36.250605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:18:33.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:41.372651+0000","last_change":"2024-04-20T21:19:28.357217+0000","last_active":"2024-04-20T21:19:41.372651+0000","last_peered":"2024-04-20T21:19:41.372651+0000","last_clean":"2024-04-20T21:19:41.372651+0000","last_became_active":"2024-04-20T21:19:28.356914+0000","last_became_peered":"2024-04-20T21:19:28.356914+0000","last_unstale":"2024-04-20T21:19:41.372651+0000","last_undegraded":"2024-04-20T21:19:41.372651+0000","last_fullsized":"2024-04-20T21:19:41.372651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248585+0000","last_change":"2024-04-20T21:19:33.629911+0000","last_active":"2024-04-20T21:19:36.248585+0000","last_peered":"2024-04-20T21:19:36.248585+0000","last_clean":"2024-04-20T21:19:36.248585+0000","last_became_active":"2024-04-20T21:19:33.627809+0000","last_became_peered":"2024-04-20T21:19:33.627809+0000","last_unstale":"2024-04-20T21:19:36.248585+0000","last_undegraded":"2024-04-20T21:19:36.248585+0000","last_fullsized":"2024-04-20T21:19:36.248585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631585+0000","last_change":"2024-04-20T21:19:29.393393+0000","last_active":"2024-04-20T21:19:35.631585+0000","last_peered":"2024-04-20T21:19:35.631585+0000","last_clean":"2024-04-20T21:19:35.631585+0000","last_became_active":"2024-04-20T21:19:29.390071+0000","last_became_peered":"2024-04-20T21:19:29.390071+0000","last_unstale":"2024-04-20T21:19:35.631585+0000","last_undegraded":"2024-04-20T21:19:35.631585+0000","last_fullsized":"2024-04-20T21:19:35.631585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:46.967851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247809+0000","last_change":"2024-04-20T21:19:28.356567+0000","last_active":"2024-04-20T21:19:36.247809+0000","last_peered":"2024-04-20T21:19:36.247809+0000","last_clean":"2024-04-20T21:19:36.247809+0000","last_became_active":"2024-04-20T21:19:28.355822+0000","last_became_peered":"2024-04-20T21:19:28.355822+0000","last_unstale":"2024-04-20T21:19:36.247809+0000","last_undegraded":"2024-04-20T21:19:36.247809+0000","last_fullsized":"2024-04-20T21:19:36.247809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630778+0000","last_change":"2024-04-20T21:19:33.630542+0000","last_active":"2024-04-20T21:19:35.630778+0000","last_peered":"2024-04-20T21:19:35.630778+0000","last_clean":"2024-04-20T21:19:35.630778+0000","last_became_active":"2024-04-20T21:19:33.630162+0000","last_became_peered":"2024-04-20T21:19:33.630162+0000","last_unstale":"2024-04-20T21:19:35.630778+0000","last_undegraded":"2024-04-20T21:19:35.630778+0000","last_fullsized":"2024-04-20T21:19:35.630778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250252+0000","last_change":"2024-04-20T21:19:29.381811+0000","last_active":"2024-04-20T21:19:36.250252+0000","last_peered":"2024-04-20T21:19:36.250252+0000","last_clean":"2024-04-20T21:19:36.250252+0000","last_became_active":"2024-04-20T21:19:29.381476+0000","last_became_peered":"2024-04-20T21:19:29.381476+0000","last_unstale":"2024-04-20T21:19:36.250252+0000","last_undegraded":"2024-04-20T21:19:36.250252+0000","last_fullsized":"2024-04-20T21:19:36.250252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778382+0000","last_change":"2024-04-20T21:19:28.362269+0000","last_active":"2024-04-20T21:19:35.778382+0000","last_peered":"2024-04-20T21:19:35.778382+0000","last_clean":"2024-04-20T21:19:35.778382+0000","last_became_active":"2024-04-20T21:19:28.361977+0000","last_became_peered":"2024-04-20T21:19:28.361977+0000","last_unstale":"2024-04-20T21:19:35.778382+0000","last_undegraded":"2024-04-20T21:19:35.778382+0000","last_fullsized":"2024-04-20T21:19:35.778382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621838+0000","last_change":"2024-04-20T21:19:33.628173+0000","last_active":"2024-04-20T21:19:35.621838+0000","last_peered":"2024-04-20T21:19:35.621838+0000","last_clean":"2024-04-20T21:19:35.621838+0000","last_became_active":"2024-04-20T21:19:33.627775+0000","last_became_peered":"2024-04-20T21:19:33.627775+0000","last_unstale":"2024-04-20T21:19:35.621838+0000","last_undegraded":"2024-04-20T21:19:35.621838+0000","last_fullsized":"2024-04-20T21:19:35.621838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:10:39.630401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778156+0000","last_change":"2024-04-20T21:19:29.395176+0000","last_active":"2024-04-20T21:19:35.778156+0000","last_peered":"2024-04-20T21:19:35.778156+0000","last_clean":"2024-04-20T21:19:35.778156+0000","last_became_active":"2024-04-20T21:19:29.394888+0000","last_became_peered":"2024-04-20T21:19:29.394888+0000","last_unstale":"2024-04-20T21:19:35.778156+0000","last_undegraded":"2024-04-20T21:19:35.778156+0000","last_fullsized":"2024-04-20T21:19:35.778156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:04:32.875201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628548+0000","last_change":"2024-04-20T21:19:28.365114+0000","last_active":"2024-04-20T21:19:35.628548+0000","last_peered":"2024-04-20T21:19:35.628548+0000","last_clean":"2024-04-20T21:19:35.628548+0000","last_became_active":"2024-04-20T21:19:28.364582+0000","last_became_peered":"2024-04-20T21:19:28.364582+0000","last_unstale":"2024-04-20T21:19:35.628548+0000","last_undegraded":"2024-04-20T21:19:35.628548+0000","last_fullsized":"2024-04-20T21:19:35.628548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622261+0000","last_change":"2024-04-20T21:19:34.106093+0000","last_active":"2024-04-20T21:19:35.622261+0000","last_peered":"2024-04-20T21:19:35.622261+0000","last_clean":"2024-04-20T21:19:35.622261+0000","last_became_active":"2024-04-20T21:19:34.104164+0000","last_became_peered":"2024-04-20T21:19:34.104164+0000","last_unstale":"2024-04-20T21:19:35.622261+0000","last_undegraded":"2024-04-20T21:19:35.622261+0000","last_fullsized":"2024-04-20T21:19:35.622261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:59:46.407601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249367+0000","last_change":"2024-04-20T21:19:34.114115+0000","last_active":"2024-04-20T21:19:36.249367+0000","last_peered":"2024-04-20T21:19:36.249367+0000","last_clean":"2024-04-20T21:19:36.249367+0000","last_became_active":"2024-04-20T21:19:34.113101+0000","last_became_peered":"2024-04-20T21:19:34.113101+0000","last_unstale":"2024-04-20T21:19:36.249367+0000","last_undegraded":"2024-04-20T21:19:36.249367+0000","last_fullsized":"2024-04-20T21:19:36.249367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247565+0000","last_change":"2024-04-20T21:19:29.393883+0000","last_active":"2024-04-20T21:19:36.247565+0000","last_peered":"2024-04-20T21:19:36.247565+0000","last_clean":"2024-04-20T21:19:36.247565+0000","last_became_active":"2024-04-20T21:19:29.386937+0000","last_became_peered":"2024-04-20T21:19:29.386937+0000","last_unstale":"2024-04-20T21:19:36.247565+0000","last_undegraded":"2024-04-20T21:19:36.247565+0000","last_fullsized":"2024-04-20T21:19:36.247565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777355+0000","last_change":"2024-04-20T21:19:28.354817+0000","last_active":"2024-04-20T21:19:35.777355+0000","last_peered":"2024-04-20T21:19:35.777355+0000","last_clean":"2024-04-20T21:19:35.777355+0000","last_became_active":"2024-04-20T21:19:28.354434+0000","last_became_peered":"2024-04-20T21:19:28.354434+0000","last_unstale":"2024-04-20T21:19:35.777355+0000","last_undegraded":"2024-04-20T21:19:35.777355+0000","last_fullsized":"2024-04-20T21:19:35.777355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628259+0000","last_change":"2024-04-20T21:19:33.633277+0000","last_active":"2024-04-20T21:19:35.628259+0000","last_peered":"2024-04-20T21:19:35.628259+0000","last_clean":"2024-04-20T21:19:35.628259+0000","last_became_active":"2024-04-20T21:19:33.632836+0000","last_became_peered":"2024-04-20T21:19:33.632836+0000","last_unstale":"2024-04-20T21:19:35.628259+0000","last_undegraded":"2024-04-20T21:19:35.628259+0000","last_fullsized":"2024-04-20T21:19:35.628259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:34.563292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621917+0000","last_change":"2024-04-20T21:19:29.398015+0000","last_active":"2024-04-20T21:19:35.621917+0000","last_peered":"2024-04-20T21:19:35.621917+0000","last_clean":"2024-04-20T21:19:35.621917+0000","last_became_active":"2024-04-20T21:19:29.395864+0000","last_became_peered":"2024-04-20T21:19:29.395864+0000","last_unstale":"2024-04-20T21:19:35.621917+0000","last_undegraded":"2024-04-20T21:19:35.621917+0000","last_fullsized":"2024-04-20T21:19:35.621917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622466+0000","last_change":"2024-04-20T21:19:28.344162+0000","last_active":"2024-04-20T21:19:35.622466+0000","last_peered":"2024-04-20T21:19:35.622466+0000","last_clean":"2024-04-20T21:19:35.622466+0000","last_became_active":"2024-04-20T21:19:28.343750+0000","last_became_peered":"2024-04-20T21:19:28.343750+0000","last_unstale":"2024-04-20T21:19:35.622466+0000","last_undegraded":"2024-04-20T21:19:35.622466+0000","last_fullsized":"2024-04-20T21:19:35.622466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627612+0000","last_change":"2024-04-20T21:19:28.351320+0000","last_active":"2024-04-20T21:19:35.627612+0000","last_peered":"2024-04-20T21:19:35.627612+0000","last_clean":"2024-04-20T21:19:35.627612+0000","last_became_active":"2024-04-20T21:19:28.350995+0000","last_became_peered":"2024-04-20T21:19:28.350995+0000","last_unstale":"2024-04-20T21:19:35.627612+0000","last_undegraded":"2024-04-20T21:19:35.627612+0000","last_fullsized":"2024-04-20T21:19:35.627612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248483+0000","last_change":"2024-04-20T21:19:29.362059+0000","last_active":"2024-04-20T21:19:36.248483+0000","last_peered":"2024-04-20T21:19:36.248483+0000","last_clean":"2024-04-20T21:19:36.248483+0000","last_became_active":"2024-04-20T21:19:29.361382+0000","last_became_peered":"2024-04-20T21:19:29.361382+0000","last_unstale":"2024-04-20T21:19:36.248483+0000","last_undegraded":"2024-04-20T21:19:36.248483+0000","last_fullsized":"2024-04-20T21:19:36.248483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249695+0000","last_change":"2024-04-20T21:19:33.628104+0000","last_active":"2024-04-20T21:19:36.249695+0000","last_peered":"2024-04-20T21:19:36.249695+0000","last_clean":"2024-04-20T21:19:36.249695+0000","last_became_active":"2024-04-20T21:19:33.627676+0000","last_became_peered":"2024-04-20T21:19:33.627676+0000","last_unstale":"2024-04-20T21:19:36.249695+0000","last_undegraded":"2024-04-20T21:19:36.249695+0000","last_fullsized":"2024-04-20T21:19:36.249695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:08:39.358313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622581+0000","last_change":"2024-04-20T21:19:28.365916+0000","last_active":"2024-04-20T21:19:35.622581+0000","last_peered":"2024-04-20T21:19:35.622581+0000","last_clean":"2024-04-20T21:19:35.622581+0000","last_became_active":"2024-04-20T21:19:28.365502+0000","last_became_peered":"2024-04-20T21:19:28.365502+0000","last_unstale":"2024-04-20T21:19:35.622581+0000","last_undegraded":"2024-04-20T21:19:35.622581+0000","last_fullsized":"2024-04-20T21:19:35.622581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629989+0000","last_change":"2024-04-20T21:19:29.387418+0000","last_active":"2024-04-20T21:19:35.629989+0000","last_peered":"2024-04-20T21:19:35.629989+0000","last_clean":"2024-04-20T21:19:35.629989+0000","last_became_active":"2024-04-20T21:19:29.387044+0000","last_became_peered":"2024-04-20T21:19:29.387044+0000","last_unstale":"2024-04-20T21:19:35.629989+0000","last_undegraded":"2024-04-20T21:19:35.629989+0000","last_fullsized":"2024-04-20T21:19:35.629989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:29.867631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622991+0000","last_change":"2024-04-20T21:19:33.633365+0000","last_active":"2024-04-20T21:19:35.622991+0000","last_peered":"2024-04-20T21:19:35.622991+0000","last_clean":"2024-04-20T21:19:35.622991+0000","last_became_active":"2024-04-20T21:19:33.631294+0000","last_became_peered":"2024-04-20T21:19:33.631294+0000","last_unstale":"2024-04-20T21:19:35.622991+0000","last_undegraded":"2024-04-20T21:19:35.622991+0000","last_fullsized":"2024-04-20T21:19:35.622991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:44.969195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626471+0000","last_change":"2024-04-20T21:19:29.374532+0000","last_active":"2024-04-20T21:19:35.626471+0000","last_peered":"2024-04-20T21:19:35.626471+0000","last_clean":"2024-04-20T21:19:35.626471+0000","last_became_active":"2024-04-20T21:19:29.370664+0000","last_became_peered":"2024-04-20T21:19:29.370664+0000","last_unstale":"2024-04-20T21:19:35.626471+0000","last_undegraded":"2024-04-20T21:19:35.626471+0000","last_fullsized":"2024-04-20T21:19:35.626471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249094+0000","last_change":"2024-04-20T21:19:29.391603+0000","last_active":"2024-04-20T21:19:36.249094+0000","last_peered":"2024-04-20T21:19:36.249094+0000","last_clean":"2024-04-20T21:19:36.249094+0000","last_became_active":"2024-04-20T21:19:29.391336+0000","last_became_peered":"2024-04-20T21:19:29.391336+0000","last_unstale":"2024-04-20T21:19:36.249094+0000","last_undegraded":"2024-04-20T21:19:36.249094+0000","last_fullsized":"2024-04-20T21:19:36.249094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:40:00.360083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777450+0000","last_change":"2024-04-20T21:19:29.397118+0000","last_active":"2024-04-20T21:19:35.777450+0000","last_peered":"2024-04-20T21:19:35.777450+0000","last_clean":"2024-04-20T21:19:35.777450+0000","last_became_active":"2024-04-20T21:19:29.396809+0000","last_became_peered":"2024-04-20T21:19:29.396809+0000","last_unstale":"2024-04-20T21:19:35.777450+0000","last_undegraded":"2024-04-20T21:19:35.777450+0000","last_fullsized":"2024-04-20T21:19:35.777450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248383+0000","last_change":"2024-04-20T21:19:29.380740+0000","last_active":"2024-04-20T21:19:36.248383+0000","last_peered":"2024-04-20T21:19:36.248383+0000","last_clean":"2024-04-20T21:19:36.248383+0000","last_became_active":"2024-04-20T21:19:29.378870+0000","last_became_peered":"2024-04-20T21:19:29.378870+0000","last_unstale":"2024-04-20T21:19:36.248383+0000","last_undegraded":"2024-04-20T21:19:36.248383+0000","last_fullsized":"2024-04-20T21:19:36.248383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622922+0000","last_change":"2024-04-20T21:19:29.376821+0000","last_active":"2024-04-20T21:19:35.622922+0000","last_peered":"2024-04-20T21:19:35.622922+0000","last_clean":"2024-04-20T21:19:35.622922+0000","last_became_active":"2024-04-20T21:19:29.372264+0000","last_became_peered":"2024-04-20T21:19:29.372264+0000","last_unstale":"2024-04-20T21:19:35.622922+0000","last_undegraded":"2024-04-20T21:19:35.622922+0000","last_fullsized":"2024-04-20T21:19:35.622922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247633+0000","last_change":"2024-04-20T21:19:29.380388+0000","last_active":"2024-04-20T21:19:36.247633+0000","last_peered":"2024-04-20T21:19:36.247633+0000","last_clean":"2024-04-20T21:19:36.247633+0000","last_became_active":"2024-04-20T21:19:29.380055+0000","last_became_peered":"2024-04-20T21:19:29.380055+0000","last_unstale":"2024-04-20T21:19:36.247633+0000","last_undegraded":"2024-04-20T21:19:36.247633+0000","last_fullsized":"2024-04-20T21:19:36.247633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628752+0000","last_change":"2024-04-20T21:19:29.392961+0000","last_active":"2024-04-20T21:19:35.628752+0000","last_peered":"2024-04-20T21:19:35.628752+0000","last_clean":"2024-04-20T21:19:35.628752+0000","last_became_active":"2024-04-20T21:19:29.392692+0000","last_became_peered":"2024-04-20T21:19:29.392692+0000","last_unstale":"2024-04-20T21:19:35.628752+0000","last_undegraded":"2024-04-20T21:19:35.628752+0000","last_fullsized":"2024-04-20T21:19:35.628752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623208+0000","last_change":"2024-04-20T21:19:29.380591+0000","last_active":"2024-04-20T21:19:35.623208+0000","last_peered":"2024-04-20T21:19:35.623208+0000","last_clean":"2024-04-20T21:19:35.623208+0000","last_became_active":"2024-04-20T21:19:29.380070+0000","last_became_peered":"2024-04-20T21:19:29.380070+0000","last_unstale":"2024-04-20T21:19:35.623208+0000","last_undegraded":"2024-04-20T21:19:35.623208+0000","last_fullsized":"2024-04-20T21:19:35.623208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:04:32.875201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777341+0000","last_change":"2024-04-20T21:19:29.384690+0000","last_active":"2024-04-20T21:19:35.777341+0000","last_peered":"2024-04-20T21:19:35.777341+0000","last_clean":"2024-04-20T21:19:35.777341+0000","last_became_active":"2024-04-20T21:19:29.383536+0000","last_became_peered":"2024-04-20T21:19:29.383536+0000","last_unstale":"2024-04-20T21:19:35.777341+0000","last_undegraded":"2024-04-20T21:19:35.777341+0000","last_fullsized":"2024-04-20T21:19:35.777341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622322+0000","last_change":"2024-04-20T21:19:29.380657+0000","last_active":"2024-04-20T21:19:35.622322+0000","last_peered":"2024-04-20T21:19:35.622322+0000","last_clean":"2024-04-20T21:19:35.622322+0000","last_became_active":"2024-04-20T21:19:29.380107+0000","last_became_peered":"2024-04-20T21:19:29.380107+0000","last_unstale":"2024-04-20T21:19:35.622322+0000","last_undegraded":"2024-04-20T21:19:35.622322+0000","last_fullsized":"2024-04-20T21:19:35.622322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777381+0000","last_change":"2024-04-20T21:19:29.388441+0000","last_active":"2024-04-20T21:19:35.777381+0000","last_peered":"2024-04-20T21:19:35.777381+0000","last_clean":"2024-04-20T21:19:35.777381+0000","last_became_active":"2024-04-20T21:19:29.388153+0000","last_became_peered":"2024-04-20T21:19:29.388153+0000","last_unstale":"2024-04-20T21:19:35.777381+0000","last_undegraded":"2024-04-20T21:19:35.777381+0000","last_fullsized":"2024-04-20T21:19:35.777381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:24:23.709381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248119+0000","last_change":"2024-04-20T21:19:29.381637+0000","last_active":"2024-04-20T21:19:36.248119+0000","last_peered":"2024-04-20T21:19:36.248119+0000","last_clean":"2024-04-20T21:19:36.248119+0000","last_became_active":"2024-04-20T21:19:29.380117+0000","last_became_peered":"2024-04-20T21:19:29.380117+0000","last_unstale":"2024-04-20T21:19:36.248119+0000","last_undegraded":"2024-04-20T21:19:36.248119+0000","last_fullsized":"2024-04-20T21:19:36.248119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628156+0000","last_change":"2024-04-20T21:19:29.371702+0000","last_active":"2024-04-20T21:19:35.628156+0000","last_peered":"2024-04-20T21:19:35.628156+0000","last_clean":"2024-04-20T21:19:35.628156+0000","last_became_active":"2024-04-20T21:19:29.371414+0000","last_became_peered":"2024-04-20T21:19:29.371414+0000","last_unstale":"2024-04-20T21:19:35.628156+0000","last_undegraded":"2024-04-20T21:19:35.628156+0000","last_fullsized":"2024-04-20T21:19:35.628156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251098+0000","last_change":"2024-04-20T21:19:29.389612+0000","last_active":"2024-04-20T21:19:36.251098+0000","last_peered":"2024-04-20T21:19:36.251098+0000","last_clean":"2024-04-20T21:19:36.251098+0000","last_became_active":"2024-04-20T21:19:29.389324+0000","last_became_peered":"2024-04-20T21:19:29.389324+0000","last_unstale":"2024-04-20T21:19:36.251098+0000","last_undegraded":"2024-04-20T21:19:36.251098+0000","last_fullsized":"2024-04-20T21:19:36.251098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:33.262857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249637+0000","last_change":"2024-04-20T21:19:29.382113+0000","last_active":"2024-04-20T21:19:36.249637+0000","last_peered":"2024-04-20T21:19:36.249637+0000","last_clean":"2024-04-20T21:19:36.249637+0000","last_became_active":"2024-04-20T21:19:29.381256+0000","last_became_peered":"2024-04-20T21:19:29.381256+0000","last_unstale":"2024-04-20T21:19:36.249637+0000","last_undegraded":"2024-04-20T21:19:36.249637+0000","last_fullsized":"2024-04-20T21:19:36.249637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:03:39.489134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778694+0000","last_change":"2024-04-20T21:19:29.395827+0000","last_active":"2024-04-20T21:19:35.778694+0000","last_peered":"2024-04-20T21:19:35.778694+0000","last_clean":"2024-04-20T21:19:35.778694+0000","last_became_active":"2024-04-20T21:19:29.395560+0000","last_became_peered":"2024-04-20T21:19:29.395560+0000","last_unstale":"2024-04-20T21:19:35.778694+0000","last_undegraded":"2024-04-20T21:19:35.778694+0000","last_fullsized":"2024-04-20T21:19:35.778694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:27:55.214090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.776970+0000","last_change":"2024-04-20T21:19:29.389510+0000","last_active":"2024-04-20T21:19:35.776970+0000","last_peered":"2024-04-20T21:19:35.776970+0000","last_clean":"2024-04-20T21:19:35.776970+0000","last_became_active":"2024-04-20T21:19:29.389143+0000","last_became_peered":"2024-04-20T21:19:29.389143+0000","last_unstale":"2024-04-20T21:19:35.776970+0000","last_undegraded":"2024-04-20T21:19:35.776970+0000","last_fullsized":"2024-04-20T21:19:35.776970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249525+0000","last_change":"2024-04-20T21:19:29.374703+0000","last_active":"2024-04-20T21:19:36.249525+0000","last_peered":"2024-04-20T21:19:36.249525+0000","last_clean":"2024-04-20T21:19:36.249525+0000","last_became_active":"2024-04-20T21:19:29.374027+0000","last_became_peered":"2024-04-20T21:19:29.374027+0000","last_unstale":"2024-04-20T21:19:36.249525+0000","last_undegraded":"2024-04-20T21:19:36.249525+0000","last_fullsized":"2024-04-20T21:19:36.249525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248059+0000","last_change":"2024-04-20T21:19:29.377330+0000","last_active":"2024-04-20T21:19:36.248059+0000","last_peered":"2024-04-20T21:19:36.248059+0000","last_clean":"2024-04-20T21:19:36.248059+0000","last_became_active":"2024-04-20T21:19:29.377054+0000","last_became_peered":"2024-04-20T21:19:29.377054+0000","last_unstale":"2024-04-20T21:19:36.248059+0000","last_undegraded":"2024-04-20T21:19:36.248059+0000","last_fullsized":"2024-04-20T21:19:36.248059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621838+0000","last_change":"2024-04-20T21:19:29.379509+0000","last_active":"2024-04-20T21:19:35.621838+0000","last_peered":"2024-04-20T21:19:35.621838+0000","last_clean":"2024-04-20T21:19:35.621838+0000","last_became_active":"2024-04-20T21:19:29.379077+0000","last_became_peered":"2024-04-20T21:19:29.379077+0000","last_unstale":"2024-04-20T21:19:35.621838+0000","last_undegraded":"2024-04-20T21:19:35.621838+0000","last_fullsized":"2024-04-20T21:19:35.621838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631470+0000","last_change":"2024-04-20T21:19:29.371610+0000","last_active":"2024-04-20T21:19:35.631470+0000","last_peered":"2024-04-20T21:19:35.631470+0000","last_clean":"2024-04-20T21:19:35.631470+0000","last_became_active":"2024-04-20T21:19:29.371194+0000","last_became_peered":"2024-04-20T21:19:29.371194+0000","last_unstale":"2024-04-20T21:19:35.631470+0000","last_undegraded":"2024-04-20T21:19:35.631470+0000","last_fullsized":"2024-04-20T21:19:35.631470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:19.225408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627705+0000","last_change":"2024-04-20T21:19:29.381261+0000","last_active":"2024-04-20T21:19:35.627705+0000","last_peered":"2024-04-20T21:19:35.627705+0000","last_clean":"2024-04-20T21:19:35.627705+0000","last_became_active":"2024-04-20T21:19:29.380856+0000","last_became_peered":"2024-04-20T21:19:29.380856+0000","last_unstale":"2024-04-20T21:19:35.627705+0000","last_undegraded":"2024-04-20T21:19:35.627705+0000","last_fullsized":"2024-04-20T21:19:35.627705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628482+0000","last_change":"2024-04-20T21:19:29.388748+0000","last_active":"2024-04-20T21:19:35.628482+0000","last_peered":"2024-04-20T21:19:35.628482+0000","last_clean":"2024-04-20T21:19:35.628482+0000","last_became_active":"2024-04-20T21:19:29.388227+0000","last_became_peered":"2024-04-20T21:19:29.388227+0000","last_unstale":"2024-04-20T21:19:35.628482+0000","last_undegraded":"2024-04-20T21:19:35.628482+0000","last_fullsized":"2024-04-20T21:19:35.628482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251764+0000","last_change":"2024-04-20T21:19:29.392148+0000","last_active":"2024-04-20T21:19:36.251764+0000","last_peered":"2024-04-20T21:19:36.251764+0000","last_clean":"2024-04-20T21:19:36.251764+0000","last_became_active":"2024-04-20T21:19:29.391719+0000","last_became_peered":"2024-04-20T21:19:29.391719+0000","last_unstale":"2024-04-20T21:19:36.251764+0000","last_undegraded":"2024-04-20T21:19:36.251764+0000","last_fullsized":"2024-04-20T21:19:36.251764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:31.354972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621658+0000","last_change":"2024-04-20T21:19:29.401358+0000","last_active":"2024-04-20T21:19:35.621658+0000","last_peered":"2024-04-20T21:19:35.621658+0000","last_clean":"2024-04-20T21:19:35.621658+0000","last_became_active":"2024-04-20T21:19:29.401015+0000","last_became_peered":"2024-04-20T21:19:29.401015+0000","last_unstale":"2024-04-20T21:19:35.621658+0000","last_undegraded":"2024-04-20T21:19:35.621658+0000","last_fullsized":"2024-04-20T21:19:35.621658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249862+0000","last_change":"2024-04-20T21:19:29.378374+0000","last_active":"2024-04-20T21:19:36.249862+0000","last_peered":"2024-04-20T21:19:36.249862+0000","last_clean":"2024-04-20T21:19:36.249862+0000","last_became_active":"2024-04-20T21:19:29.377992+0000","last_became_peered":"2024-04-20T21:19:29.377992+0000","last_unstale":"2024-04-20T21:19:36.249862+0000","last_undegraded":"2024-04-20T21:19:36.249862+0000","last_fullsized":"2024-04-20T21:19:36.249862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:01:25.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777114+0000","last_change":"2024-04-20T21:19:29.388283+0000","last_active":"2024-04-20T21:19:35.777114+0000","last_peered":"2024-04-20T21:19:35.777114+0000","last_clean":"2024-04-20T21:19:35.777114+0000","last_became_active":"2024-04-20T21:19:29.386243+0000","last_became_peered":"2024-04-20T21:19:29.386243+0000","last_unstale":"2024-04-20T21:19:35.777114+0000","last_undegraded":"2024-04-20T21:19:35.777114+0000","last_fullsized":"2024-04-20T21:19:35.777114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249862+0000","last_change":"2024-04-20T21:19:29.387887+0000","last_active":"2024-04-20T21:19:36.249862+0000","last_peered":"2024-04-20T21:19:36.249862+0000","last_clean":"2024-04-20T21:19:36.249862+0000","last_became_active":"2024-04-20T21:19:29.387481+0000","last_became_peered":"2024-04-20T21:19:29.387481+0000","last_unstale":"2024-04-20T21:19:36.249862+0000","last_undegraded":"2024-04-20T21:19:36.249862+0000","last_fullsized":"2024-04-20T21:19:36.249862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:27:55.214090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777684+0000","last_change":"2024-04-20T21:19:29.397568+0000","last_active":"2024-04-20T21:19:35.777684+0000","last_peered":"2024-04-20T21:19:35.777684+0000","last_clean":"2024-04-20T21:19:35.777684+0000","last_became_active":"2024-04-20T21:19:29.397258+0000","last_became_peered":"2024-04-20T21:19:29.397258+0000","last_unstale":"2024-04-20T21:19:35.777684+0000","last_undegraded":"2024-04-20T21:19:35.777684+0000","last_fullsized":"2024-04-20T21:19:35.777684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:01:25.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249144+0000","last_change":"2024-04-20T21:19:29.391755+0000","last_active":"2024-04-20T21:19:36.249144+0000","last_peered":"2024-04-20T21:19:36.249144+0000","last_clean":"2024-04-20T21:19:36.249144+0000","last_became_active":"2024-04-20T21:19:29.389939+0000","last_became_peered":"2024-04-20T21:19:29.389939+0000","last_unstale":"2024-04-20T21:19:36.249144+0000","last_undegraded":"2024-04-20T21:19:36.249144+0000","last_fullsized":"2024-04-20T21:19:36.249144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249430+0000","last_change":"2024-04-20T21:19:29.383237+0000","last_active":"2024-04-20T21:19:36.249430+0000","last_peered":"2024-04-20T21:19:36.249430+0000","last_clean":"2024-04-20T21:19:36.249430+0000","last_became_active":"2024-04-20T21:19:29.382910+0000","last_became_peered":"2024-04-20T21:19:29.382910+0000","last_unstale":"2024-04-20T21:19:36.249430+0000","last_undegraded":"2024-04-20T21:19:36.249430+0000","last_fullsized":"2024-04-20T21:19:36.249430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251604+0000","last_change":"2024-04-20T21:19:29.382459+0000","last_active":"2024-04-20T21:19:36.251604+0000","last_peered":"2024-04-20T21:19:36.251604+0000","last_clean":"2024-04-20T21:19:36.251604+0000","last_became_active":"2024-04-20T21:19:29.382142+0000","last_became_peered":"2024-04-20T21:19:29.382142+0000","last_unstale":"2024-04-20T21:19:36.251604+0000","last_undegraded":"2024-04-20T21:19:36.251604+0000","last_fullsized":"2024-04-20T21:19:36.251604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:01.897496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T21:19:53.588 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-20T21:19:53.588 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-20T21:19:53.588 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-20T21:19:53.588 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-20T21:19:53.589 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-20T21:19:53.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.828+0000 7fe246e00640 1 Processor -- start 2024-04-20T21:19:53.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.828+0000 7fe246e00640 1 -- start start 2024-04-20T21:19:53.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.830+0000 7fe246e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe24015c360 0x7fe240166250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.830+0000 7fe246e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24006ccc0 con 0x7fe24015b7e0 2024-04-20T21:19:53.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.830+0000 7fe246e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24006cfa0 con 0x7fe24015b400 2024-04-20T21:19:53.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.830+0000 7fe246e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe24006d280 con 0x7fe24015c360 2024-04-20T21:19:53.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.830+0000 7fe245000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe24015b7e0 0x7fe24015bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46284/0 (socket says 172.21.15.71:46284) 2024-04-20T21:19:53.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.830+0000 7fe245000640 1 -- 172.21.15.71:0/3443914526 learned_addr learned my addr 172.21.15.71:0/3443914526 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:53.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.830+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264961979 0 0) 0x7fe24006ccc0 con 0x7fe24015b7e0 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.830+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe228005730 con 0x7fe24015b7e0 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.830+0000 7fe246400640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe24015c360 0x7fe240166250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1673376329 0 0) 0x7fe228005730 con 0x7fe24015b7e0 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe24015c360 msgr2=0x7fe240166250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe24015c360 0x7fe240166250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 >> v1:172.21.15.137:6789/0 conn(0x7fe24015b400 legacy=0x7fe240072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24006e440 con 0x7fe24015b7e0 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fe22c001670 con 0x7fe24015b7e0 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 >> v1:172.21.15.71:6789/0 conn(0x7fe24015b7e0 legacy=0x7fe24015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 0x7fe228006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe228006a10 0x7fe228006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe24015c360 0x7fe228007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe24006d280 con 0x7fe228005bf0 2024-04-20T21:19:53.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe22800dd30 con 0x7fe228006a10 2024-04-20T21:19:53.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe22800df30 con 0x7fe24015c360 2024-04-20T21:19:53.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.831+0000 7fe245a00640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 0x7fe228006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.832+0000 7fe245a00640 1 -- 172.21.15.71:0/3443914526 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe24015c360 msgr2=0x7fe228007410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:53.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.832+0000 7fe245a00640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe24015c360 0x7fe228007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.832+0000 7fe245000640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe228006a10 0x7fe228006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.832+0000 7fe245a00640 1 -- 172.21.15.71:0/3443914526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe228006a10 msgr2=0x7fe228006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:53.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.832+0000 7fe245a00640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe228006a10 0x7fe228006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.832+0000 7fe245a00640 1 -- 172.21.15.71:0/3443914526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe228005730 con 0x7fe228005bf0 2024-04-20T21:19:53.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.832+0000 7fe245000640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe228006a10 0x7fe228006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:53.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.833+0000 7fe245a00640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 0x7fe228006010 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe234001750 tx=0x7fe228007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152d8422e9c6727e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:53.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.833+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234001370 con 0x7fe228005bf0 2024-04-20T21:19:53.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.833+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2340052d0 con 0x7fe228005bf0 2024-04-20T21:19:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.833+0000 7fe23fe00640 1 -- 172.21.15.71:0/3443914526 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234003830 con 0x7fe228005bf0 2024-04-20T21:19:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.833+0000 7fe246e00640 1 -- 172.21.15.71:0/3443914526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 msgr2=0x7fe228006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.833+0000 7fe246e00640 1 --2- 172.21.15.71:0/3443914526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 0x7fe228006010 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe234001750 tx=0x7fe228007a40 comp rx=0 tx=0).stop 2024-04-20T21:19:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.833+0000 7fe246400640 1 -- 172.21.15.71:0/3443914526 reap_dead start 2024-04-20T21:19:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.834+0000 7fe246e00640 1 -- 172.21.15.71:0/3443914526 shutdown_connections 2024-04-20T21:19:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.834+0000 7fe246e00640 1 -- 172.21.15.71:0/3443914526 >> 172.21.15.71:0/3443914526 conn(0x7fe2400d0040 msgr2=0x7fe2400d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.834+0000 7fe246e00640 1 -- 172.21.15.71:0/3443914526 shutdown_connections 2024-04-20T21:19:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.834+0000 7fe246e00640 1 -- 172.21.15.71:0/3443914526 wait complete. 2024-04-20T21:19:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.835+0000 7fe246e00640 1 Processor -- start 2024-04-20T21:19:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.835+0000 7fe246e00640 1 -- start start 2024-04-20T21:19:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.836+0000 7fe246e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 0x7fe24009d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.836+0000 7fe246e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2401e5e50 0x7fe2401e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.836+0000 7fe246e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe24009ad00 0x7fe24009b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.836+0000 7fe246e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe24006fc50 con 0x7fe228005bf0 2024-04-20T21:19:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.836+0000 7fe246e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe24015c7c0 con 0x7fe24009ad00 2024-04-20T21:19:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.836+0000 7fe246e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe24006fdd0 con 0x7fe2401e5e50 2024-04-20T21:19:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.837+0000 7fe245a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 0x7fe24009d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.837+0000 7fe245a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 0x7fe24009d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44690/0 (socket says 172.21.15.71:44690) 2024-04-20T21:19:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.837+0000 7fe245a00640 1 -- 172.21.15.71:0/1495304254 learned_addr learned my addr 172.21.15.71:0/1495304254 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:53.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.837+0000 7fe245a00640 1 -- 172.21.15.71:0/1495304254 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2401e5e50 msgr2=0x7fe2401e62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.837+0000 7fe245a00640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2401e5e50 0x7fe2401e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.837+0000 7fe245a00640 1 -- 172.21.15.71:0/1495304254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe24009ad00 msgr2=0x7fe24009b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:53.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.837+0000 7fe246400640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe24009ad00 0x7fe24009b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.837+0000 7fe245a00640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe24009ad00 0x7fe24009b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:53.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.837+0000 7fe245a00640 1 -- 172.21.15.71:0/1495304254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24009ba30 con 0x7fe228005bf0 2024-04-20T21:19:53.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.837+0000 7fe245a00640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 0x7fe24009d1e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe234008fd0 tx=0x7fe234001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:53.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.838+0000 7fe23d600640 1 -- 172.21.15.71:0/1495304254 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234041070 con 0x7fe228005bf0 2024-04-20T21:19:53.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.838+0000 7fe23d600640 1 -- 172.21.15.71:0/1495304254 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe234005480 con 0x7fe228005bf0 2024-04-20T21:19:53.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.838+0000 7fe23d600640 1 -- 172.21.15.71:0/1495304254 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234001370 con 0x7fe228005bf0 2024-04-20T21:19:53.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.838+0000 7fe246e00640 1 -- 172.21.15.71:0/1495304254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24009bd10 con 0x7fe228005bf0 2024-04-20T21:19:53.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.838+0000 7fe246e00640 1 -- 172.21.15.71:0/1495304254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24009c2d0 con 0x7fe228005bf0 2024-04-20T21:19:53.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.839+0000 7fe246e00640 1 -- 172.21.15.71:0/1495304254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe240075b60 con 0x7fe228005bf0 2024-04-20T21:19:53.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.840+0000 7fe23d600640 1 -- 172.21.15.71:0/1495304254 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe234044070 con 0x7fe228005bf0 2024-04-20T21:19:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.841+0000 7fe23d600640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe22006c970 0x7fe22006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.841+0000 7fe23d600640 1 -- 172.21.15.71:0/1495304254 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe2340ad860 con 0x7fe228005bf0 2024-04-20T21:19:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.841+0000 7fe245000640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe22006c970 0x7fe22006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.842+0000 7fe245000640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe22006c970 0x7fe22006ee30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0017e0 tx=0x7fe22c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:53.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:53.845+0000 7fe23d600640 1 -- 172.21.15.71:0/1495304254 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe23407b930 con 0x7fe228005bf0 2024-04-20T21:19:54.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.094+0000 7fe246e00640 1 -- 172.21.15.71:0/1495304254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe2400b5220 con 0x7fe228005bf0 2024-04-20T21:19:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.099+0000 7fe23d600640 1 -- 172.21.15.71:0/1495304254 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174136 (secure 0 0 0) 0x7fe23407b230 con 0x7fe228005bf0 2024-04-20T21:19:54.100 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.103+0000 7fe246e00640 1 -- 172.21.15.71:0/1495304254 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe22006c970 msgr2=0x7fe22006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.103+0000 7fe246e00640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe22006c970 0x7fe22006ee30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0017e0 tx=0x7fe22c009040 comp rx=0 tx=0).stop 2024-04-20T21:19:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.103+0000 7fe246e00640 1 -- 172.21.15.71:0/1495304254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 msgr2=0x7fe24009d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.103+0000 7fe246e00640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 0x7fe24009d1e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe234008fd0 tx=0x7fe234001120 comp rx=0 tx=0).stop 2024-04-20T21:19:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.103+0000 7fe246e00640 1 -- 172.21.15.71:0/1495304254 shutdown_connections 2024-04-20T21:19:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.103+0000 7fe246e00640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe22006c970 0x7fe22006ee30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.103+0000 7fe246e00640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe24009ad00 0x7fe24009b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.103+0000 7fe246e00640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2401e5e50 0x7fe2401e62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.103+0000 7fe246e00640 1 --2- 172.21.15.71:0/1495304254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe228005bf0 0x7fe24009d1e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.103+0000 7fe246e00640 1 -- 172.21.15.71:0/1495304254 >> 172.21.15.71:0/1495304254 conn(0x7fe2400d0040 msgr2=0x7fe2400b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.104+0000 7fe246e00640 1 -- 172.21.15.71:0/1495304254 shutdown_connections 2024-04-20T21:19:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.104+0000 7fe246e00640 1 -- 172.21.15.71:0/1495304254 wait complete. 2024-04-20T21:19:54.121 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":1511456036},{"type":"v1","addr":"172.21.15.71:6833","nonce":1511456036}]},"active_addr":"172.21.15.71:6833/1511456036","active_change":"2024-04-20T21:19:09.776416+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4120,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":306595878}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":3486759628}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":3361172717}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1479084920}]}]} 2024-04-20T21:19:54.124 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-20T21:19:54.124 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-20T21:19:54.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:54.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.317+0000 7fdff8a00640 1 Processor -- start 2024-04-20T21:19:54.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.317+0000 7fdff8a00640 1 -- start start 2024-04-20T21:19:54.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.318+0000 7fdff8a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdff415ca40 0x7fdff40ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.318+0000 7fdff8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 0x7fdff40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.318+0000 7fdff8a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff4141c60 con 0x7fdff4156c20 2024-04-20T21:19:54.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.318+0000 7fdff8a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdff406c010 con 0x7fdff415ca40 2024-04-20T21:19:54.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.318+0000 7fdff8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdff415cf90 con 0x7fdff40ad8e0 2024-04-20T21:19:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.319+0000 7fdff2800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 0x7fdff40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.319+0000 7fdff2800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 0x7fdff40d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:37080/0 (socket says 172.21.15.71:37080) 2024-04-20T21:19:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.319+0000 7fdff2800640 1 -- 172.21.15.71:0/3401178945 learned_addr learned my addr 172.21.15.71:0/3401178945 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.319+0000 7fdff1e00640 1 --1- 172.21.15.71:0/3401178945 >> v1:172.21.15.137:6789/0 conn(0x7fdff4156c20 0x7fdff406b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:40168/0 (socket says 172.21.15.71:40168) 2024-04-20T21:19:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.320+0000 7fdfebe00640 1 --2- 172.21.15.71:0/3401178945 >> v2:172.21.15.137:3300/0 conn(0x7fdff415ca40 0x7fdff40ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.320+0000 7fdff1400640 1 -- 172.21.15.71:0/3401178945 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4111764205 0 0) 0x7fdff4141c60 con 0x7fdff4156c20 2024-04-20T21:19:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.320+0000 7fdff1400640 1 -- 172.21.15.71:0/3401178945 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfd8003520 con 0x7fdff4156c20 2024-04-20T21:19:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.320+0000 7fdfebe00640 1 -- 172.21.15.71:0/3401178945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 msgr2=0x7fdff40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.320+0000 7fdfebe00640 1 --2- 172.21.15.71:0/3401178945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 0x7fdff40d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.320+0000 7fdfebe00640 1 -- 172.21.15.71:0/3401178945 >> v1:172.21.15.137:6789/0 conn(0x7fdff4156c20 legacy=0x7fdff406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.320+0000 7fdfebe00640 1 -- 172.21.15.71:0/3401178945 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff415d270 con 0x7fdff415ca40 2024-04-20T21:19:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.322+0000 7fdfebe00640 1 --2- 172.21.15.71:0/3401178945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdff415ca40 0x7fdff40ad3a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0097a0 tx=0x7fdfdc02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=946078b8c1abf438 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.322+0000 7fdff1400640 1 -- 172.21.15.71:0/3401178945 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc035020 con 0x7fdff415ca40 2024-04-20T21:19:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.322+0000 7fdff1400640 1 -- 172.21.15.71:0/3401178945 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfdc031810 con 0x7fdff415ca40 2024-04-20T21:19:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.322+0000 7fdff1400640 1 -- 172.21.15.71:0/3401178945 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc031bc0 con 0x7fdff415ca40 2024-04-20T21:19:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.323+0000 7fdff8a00640 1 -- 172.21.15.71:0/3401178945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdff415ca40 msgr2=0x7fdff40ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.323+0000 7fdff8a00640 1 --2- 172.21.15.71:0/3401178945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdff415ca40 0x7fdff40ad3a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0097a0 tx=0x7fdfdc02b8b0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.323+0000 7fdff8a00640 1 -- 172.21.15.71:0/3401178945 shutdown_connections 2024-04-20T21:19:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.323+0000 7fdff8a00640 1 --2- 172.21.15.71:0/3401178945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 0x7fdff40d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.323+0000 7fdff8a00640 1 --2- 172.21.15.71:0/3401178945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdff415ca40 0x7fdff40ad3a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.323+0000 7fdff8a00640 1 -- 172.21.15.71:0/3401178945 >> 172.21.15.71:0/3401178945 conn(0x7fdff40b3350 msgr2=0x7fdff40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.323+0000 7fdff8a00640 1 -- 172.21.15.71:0/3401178945 shutdown_connections 2024-04-20T21:19:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.323+0000 7fdff8a00640 1 -- 172.21.15.71:0/3401178945 wait complete. 2024-04-20T21:19:54.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.325+0000 7fdff8a00640 1 Processor -- start 2024-04-20T21:19:54.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.325+0000 7fdff8a00640 1 -- start start 2024-04-20T21:19:54.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.326+0000 7fdff8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 0x7fdff41f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.326+0000 7fdff8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff4156c20 0x7fdff414c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.326+0000 7fdff8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdff415ca40 0x7fdff414c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.326+0000 7fdff8a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdff40d08a0 con 0x7fdff4156c20 2024-04-20T21:19:54.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.326+0000 7fdff8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdff415d830 con 0x7fdff415ca40 2024-04-20T21:19:54.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.326+0000 7fdff8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdff40d0a20 con 0x7fdff40ad8e0 2024-04-20T21:19:54.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.326+0000 7fdfebe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff4156c20 0x7fdff414c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.327+0000 7fdfebe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff4156c20 0x7fdff414c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44704/0 (socket says 172.21.15.71:44704) 2024-04-20T21:19:54.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.327+0000 7fdfebe00640 1 -- 172.21.15.71:0/2674923593 learned_addr learned my addr 172.21.15.71:0/2674923593 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:54.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.327+0000 7fdff2800640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdff415ca40 0x7fdff414c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.327+0000 7fdff1e00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 0x7fdff41f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.327+0000 7fdfebe00640 1 -- 172.21.15.71:0/2674923593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 msgr2=0x7fdff41f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.327+0000 7fdfebe00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 0x7fdff41f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.327+0000 7fdfebe00640 1 -- 172.21.15.71:0/2674923593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdff415ca40 msgr2=0x7fdff414c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.327+0000 7fdfebe00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdff415ca40 0x7fdff414c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.327+0000 7fdfebe00640 1 -- 172.21.15.71:0/2674923593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff414d2d0 con 0x7fdff4156c20 2024-04-20T21:19:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.327+0000 7fdff1e00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 0x7fdff41f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.327+0000 7fdfebe00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff4156c20 0x7fdff414c090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc02b8f0 tx=0x7fdfdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:54.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.328+0000 7fdfea000640 1 -- 172.21.15.71:0/2674923593 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc035070 con 0x7fdff4156c20 2024-04-20T21:19:54.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.328+0000 7fdfea000640 1 -- 172.21.15.71:0/2674923593 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfdc003610 con 0x7fdff4156c20 2024-04-20T21:19:54.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.328+0000 7fdfea000640 1 -- 172.21.15.71:0/2674923593 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc006e10 con 0x7fdff4156c20 2024-04-20T21:19:54.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.328+0000 7fdff8a00640 1 -- 172.21.15.71:0/2674923593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff414d5b0 con 0x7fdff4156c20 2024-04-20T21:19:54.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.328+0000 7fdff8a00640 1 -- 172.21.15.71:0/2674923593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff40cd5e0 con 0x7fdff4156c20 2024-04-20T21:19:54.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.329+0000 7fdff8a00640 1 -- 172.21.15.71:0/2674923593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff4068980 con 0x7fdff4156c20 2024-04-20T21:19:54.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.330+0000 7fdfea000640 1 -- 172.21.15.71:0/2674923593 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfdc038020 con 0x7fdff4156c20 2024-04-20T21:19:54.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.331+0000 7fdfea000640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c8f0 0x7fdfd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.331+0000 7fdfea000640 1 -- 172.21.15.71:0/2674923593 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdfdc0adbc0 con 0x7fdff4156c20 2024-04-20T21:19:54.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.331+0000 7fdff1e00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c8f0 0x7fdfd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.332+0000 7fdff1e00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c8f0 0x7fdfd006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4000f60 tx=0x7fdfe4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:54.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.336+0000 7fdfea000640 1 -- 172.21.15.71:0/2674923593 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fdfdc07bcc0 con 0x7fdff4156c20 2024-04-20T21:19:54.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.534+0000 7fdff8a00640 1 -- 172.21.15.71:0/2674923593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdff40cfd90 con 0x7fdff4156c20 2024-04-20T21:19:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.537+0000 7fdfea000640 1 -- 172.21.15.71:0/2674923593 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fdfdc07b5c0 con 0x7fdff4156c20 2024-04-20T21:19:54.537 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:54.537 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.539+0000 7fdff8a00640 1 -- 172.21.15.71:0/2674923593 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c8f0 msgr2=0x7fdfd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.539+0000 7fdff8a00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c8f0 0x7fdfd006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4000f60 tx=0x7fdfe4009040 comp rx=0 tx=0).stop 2024-04-20T21:19:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.539+0000 7fdff8a00640 1 -- 172.21.15.71:0/2674923593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff4156c20 msgr2=0x7fdff414c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.539+0000 7fdff8a00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff4156c20 0x7fdff414c090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc02b8f0 tx=0x7fdfdc0046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.539+0000 7fdff8a00640 1 -- 172.21.15.71:0/2674923593 shutdown_connections 2024-04-20T21:19:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.539+0000 7fdff8a00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdfd006c8f0 0x7fdfd006edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.540+0000 7fdff8a00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdff415ca40 0x7fdff414c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.540+0000 7fdff8a00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdff4156c20 0x7fdff414c090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.540+0000 7fdff8a00640 1 --2- 172.21.15.71:0/2674923593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdff40ad8e0 0x7fdff41f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.540+0000 7fdff8a00640 1 -- 172.21.15.71:0/2674923593 >> 172.21.15.71:0/2674923593 conn(0x7fdff40b3350 msgr2=0x7fdff415db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.540+0000 7fdff8a00640 1 -- 172.21.15.71:0/2674923593 shutdown_connections 2024-04-20T21:19:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.540+0000 7fdff8a00640 1 -- 172.21.15.71:0/2674923593 wait complete. 2024-04-20T21:19:54.558 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-20T21:19:54.559 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:54.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.745+0000 7fc1bbe00640 1 Processor -- start 2024-04-20T21:19:54.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.745+0000 7fc1bbe00640 1 -- start start 2024-04-20T21:19:54.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.746+0000 7fc1bbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc161d50 0x7fc1bc0d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.746+0000 7fc1bbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc1bc0b3330 0x7fc1bc0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.746+0000 7fc1bbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1bc06c6d0 0x7fc1bc06cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.746+0000 7fc1bbe00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc1bc162130 con 0x7fc1bc0b3330 2024-04-20T21:19:54.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.747+0000 7fc1bbe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc1bc06c190 con 0x7fc1bc06c6d0 2024-04-20T21:19:54.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.747+0000 7fc1bbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc1bc06c470 con 0x7fc1bc161d50 2024-04-20T21:19:54.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.747+0000 7fc1b2000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc1bc0b3330 0x7fc1bc0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.747+0000 7fc1b2000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc1bc0b3330 0x7fc1bc0b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44712/0 (socket says 172.21.15.71:44712) 2024-04-20T21:19:54.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.747+0000 7fc1b2000640 1 -- 172.21.15.71:0/500294755 learned_addr learned my addr 172.21.15.71:0/500294755 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:54.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.747+0000 7fc1baa00640 1 --2- 172.21.15.71:0/500294755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc161d50 0x7fc1bc0d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.747+0000 7fc1b2000640 1 -- 172.21.15.71:0/500294755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc161d50 msgr2=0x7fc1bc0d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:54.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.747+0000 7fc1b2000640 1 --2- 172.21.15.71:0/500294755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc161d50 0x7fc1bc0d38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.747+0000 7fc1b2000640 1 -- 172.21.15.71:0/500294755 >> v2:172.21.15.137:3300/0 conn(0x7fc1bc06c6d0 msgr2=0x7fc1bc06cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:54.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.747+0000 7fc1b2000640 1 --2- 172.21.15.71:0/500294755 >> v2:172.21.15.137:3300/0 conn(0x7fc1bc06c6d0 0x7fc1bc06cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.747+0000 7fc1b2000640 1 -- 172.21.15.71:0/500294755 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1bc0d2e00 con 0x7fc1bc0b3330 2024-04-20T21:19:54.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.748+0000 7fc1b2000640 1 --2- 172.21.15.71:0/500294755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc0b3330 0x7fc1bc0b3880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0b32e0 tx=0x7fc1a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a502fa05b8cfcc8a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:54.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.749+0000 7fc1ba000640 1 -- 172.21.15.71:0/500294755 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4035020 con 0x7fc1bc0b3330 2024-04-20T21:19:54.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.749+0000 7fc1ba000640 1 -- 172.21.15.71:0/500294755 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a4031870 con 0x7fc1bc0b3330 2024-04-20T21:19:54.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.749+0000 7fc1ba000640 1 -- 172.21.15.71:0/500294755 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4031c40 con 0x7fc1bc0b3330 2024-04-20T21:19:54.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.750+0000 7fc1bbe00640 1 -- 172.21.15.71:0/500294755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc0b3330 msgr2=0x7fc1bc0b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.750+0000 7fc1bbe00640 1 --2- 172.21.15.71:0/500294755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc0b3330 0x7fc1bc0b3880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0b32e0 tx=0x7fc1a402b910 comp rx=0 tx=0).stop 2024-04-20T21:19:54.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.750+0000 7fc1bbe00640 1 -- 172.21.15.71:0/500294755 shutdown_connections 2024-04-20T21:19:54.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.750+0000 7fc1bbe00640 1 --2- 172.21.15.71:0/500294755 >> v2:172.21.15.137:3300/0 conn(0x7fc1bc06c6d0 0x7fc1bc06cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.750+0000 7fc1bbe00640 1 --2- 172.21.15.71:0/500294755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc0b3330 0x7fc1bc0b3880 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.750+0000 7fc1bbe00640 1 --2- 172.21.15.71:0/500294755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc161d50 0x7fc1bc0d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.750+0000 7fc1bbe00640 1 -- 172.21.15.71:0/500294755 >> 172.21.15.71:0/500294755 conn(0x7fc1bc0d4450 msgr2=0x7fc1bc0d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:54.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.750+0000 7fc1bbe00640 1 -- 172.21.15.71:0/500294755 shutdown_connections 2024-04-20T21:19:54.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.750+0000 7fc1bbe00640 1 -- 172.21.15.71:0/500294755 wait complete. 2024-04-20T21:19:54.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.752+0000 7fc1bbe00640 1 Processor -- start 2024-04-20T21:19:54.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.752+0000 7fc1bbe00640 1 -- start start 2024-04-20T21:19:54.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.753+0000 7fc1bbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc06c6d0 0x7fc1bc0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.753+0000 7fc1bbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc0b3330 0x7fc1bc1f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.753+0000 7fc1bbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1bc161d50 0x7fc1bc14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.753+0000 7fc1bbe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc0cfa00 con 0x7fc1bc0b3330 2024-04-20T21:19:54.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.753+0000 7fc1bbe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc0d33c0 con 0x7fc1bc161d50 2024-04-20T21:19:54.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.753+0000 7fc1bbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc1bc0cfb80 con 0x7fc1bc06c6d0 2024-04-20T21:19:54.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1b2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc0b3330 0x7fc1bc1f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1b2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc0b3330 0x7fc1bc1f4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44724/0 (socket says 172.21.15.71:44724) 2024-04-20T21:19:54.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1b2000640 1 -- 172.21.15.71:0/2732993364 learned_addr learned my addr 172.21.15.71:0/2732993364 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1bb400640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1bc161d50 0x7fc1bc14d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1baa00640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc06c6d0 0x7fc1bc0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1b2000640 1 -- 172.21.15.71:0/2732993364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc06c6d0 msgr2=0x7fc1bc0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1b2000640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc06c6d0 0x7fc1bc0cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1b2000640 1 -- 172.21.15.71:0/2732993364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1bc161d50 msgr2=0x7fc1bc14d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1b2000640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1bc161d50 0x7fc1bc14d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1b2000640 1 -- 172.21.15.71:0/2732993364 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1bc0cc8b0 con 0x7fc1bc0b3330 2024-04-20T21:19:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1bb400640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1bc161d50 0x7fc1bc14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.754+0000 7fc1b2000640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc0b3330 0x7fc1bc1f4660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1a402b950 tx=0x7fc1a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.755+0000 7fc1b3e00640 1 -- 172.21.15.71:0/2732993364 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4040070 con 0x7fc1bc0b3330 2024-04-20T21:19:54.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.755+0000 7fc1b3e00640 1 -- 172.21.15.71:0/2732993364 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a403a420 con 0x7fc1bc0b3330 2024-04-20T21:19:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.755+0000 7fc1b3e00640 1 -- 172.21.15.71:0/2732993364 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4035040 con 0x7fc1bc0b3330 2024-04-20T21:19:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.755+0000 7fc1bbe00640 1 -- 172.21.15.71:0/2732993364 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1bc0ccb90 con 0x7fc1bc0b3330 2024-04-20T21:19:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.755+0000 7fc1bbe00640 1 -- 172.21.15.71:0/2732993364 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1bc0cd150 con 0x7fc1bc0b3330 2024-04-20T21:19:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.756+0000 7fc1bbe00640 1 -- 172.21.15.71:0/2732993364 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1bc075b60 con 0x7fc1bc0b3330 2024-04-20T21:19:54.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.757+0000 7fc1b3e00640 1 -- 172.21.15.71:0/2732993364 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc1a404b060 con 0x7fc1bc0b3330 2024-04-20T21:19:54.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.758+0000 7fc1b3e00640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c8f0 0x7fc19806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:54.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.759+0000 7fc1b3e00640 1 -- 172.21.15.71:0/2732993364 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc1a40adeb0 con 0x7fc1bc0b3330 2024-04-20T21:19:54.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.759+0000 7fc1baa00640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c8f0 0x7fc19806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:54.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.759+0000 7fc1baa00640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c8f0 0x7fc19806edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac008e50 tx=0x7fc1ac0083a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:54.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.763+0000 7fc1b3e00640 1 -- 172.21.15.71:0/2732993364 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc1a407bf90 con 0x7fc1bc0b3330 2024-04-20T21:19:54.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.965+0000 7fc1bbe00640 1 -- 172.21.15.71:0/2732993364 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1bc0cf410 con 0x7fc1bc0b3330 2024-04-20T21:19:54.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.968+0000 7fc1b3e00640 1 -- 172.21.15.71:0/2732993364 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fc1a407b890 con 0x7fc1bc0b3330 2024-04-20T21:19:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:54.969 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:54.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 -- 172.21.15.71:0/2732993364 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c8f0 msgr2=0x7fc19806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c8f0 0x7fc19806edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac008e50 tx=0x7fc1ac0083a0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 -- 172.21.15.71:0/2732993364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc0b3330 msgr2=0x7fc1bc1f4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:54.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc0b3330 0x7fc1bc1f4660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1a402b950 tx=0x7fc1a40046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 -- 172.21.15.71:0/2732993364 shutdown_connections 2024-04-20T21:19:54.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c8f0 0x7fc19806edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1bc161d50 0x7fc1bc14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc0b3330 0x7fc1bc1f4660 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 --2- 172.21.15.71:0/2732993364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc06c6d0 0x7fc1bc0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:54.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 -- 172.21.15.71:0/2732993364 >> 172.21.15.71:0/2732993364 conn(0x7fc1bc0d4450 msgr2=0x7fc1bc0b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:54.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 -- 172.21.15.71:0/2732993364 shutdown_connections 2024-04-20T21:19:54.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:54.971+0000 7fc1bbe00640 1 -- 172.21.15.71:0/2732993364 wait complete. 2024-04-20T21:19:54.990 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-20T21:19:54.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-20T21:19:54.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-20T21:19:54.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-20T21:19:54.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-20T21:19:54.993 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-20T21:19:54.993 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-20T21:19:54.993 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-20T21:19:55.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.281+0000 7fd16d000640 1 Processor -- start 2024-04-20T21:19:55.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.281+0000 7fd16d000640 1 -- start start 2024-04-20T21:19:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.283+0000 7fd16d000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd16815e770 0x7fd1680b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.283+0000 7fd16d000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1680d3590 con 0x7fd168162210 2024-04-20T21:19:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.283+0000 7fd16d000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1680d3870 con 0x7fd168162670 2024-04-20T21:19:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.283+0000 7fd16d000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd168162ae0 con 0x7fd16815e770 2024-04-20T21:19:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.284+0000 7fd166a00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd168162210 0x7fd1680b6400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46290/0 (socket says 172.21.15.71:46290) 2024-04-20T21:19:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.284+0000 7fd166a00640 1 -- 172.21.15.71:0/1857095321 learned_addr learned my addr 172.21.15.71:0/1857095321 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:55.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.285+0000 7fd167400640 1 --2- 172.21.15.71:0/1857095321 >> v2:172.21.15.71:3300/0 conn(0x7fd16815e770 0x7fd1680b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.286+0000 7fd166000640 1 -- 172.21.15.71:0/1857095321 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374293468 0 0) 0x7fd1680d3590 con 0x7fd168162210 2024-04-20T21:19:55.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.287+0000 7fd166000640 1 -- 172.21.15.71:0/1857095321 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd14c003520 con 0x7fd168162210 2024-04-20T21:19:55.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.287+0000 7fd166000640 1 -- 172.21.15.71:0/1857095321 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891521814 0 0) 0x7fd1680d3870 con 0x7fd168162670 2024-04-20T21:19:55.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.287+0000 7fd166000640 1 -- 172.21.15.71:0/1857095321 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1680d3590 con 0x7fd168162670 2024-04-20T21:19:55.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.287+0000 7fd167400640 1 -- 172.21.15.71:0/1857095321 >> v1:172.21.15.137:6789/0 conn(0x7fd168162670 legacy=0x7fd1680d42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.287+0000 7fd167400640 1 -- 172.21.15.71:0/1857095321 >> v1:172.21.15.71:6789/0 conn(0x7fd168162210 legacy=0x7fd1680b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.287+0000 7fd167400640 1 -- 172.21.15.71:0/1857095321 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1680d3b50 con 0x7fd16815e770 2024-04-20T21:19:55.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.287+0000 7fc027600640 1 Processor -- start 2024-04-20T21:19:55.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.287+0000 7f4740a00640 1 Processor -- start 2024-04-20T21:19:55.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.287+0000 7fc027600640 1 -- start start 2024-04-20T21:19:55.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.287+0000 7f4740a00640 1 -- start start 2024-04-20T21:19:55.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.289+0000 7fc027600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0200d1a00 0x7fc0200b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.289+0000 7fc027600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0200b17d0 0x7fc0200d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.289+0000 7fc027600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0200d1e60 con 0x7fc0200d4270 2024-04-20T21:19:55.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.289+0000 7fc027600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc0200d40c0 con 0x7fc0200b17d0 2024-04-20T21:19:55.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.289+0000 7fc027600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc0200d3820 con 0x7fc0200d1a00 2024-04-20T21:19:55.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.289+0000 7fd167400640 1 --2- 172.21.15.71:0/1857095321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd16815e770 0x7fd1680b3490 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd158009a00 tx=0x7fd15802baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0fcd8a26c05e8f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.290+0000 7f866e400640 1 Processor -- start 2024-04-20T21:19:55.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.290+0000 7f4740a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f47340e7a50 0x7f4734049b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.290+0000 7f866e400640 1 -- start start 2024-04-20T21:19:55.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.290+0000 7fc024c00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc0200d4270 0x7fc0200d4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46298/0 (socket says 172.21.15.71:46298) 2024-04-20T21:19:55.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.290+0000 7fc024c00640 1 -- 172.21.15.71:0/305613445 learned_addr learned my addr 172.21.15.71:0/305613445 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:55.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.290+0000 7fc025600640 1 --2- 172.21.15.71:0/305613445 >> v2:172.21.15.71:3300/0 conn(0x7fc0200b17d0 0x7fc0200d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.290+0000 7fc01fe00640 1 --2- 172.21.15.71:0/305613445 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0200d1a00 0x7fc0200b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.290+0000 7fd166000640 1 -- 172.21.15.71:0/1857095321 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15802d650 con 0x7fd16815e770 2024-04-20T21:19:55.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.291+0000 7f4740a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47340e7e30 con 0x7f473403c360 2024-04-20T21:19:55.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.291+0000 7f4740a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473403b5a0 con 0x7f473404a0a0 2024-04-20T21:19:55.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.291+0000 7f4740a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f473403b880 con 0x7f47340e7a50 2024-04-20T21:19:55.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.291+0000 7fd166000640 1 -- 172.21.15.71:0/1857095321 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15802d7f0 con 0x7fd16815e770 2024-04-20T21:19:55.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.291+0000 7fd166000640 1 -- 172.21.15.71:0/1857095321 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15802d650 con 0x7fd16815e770 2024-04-20T21:19:55.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.291+0000 7f473b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f47340e7a50 0x7f4734049b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.291+0000 7f473be00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f473403c360 0x7f4734051320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46308/0 (socket says 172.21.15.71:46308) 2024-04-20T21:19:55.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.291+0000 7f473be00640 1 -- 172.21.15.71:0/2182210948 learned_addr learned my addr 172.21.15.71:0/2182210948 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:55.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.291+0000 7f473aa00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f473404a0a0 0x7f47340548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:40184/0 (socket says 172.21.15.71:40184) 2024-04-20T21:19:55.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.292+0000 7fc01fe00640 1 -- 172.21.15.71:0/305613445 >> v2:172.21.15.71:3300/0 conn(0x7fc0200b17d0 msgr2=0x7fc0200d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.292+0000 7fc01fe00640 1 --2- 172.21.15.71:0/305613445 >> v2:172.21.15.71:3300/0 conn(0x7fc0200b17d0 0x7fc0200d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.292+0000 7f473a000640 1 -- 172.21.15.71:0/2182210948 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044125096 0 0) 0x7f47340e7e30 con 0x7f473403c360 2024-04-20T21:19:55.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.292+0000 7f473a000640 1 -- 172.21.15.71:0/2182210948 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4724003520 con 0x7f473403c360 2024-04-20T21:19:55.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7fd16d000640 1 -- 172.21.15.71:0/1857095321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd16815e770 msgr2=0x7fd1680b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7fd16d000640 1 --2- 172.21.15.71:0/1857095321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd16815e770 0x7fd1680b3490 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd158009a00 tx=0x7fd15802baa0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.292+0000 7f473a000640 1 -- 172.21.15.71:0/2182210948 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 519148830 0 0) 0x7f473403b5a0 con 0x7f473404a0a0 2024-04-20T21:19:55.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.292+0000 7f473a000640 1 -- 172.21.15.71:0/2182210948 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47340e7e30 con 0x7f473404a0a0 2024-04-20T21:19:55.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7fd16d000640 1 -- 172.21.15.71:0/1857095321 shutdown_connections 2024-04-20T21:19:55.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7fd16d000640 1 --2- 172.21.15.71:0/1857095321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd16815e770 0x7fd1680b3490 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7fd16d000640 1 -- 172.21.15.71:0/1857095321 >> 172.21.15.71:0/1857095321 conn(0x7fd16809d6d0 msgr2=0x7fd1680b92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.292+0000 7fc01fe00640 1 -- 172.21.15.71:0/305613445 >> v1:172.21.15.71:6789/0 conn(0x7fc0200d4270 legacy=0x7fc0200d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7f473b400640 1 -- 172.21.15.71:0/2182210948 >> v1:172.21.15.137:6789/0 conn(0x7f473404a0a0 legacy=0x7f47340548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7f473b400640 1 -- 172.21.15.71:0/2182210948 >> v1:172.21.15.71:6789/0 conn(0x7f473403c360 legacy=0x7f4734051320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7f473b400640 1 -- 172.21.15.71:0/2182210948 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473403bb60 con 0x7f47340e7a50 2024-04-20T21:19:55.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.294+0000 7fd16d000640 1 -- 172.21.15.71:0/1857095321 shutdown_connections 2024-04-20T21:19:55.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7f866e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f866806bdd0 0x7f86680ad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7f866e400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f86680b3bf0 0x7f86680ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7f866e400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86680ad810 con 0x7f866815a7d0 2024-04-20T21:19:55.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7f866e400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f86680adaf0 con 0x7f86680b3bf0 2024-04-20T21:19:55.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.293+0000 7f866e400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f86680addd0 con 0x7f866806bdd0 2024-04-20T21:19:55.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.292+0000 7fc01fe00640 1 -- 172.21.15.71:0/305613445 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0200d3b00 con 0x7fc0200d1a00 2024-04-20T21:19:55.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.292+0000 7fc025600640 1 --2- 172.21.15.71:0/305613445 >> v2:172.21.15.71:3300/0 conn(0x7fc0200b17d0 0x7fc0200d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.294+0000 7f8667400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f866815a7d0 0x7f866815abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46310/0 (socket says 172.21.15.71:46310) 2024-04-20T21:19:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.294+0000 7f8666a00640 1 --2- 172.21.15.71:0/1557938779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f866806bdd0 0x7f86680ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.294+0000 7fd16d000640 1 -- 172.21.15.71:0/1857095321 wait complete. 2024-04-20T21:19:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.294+0000 7fc01fe00640 1 --2- 172.21.15.71:0/305613445 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0200d1a00 0x7fc0200b1290 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0097a0 tx=0x7fc00c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83e29888939043c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.294+0000 7f8667400640 1 -- 172.21.15.71:0/1557938779 learned_addr learned my addr 172.21.15.71:0/1557938779 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.295+0000 7f8667e00640 1 --2- 172.21.15.71:0/1557938779 >> v2:172.21.15.137:3300/0 conn(0x7f86680b3bf0 0x7f86680ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.295+0000 7f8666a00640 1 -- 172.21.15.71:0/1557938779 >> v2:172.21.15.137:3300/0 conn(0x7f86680b3bf0 msgr2=0x7f86680ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.295+0000 7f8666a00640 1 --2- 172.21.15.71:0/1557938779 >> v2:172.21.15.137:3300/0 conn(0x7f86680b3bf0 0x7f86680ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.295+0000 7f8666a00640 1 -- 172.21.15.71:0/1557938779 >> v1:172.21.15.71:6789/0 conn(0x7f866815a7d0 legacy=0x7f866815abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.295+0000 7f8666a00640 1 -- 172.21.15.71:0/1557938779 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86680ae0b0 con 0x7f866806bdd0 2024-04-20T21:19:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.295+0000 7fc01f400640 1 -- 172.21.15.71:0/305613445 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c035020 con 0x7fc0200d1a00 2024-04-20T21:19:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.295+0000 7fc01f400640 1 -- 172.21.15.71:0/305613445 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00c031810 con 0x7fc0200d1a00 2024-04-20T21:19:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.295+0000 7fc01f400640 1 -- 172.21.15.71:0/305613445 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c031be0 con 0x7fc0200d1a00 2024-04-20T21:19:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.296+0000 7f473b400640 1 --2- 172.21.15.71:0/2182210948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47340e7a50 0x7f4734049b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47280097a0 tx=0x7f472802b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccf05cc53cf702a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.296+0000 7fc027600640 1 -- 172.21.15.71:0/305613445 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0200d1a00 msgr2=0x7fc0200b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.296+0000 7fc027600640 1 --2- 172.21.15.71:0/305613445 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0200d1a00 0x7fc0200b1290 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0097a0 tx=0x7fc00c02b8b0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.296+0000 7f473a000640 1 -- 172.21.15.71:0/2182210948 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728037070 con 0x7f47340e7a50 2024-04-20T21:19:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.296+0000 7f473a000640 1 -- 172.21.15.71:0/2182210948 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4728030510 con 0x7f47340e7a50 2024-04-20T21:19:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.296+0000 7f473a000640 1 -- 172.21.15.71:0/2182210948 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c050540 con 0x7f47340e7a50 2024-04-20T21:19:55.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.297+0000 7f8666a00640 1 --2- 172.21.15.71:0/1557938779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f866806bdd0 0x7f86680ad210 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f86540097a0 tx=0x7f865402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be307d8b4a457d1a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.297+0000 7f4740a00640 1 -- 172.21.15.71:0/2182210948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47340e7a50 msgr2=0x7f4734049b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.297+0000 7f4740a00640 1 --2- 172.21.15.71:0/2182210948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47340e7a50 0x7f4734049b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47280097a0 tx=0x7f472802b740 comp rx=0 tx=0).stop 2024-04-20T21:19:55.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.299+0000 7fd16d000640 1 Processor -- start 2024-04-20T21:19:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.299+0000 7fd16d000640 1 -- start start 2024-04-20T21:19:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7f4740a00640 1 -- 172.21.15.71:0/2182210948 shutdown_connections 2024-04-20T21:19:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7f4740a00640 1 --2- 172.21.15.71:0/2182210948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47340e7a50 0x7f4734049b60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7f4740a00640 1 -- 172.21.15.71:0/2182210948 >> 172.21.15.71:0/2182210948 conn(0x7f4734056cd0 msgr2=0x7f47340570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.299+0000 7f4740a00640 1 -- 172.21.15.71:0/2182210948 shutdown_connections 2024-04-20T21:19:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.299+0000 7f4740a00640 1 -- 172.21.15.71:0/2182210948 wait complete. 2024-04-20T21:19:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7f8666000640 1 -- 172.21.15.71:0/1557938779 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654035020 con 0x7f866806bdd0 2024-04-20T21:19:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7f8666000640 1 -- 172.21.15.71:0/1557938779 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8654031810 con 0x7f866806bdd0 2024-04-20T21:19:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7f8666000640 1 -- 172.21.15.71:0/1557938779 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654031be0 con 0x7f866806bdd0 2024-04-20T21:19:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.299+0000 7f866e400640 1 -- 172.21.15.71:0/1557938779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f866806bdd0 msgr2=0x7f86680ad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.299+0000 7f866e400640 1 --2- 172.21.15.71:0/1557938779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f866806bdd0 0x7f86680ad210 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f86540097a0 tx=0x7f865402b8b0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.297+0000 7fc027600640 1 -- 172.21.15.71:0/305613445 shutdown_connections 2024-04-20T21:19:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.297+0000 7fc027600640 1 --2- 172.21.15.71:0/305613445 >> v2:172.21.15.71:3300/0 conn(0x7fc0200b17d0 0x7fc0200d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.297+0000 7fc027600640 1 --2- 172.21.15.71:0/305613445 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0200d1a00 0x7fc0200b1290 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.297+0000 7fc027600640 1 -- 172.21.15.71:0/305613445 >> 172.21.15.71:0/305613445 conn(0x7fc0200b99c0 msgr2=0x7fc0200b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7fc027600640 1 -- 172.21.15.71:0/305613445 shutdown_connections 2024-04-20T21:19:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7fc027600640 1 -- 172.21.15.71:0/305613445 wait complete. 2024-04-20T21:19:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7fcf39200640 1 Processor -- start 2024-04-20T21:19:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7eff0d400640 1 Processor -- start 2024-04-20T21:19:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7eff0d400640 1 -- start start 2024-04-20T21:19:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7f866e400640 1 -- 172.21.15.71:0/1557938779 shutdown_connections 2024-04-20T21:19:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7f866e400640 1 --2- 172.21.15.71:0/1557938779 >> v2:172.21.15.137:3300/0 conn(0x7f86680b3bf0 0x7f86680ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7f866e400640 1 --2- 172.21.15.71:0/1557938779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f866806bdd0 0x7f86680ad210 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7f866e400640 1 -- 172.21.15.71:0/1557938779 >> 172.21.15.71:0/1557938779 conn(0x7f8668072090 msgr2=0x7f86680b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.298+0000 7fcf39200640 1 -- start start 2024-04-20T21:19:55.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.299+0000 7fcf39200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf34161d50 0x7fcf340d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.299+0000 7fcf39200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcf340b3330 0x7fcf340b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7fcf39200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf3406c190 con 0x7fcf3406c6d0 2024-04-20T21:19:55.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7fcf39200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcf34162130 con 0x7fcf340b3330 2024-04-20T21:19:55.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7fcf39200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3406c470 con 0x7fcf34161d50 2024-04-20T21:19:55.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7eff0d400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff080d1a00 0x7eff080b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7eff0d400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff080b17d0 0x7eff080d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7eff0d400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff080d1e90 con 0x7eff080d4270 2024-04-20T21:19:55.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7eff0d400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7eff080d40c0 con 0x7eff080d1a00 2024-04-20T21:19:55.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7eff0d400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7eff080d3820 con 0x7eff080b17d0 2024-04-20T21:19:55.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.300+0000 7fc027600640 1 Processor -- start 2024-04-20T21:19:55.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7fc027600640 1 -- start start 2024-04-20T21:19:55.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7fcf33e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fcf3406c6d0 0x7fcf340cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46316/0 (socket says 172.21.15.71:46316) 2024-04-20T21:19:55.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7fcf33e00640 1 -- 172.21.15.71:0/1587530380 learned_addr learned my addr 172.21.15.71:0/1587530380 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:55.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7fd16d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd16815e770 0x7fd1681fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7fd16d000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd168162210 0x7fd1681f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7fd16d000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd168162670 0x7fd1680cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7fd16d000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1680d3e30 con 0x7fd168162210 2024-04-20T21:19:55.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7fd16d000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd16815eb50 con 0x7fd16815e770 2024-04-20T21:19:55.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7fd16d000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd1680b6b10 con 0x7fd168162670 2024-04-20T21:19:55.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7eff07200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff080b17d0 0x7eff080d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7eff06800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7eff080d4270 0x7eff080d4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:40200/0 (socket says 172.21.15.71:40200) 2024-04-20T21:19:55.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7eff07200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff080b17d0 0x7eff080d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:41854/0 (socket says 172.21.15.71:41854) 2024-04-20T21:19:55.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7eff07200640 1 -- 172.21.15.71:0/1470574172 learned_addr learned my addr 172.21.15.71:0/1470574172 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7f866e400640 1 -- 172.21.15.71:0/1557938779 shutdown_connections 2024-04-20T21:19:55.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7eff05e00640 1 --2- 172.21.15.71:0/1470574172 >> v2:172.21.15.71:3300/0 conn(0x7eff080d1a00 0x7eff080b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7f4740a00640 1 Processor -- start 2024-04-20T21:19:55.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.302+0000 7f4740a00640 1 -- start start 2024-04-20T21:19:55.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.302+0000 7fd167400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd16815e770 0x7fd1681fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.302+0000 7eff07200640 1 -- 172.21.15.71:0/1470574172 >> v2:172.21.15.71:3300/0 conn(0x7eff080d1a00 msgr2=0x7eff080b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.302+0000 7eff07200640 1 --2- 172.21.15.71:0/1470574172 >> v2:172.21.15.71:3300/0 conn(0x7eff080d1a00 0x7eff080b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.302+0000 7eff05400640 1 -- 172.21.15.71:0/1470574172 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 644295093 0 0) 0x7eff00001490 con 0x7eff080d4270 2024-04-20T21:19:55.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.302+0000 7fd167400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd16815e770 0x7fd1681fcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:41856/0 (socket says 172.21.15.71:41856) 2024-04-20T21:19:55.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.302+0000 7fd167400640 1 -- 172.21.15.71:0/223934634 learned_addr learned my addr 172.21.15.71:0/223934634 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.302+0000 7fd167e00640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd168162670 0x7fd1680cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.302+0000 7eff07200640 1 -- 172.21.15.71:0/1470574172 >> v1:172.21.15.137:6789/0 conn(0x7eff080d4270 legacy=0x7eff080d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.302+0000 7eff07200640 1 -- 172.21.15.71:0/1470574172 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff080d3b00 con 0x7eff080b17d0 2024-04-20T21:19:55.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.303+0000 7fc027600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0200b17d0 0x7fc0200cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.303+0000 7fc027600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0200d1a00 0x7fc0200c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.303+0000 7fd166a00640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd168162210 0x7fd1681f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.303+0000 7fc027600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0200d4270 0x7fc0200c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.303+0000 7f4740a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473403c360 0x7f47340086a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.303+0000 7fcf33400640 1 --2- 172.21.15.71:0/1587530380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf34161d50 0x7fcf340d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.303+0000 7fcf32a00640 1 --2- 172.21.15.71:0/1587530380 >> v2:172.21.15.137:3300/0 conn(0x7fcf340b3330 0x7fcf340b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.303+0000 7f4740a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473404a0a0 0x7f47340e3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fc027600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc0200d53b0 con 0x7fc0200d4270 2024-04-20T21:19:55.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fc027600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0200cfe60 con 0x7fc0200b17d0 2024-04-20T21:19:55.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fc027600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc020161f70 con 0x7fc0200d1a00 2024-04-20T21:19:55.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fcf32a00640 1 -- 172.21.15.71:0/1587530380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf34161d50 msgr2=0x7fcf340d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7f42cf200640 1 Processor -- start 2024-04-20T21:19:55.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fc024c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0200b17d0 0x7fc0200cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fc024c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0200b17d0 0x7fc0200cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:41862/0 (socket says 172.21.15.71:41862) 2024-04-20T21:19:55.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fc024c00640 1 -- 172.21.15.71:0/43606478 learned_addr learned my addr 172.21.15.71:0/43606478 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fd167e00640 1 -- 172.21.15.71:0/223934634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd16815e770 msgr2=0x7fd1681fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fd167e00640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd16815e770 0x7fd1681fcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fd167e00640 1 -- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd168162210 msgr2=0x7fd1681f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fd167e00640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd168162210 0x7fd1681f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7f4740a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47340e7a50 0x7f4734180cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7f4740a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4734054fb0 con 0x7f473404a0a0 2024-04-20T21:19:55.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fc01fe00640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0200d1a00 0x7fc0200c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fd167e00640 1 -- 172.21.15.71:0/223934634 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16815ee70 con 0x7fd168162670 2024-04-20T21:19:55.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7f4740a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f473404a5b0 con 0x7f47340e7a50 2024-04-20T21:19:55.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7f4740a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f473404e730 con 0x7f473403c360 2024-04-20T21:19:55.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7f473b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473403c360 0x7f47340086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7f473b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473403c360 0x7f47340086a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:37150/0 (socket says 172.21.15.71:37150) 2024-04-20T21:19:55.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7f473b400640 1 -- 172.21.15.71:0/417155010 learned_addr learned my addr 172.21.15.71:0/417155010 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7eff07200640 1 --2- 172.21.15.71:0/1470574172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff080b17d0 0x7eff080d0380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7eff08068550 tx=0x7efef002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b27fcffb0062d73 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7f473aa00640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473404a0a0 0x7f47340e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.301+0000 7f866e400640 1 -- 172.21.15.71:0/1557938779 wait complete. 2024-04-20T21:19:55.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7f42cf200640 1 -- start start 2024-04-20T21:19:55.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7fc025600640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0200d4270 0x7fc0200c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7f473be00640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47340e7a50 0x7f4734180cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7f866e400640 1 Processor -- start 2024-04-20T21:19:55.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7f866e400640 1 -- start start 2024-04-20T21:19:55.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fcf32a00640 1 --2- 172.21.15.71:0/1587530380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf34161d50 0x7fcf340d38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fcf32a00640 1 -- 172.21.15.71:0/1587530380 >> v1:172.21.15.71:6789/0 conn(0x7fcf3406c6d0 legacy=0x7fcf340cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.304+0000 7fcf32a00640 1 -- 172.21.15.71:0/1587530380 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf340d2e00 con 0x7fcf340b3330 2024-04-20T21:19:55.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7fd167e00640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd168162670 0x7fd1680cce10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1600012e0 tx=0x7fd16000cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7f6887a00640 1 Processor -- start 2024-04-20T21:19:55.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7fc024c00640 1 -- 172.21.15.71:0/43606478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0200d1a00 msgr2=0x7fc0200c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7fc024c00640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0200d1a00 0x7fc0200c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7fc024c00640 1 -- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0200d4270 msgr2=0x7fc0200c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7fc024c00640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0200d4270 0x7fc0200c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.305+0000 7fc024c00640 1 -- 172.21.15.71:0/43606478 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0200cbbf0 con 0x7fc0200b17d0 2024-04-20T21:19:55.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7eff05400640 1 -- 172.21.15.71:0/1470574172 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef0034070 con 0x7eff080b17d0 2024-04-20T21:19:55.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7eff05400640 1 -- 172.21.15.71:0/1470574172 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef0030860 con 0x7eff080b17d0 2024-04-20T21:19:55.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7eff05400640 1 -- 172.21.15.71:0/1470574172 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef0030c30 con 0x7eff080b17d0 2024-04-20T21:19:55.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7fd15f400640 1 -- 172.21.15.71:0/223934634 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160003b70 con 0x7fd168162670 2024-04-20T21:19:55.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7fd15f400640 1 -- 172.21.15.71:0/223934634 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd160003d10 con 0x7fd168162670 2024-04-20T21:19:55.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7fd15f400640 1 -- 172.21.15.71:0/223934634 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160005310 con 0x7fd168162670 2024-04-20T21:19:55.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7f6887a00640 1 -- start start 2024-04-20T21:19:55.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7f473b400640 1 -- 172.21.15.71:0/417155010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47340e7a50 msgr2=0x7f4734180cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7f473b400640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47340e7a50 0x7f4734180cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7f473b400640 1 -- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473404a0a0 msgr2=0x7f47340e3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7f473b400640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473404a0a0 0x7f47340e3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7f866e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f866806bdd0 0x7f8668151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.306+0000 7f473b400640 1 -- 172.21.15.71:0/417155010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473404de40 con 0x7f473403c360 2024-04-20T21:19:55.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f866e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86680b3bf0 0x7f8668151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f866e400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f866815a7d0 0x7f8668153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f42cf200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f42c80d0a70 0x7f42c80ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7fc024c00640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0200b17d0 0x7fc0200cb6b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc01400c480 tx=0x7fc01400c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f473b400640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473403c360 0x7f47340086a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47280098c0 tx=0x7f47280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f42cf200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f42c806f090 0x7f42c80ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7eff0d400640 1 -- 172.21.15.71:0/1470574172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff080b17d0 msgr2=0x7eff080d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7eff0d400640 1 --2- 172.21.15.71:0/1470574172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff080b17d0 0x7eff080d0380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7eff08068550 tx=0x7efef002b9a0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7fd16d000640 1 -- 172.21.15.71:0/223934634 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16815f150 con 0x7fd168162670 2024-04-20T21:19:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f42cf200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c806df70 con 0x7f42c8162c00 2024-04-20T21:19:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7fd16d000640 1 -- 172.21.15.71:0/223934634 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd16815f710 con 0x7fd168162670 2024-04-20T21:19:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f42cf200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f42c8162fe0 con 0x7f42c806f090 2024-04-20T21:19:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f42cf200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f42c806ec00 con 0x7f42c80d0a70 2024-04-20T21:19:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f8667400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f866806bdd0 0x7f8668151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f8667400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f866806bdd0 0x7f8668151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:41870/0 (socket says 172.21.15.71:41870) 2024-04-20T21:19:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7fc01cc00640 1 -- 172.21.15.71:0/43606478 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014017070 con 0x7fc0200b17d0 2024-04-20T21:19:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7fc01cc00640 1 -- 172.21.15.71:0/43606478 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc014005ce0 con 0x7fc0200b17d0 2024-04-20T21:19:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7fc01cc00640 1 -- 172.21.15.71:0/43606478 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0140072f0 con 0x7fc0200b17d0 2024-04-20T21:19:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7eff0d400640 1 -- 172.21.15.71:0/1470574172 shutdown_connections 2024-04-20T21:19:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7eff0d400640 1 --2- 172.21.15.71:0/1470574172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff080b17d0 0x7eff080d0380 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7eff0d400640 1 --2- 172.21.15.71:0/1470574172 >> v2:172.21.15.71:3300/0 conn(0x7eff080d1a00 0x7eff080b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7eff0d400640 1 -- 172.21.15.71:0/1470574172 >> 172.21.15.71:0/1470574172 conn(0x7eff080b99c0 msgr2=0x7eff080b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f42cd200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f42c806f090 0x7f42c80ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f42cd200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f42c806f090 0x7f42c80ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44778/0 (socket says 172.21.15.71:44778) 2024-04-20T21:19:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f42cd200640 1 -- 172.21.15.71:0/140818748 learned_addr learned my addr 172.21.15.71:0/140818748 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7fc027600640 1 -- 172.21.15.71:0/43606478 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0200c70f0 con 0x7fc0200b17d0 2024-04-20T21:19:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7fc027600640 1 -- 172.21.15.71:0/43606478 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0200b5090 con 0x7fc0200b17d0 2024-04-20T21:19:55.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f8667400640 1 -- 172.21.15.71:0/1717161639 learned_addr learned my addr 172.21.15.71:0/1717161639 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f866806baf0 con 0x7f866815a7d0 2024-04-20T21:19:55.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f866806b970 con 0x7f866806bdd0 2024-04-20T21:19:55.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.307+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f86680aedf0 con 0x7f86680b3bf0 2024-04-20T21:19:55.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7f8666a00640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86680b3bf0 0x7f8668151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7f6887a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68800d1a00 0x7f68800b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7f6887a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68800b17d0 0x7f68800d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7f42c7400640 1 --2- 172.21.15.71:0/140818748 >> v2:172.21.15.137:3300/0 conn(0x7f42c80d0a70 0x7f42c80ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7f8667e00640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f866815a7d0 0x7f8668153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7f6887a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68800d1e90 con 0x7f68800d4270 2024-04-20T21:19:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7f42cd200640 1 -- 172.21.15.71:0/140818748 >> v2:172.21.15.137:3300/0 conn(0x7f42c80d0a70 msgr2=0x7f42c80ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7f42cd200640 1 --2- 172.21.15.71:0/140818748 >> v2:172.21.15.137:3300/0 conn(0x7f42c80d0a70 0x7f42c80ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7f42cd200640 1 -- 172.21.15.71:0/140818748 >> v1:172.21.15.137:6789/0 conn(0x7f42c8162c00 legacy=0x7f42c80d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7f8667400640 1 -- 172.21.15.71:0/1717161639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86680b3bf0 msgr2=0x7f8668151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7f8667400640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86680b3bf0 0x7f8668151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7f687fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68800d1a00 0x7f68800b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7f8667400640 1 -- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f866815a7d0 msgr2=0x7f8668153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7f42cd200640 1 -- 172.21.15.71:0/140818748 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c806e310 con 0x7f42c806f090 2024-04-20T21:19:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7f8667400640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f866815a7d0 0x7f8668153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7f8667400640 1 -- 172.21.15.71:0/1717161639 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86681543d0 con 0x7f866806bdd0 2024-04-20T21:19:55.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7f8667e00640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f866815a7d0 0x7f8668153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:19:55.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.308+0000 7fcf32a00640 1 --2- 172.21.15.71:0/1587530380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf340b3330 0x7fcf340b3880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf240097a0 tx=0x7fcf2402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4efa5e6ff2b3f3fc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7f687fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68800d1a00 0x7f68800b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44792/0 (socket says 172.21.15.71:44792) 2024-04-20T21:19:55.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7f687fe00640 1 -- 172.21.15.71:0/1341815710 learned_addr learned my addr 172.21.15.71:0/1341815710 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7eff0d400640 1 -- 172.21.15.71:0/1470574172 shutdown_connections 2024-04-20T21:19:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7f6887a00640 1 -- 172.21.15.71:0/1341815710 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f68800d40c0 con 0x7f68800d1a00 2024-04-20T21:19:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7f6887a00640 1 -- 172.21.15.71:0/1341815710 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f68800d3820 con 0x7f68800b17d0 2024-04-20T21:19:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7fc027600640 1 -- 172.21.15.71:0/43606478 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbffc001030 con 0x7fc0200b17d0 2024-04-20T21:19:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7eff0d400640 1 -- 172.21.15.71:0/1470574172 wait complete. 2024-04-20T21:19:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7fd16d000640 1 -- 172.21.15.71:0/223934634 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd168075b30 con 0x7fd168162670 2024-04-20T21:19:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7f8667400640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f866806bdd0 0x7f8668151120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f865800b460 tx=0x7f865800b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.309+0000 7fcf32000640 1 -- 172.21.15.71:0/1587530380 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24037070 con 0x7fcf340b3330 2024-04-20T21:19:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7fcf32000640 1 -- 172.21.15.71:0/1587530380 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf24030710 con 0x7fcf340b3330 2024-04-20T21:19:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7fcf32000640 1 -- 172.21.15.71:0/1587530380 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24030ae0 con 0x7fcf340b3330 2024-04-20T21:19:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f472f400640 1 -- 172.21.15.71:0/417155010 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728040020 con 0x7f473403c360 2024-04-20T21:19:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f687fe00640 1 -- 172.21.15.71:0/1341815710 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68800b17d0 msgr2=0x7f68800d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f687fe00640 1 --2- 172.21.15.71:0/1341815710 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68800b17d0 0x7f68800d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f687fe00640 1 -- 172.21.15.71:0/1341815710 >> v1:172.21.15.137:6789/0 conn(0x7f68800d4270 legacy=0x7f68800d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f687fe00640 1 -- 172.21.15.71:0/1341815710 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68800d3b00 con 0x7f68800d1a00 2024-04-20T21:19:55.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f4740a00640 1 -- 172.21.15.71:0/417155010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473404e3c0 con 0x7f473403c360 2024-04-20T21:19:55.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f865f400640 1 -- 172.21.15.71:0/1717161639 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658015020 con 0x7f866806bdd0 2024-04-20T21:19:55.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f865f400640 1 -- 172.21.15.71:0/1717161639 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86580118b0 con 0x7f866806bdd0 2024-04-20T21:19:55.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f865f400640 1 -- 172.21.15.71:0/1717161639 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658011ca0 con 0x7f866806bdd0 2024-04-20T21:19:55.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f472f400640 1 -- 172.21.15.71:0/417155010 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4728032760 con 0x7f473403c360 2024-04-20T21:19:55.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f472f400640 1 -- 172.21.15.71:0/417155010 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728037040 con 0x7f473403c360 2024-04-20T21:19:55.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86681503a0 con 0x7f866806bdd0 2024-04-20T21:19:55.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f4740a00640 1 -- 172.21.15.71:0/417155010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47340ea9f0 con 0x7f473403c360 2024-04-20T21:19:55.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.310+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8668150920 con 0x7f866806bdd0 2024-04-20T21:19:55.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7fcf39200640 1 -- 172.21.15.71:0/1587530380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf340b3330 msgr2=0x7fcf340b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7fcf39200640 1 --2- 172.21.15.71:0/1587530380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf340b3330 0x7fcf340b3880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf240097a0 tx=0x7fcf2402b710 comp rx=0 tx=0).stop 2024-04-20T21:19:55.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7f42cd200640 1 --2- 172.21.15.71:0/140818748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42c806f090 0x7f42c80ad590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42c80d0f10 tx=0x7f42c002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8f9e1a556c9744 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7fcf39200640 1 -- 172.21.15.71:0/1587530380 shutdown_connections 2024-04-20T21:19:55.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7fcf39200640 1 --2- 172.21.15.71:0/1587530380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf340b3330 0x7fcf340b3880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7fcf39200640 1 --2- 172.21.15.71:0/1587530380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf34161d50 0x7fcf340d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7f42c6a00640 1 -- 172.21.15.71:0/140818748 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c002c9f0 con 0x7f42c806f090 2024-04-20T21:19:55.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7f42c6a00640 1 -- 172.21.15.71:0/140818748 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c002cb90 con 0x7f42c806f090 2024-04-20T21:19:55.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7f42c6a00640 1 -- 172.21.15.71:0/140818748 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00343f0 con 0x7f42c806f090 2024-04-20T21:19:55.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7eff0d400640 1 Processor -- start 2024-04-20T21:19:55.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7fcf39200640 1 -- 172.21.15.71:0/1587530380 >> 172.21.15.71:0/1587530380 conn(0x7fcf340d4450 msgr2=0x7fcf340d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.312+0000 7f687fe00640 1 --2- 172.21.15.71:0/1341815710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68800d1a00 0x7f68800b1290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f686c009870 tx=0x7f686c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2320552532eb3306 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.311+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8668068980 con 0x7f866806bdd0 2024-04-20T21:19:55.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.312+0000 7eff0d400640 1 -- start start 2024-04-20T21:19:55.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.312+0000 7f687f400640 1 -- 172.21.15.71:0/1341815710 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c035020 con 0x7f68800d1a00 2024-04-20T21:19:55.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.312+0000 7f687f400640 1 -- 172.21.15.71:0/1341815710 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f686c031870 con 0x7f68800d1a00 2024-04-20T21:19:55.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.312+0000 7f687f400640 1 -- 172.21.15.71:0/1341815710 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c031c40 con 0x7f68800d1a00 2024-04-20T21:19:55.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.312+0000 7fcf39200640 1 -- 172.21.15.71:0/1587530380 shutdown_connections 2024-04-20T21:19:55.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.312+0000 7fcf39200640 1 -- 172.21.15.71:0/1587530380 wait complete. 2024-04-20T21:19:55.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.312+0000 7f4740a00640 1 -- 172.21.15.71:0/417155010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f47340057e0 con 0x7f473403c360 2024-04-20T21:19:55.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.312+0000 7f42cf200640 1 -- 172.21.15.71:0/140818748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42c806f090 msgr2=0x7f42c80ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.312+0000 7f42cf200640 1 --2- 172.21.15.71:0/140818748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42c806f090 0x7f42c80ad590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42c80d0f10 tx=0x7f42c002be50 comp rx=0 tx=0).stop 2024-04-20T21:19:55.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.313+0000 7f42cf200640 1 -- 172.21.15.71:0/140818748 shutdown_connections 2024-04-20T21:19:55.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.313+0000 7f42cf200640 1 --2- 172.21.15.71:0/140818748 >> v2:172.21.15.137:3300/0 conn(0x7f42c80d0a70 0x7f42c80ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.313+0000 7f42cf200640 1 --2- 172.21.15.71:0/140818748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42c806f090 0x7f42c80ad590 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.313+0000 7f42cf200640 1 -- 172.21.15.71:0/140818748 >> 172.21.15.71:0/140818748 conn(0x7f42c80b3350 msgr2=0x7f42c80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.313+0000 7f42cf200640 1 -- 172.21.15.71:0/140818748 shutdown_connections 2024-04-20T21:19:55.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.313+0000 7f6887a00640 1 -- 172.21.15.71:0/1341815710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68800d1a00 msgr2=0x7f68800b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.313+0000 7f6887a00640 1 --2- 172.21.15.71:0/1341815710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68800d1a00 0x7f68800b1290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f686c009870 tx=0x7f686c02b910 comp rx=0 tx=0).stop 2024-04-20T21:19:55.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.313+0000 7eff0d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff080b17d0 0x7eff080cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.313+0000 7eff0d400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7eff080d1a00 0x7eff0814dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.313+0000 7eff0d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff080d4270 0x7eff080b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7eff06800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff080b17d0 0x7eff080cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7eff0d400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff080d53b0 con 0x7eff080d4270 2024-04-20T21:19:55.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7eff06800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff080b17d0 0x7eff080cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:41894/0 (socket says 172.21.15.71:41894) 2024-04-20T21:19:55.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7eff07200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff080d4270 0x7eff080b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7eff06800640 1 -- 172.21.15.71:0/526791304 learned_addr learned my addr 172.21.15.71:0/526791304 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7f6887a00640 1 -- 172.21.15.71:0/1341815710 shutdown_connections 2024-04-20T21:19:55.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.313+0000 7f42cf200640 1 -- 172.21.15.71:0/140818748 wait complete. 2024-04-20T21:19:55.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7eff0d400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff080cfe60 con 0x7eff080b17d0 2024-04-20T21:19:55.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7eff08161f70 con 0x7eff080d1a00 2024-04-20T21:19:55.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7f6887a00640 1 --2- 172.21.15.71:0/1341815710 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68800b17d0 0x7f68800d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7f6887a00640 1 --2- 172.21.15.71:0/1341815710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68800d1a00 0x7f68800b1290 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7f6887a00640 1 -- 172.21.15.71:0/1341815710 >> 172.21.15.71:0/1341815710 conn(0x7f68800b99c0 msgr2=0x7f68800b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7fd15f400640 1 -- 172.21.15.71:0/223934634 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd1600056c0 con 0x7fd168162670 2024-04-20T21:19:55.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7f6887a00640 1 -- 172.21.15.71:0/1341815710 shutdown_connections 2024-04-20T21:19:55.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.314+0000 7f6887a00640 1 -- 172.21.15.71:0/1341815710 wait complete. 2024-04-20T21:19:55.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.315+0000 7f472f400640 1 -- 172.21.15.71:0/417155010 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4728043020 con 0x7f473403c360 2024-04-20T21:19:55.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.316+0000 7fd15f400640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd14806c8f0 0x7fd14806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.316+0000 7fd15f400640 1 -- 172.21.15.71:0/223934634 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd16008c8c0 con 0x7fd168162670 2024-04-20T21:19:55.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.316+0000 7fd15f400640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:6800/540495591,v1:172.21.15.71:6801/540495591] conn(0x7fd148076070 0x7fd1480784b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.316+0000 7fd15f400640 1 -- 172.21.15.71:0/223934634 --> [v2:172.21.15.71:6800/540495591,v1:172.21.15.71:6801/540495591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd16000bf30 con 0x7fd148076070 2024-04-20T21:19:55.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.316+0000 7fd15f400640 1 -- 172.21.15.71:0/223934634 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd16008ccb0 con 0x7fd168162670 2024-04-20T21:19:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.315+0000 7eff07200640 1 -- 172.21.15.71:0/526791304 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7eff080d1a00 msgr2=0x7eff0814dcc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T21:19:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.315+0000 7eff07200640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7eff080d1a00 0x7eff0814dcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.315+0000 7eff07200640 1 -- 172.21.15.71:0/526791304 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff080b17d0 msgr2=0x7eff080cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.315+0000 7eff07200640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff080b17d0 0x7eff080cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.315+0000 7eff07200640 1 -- 172.21.15.71:0/526791304 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff080ce4f0 con 0x7eff080d4270 2024-04-20T21:19:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.315+0000 7fc01cc00640 1 -- 172.21.15.71:0/43606478 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc01401a070 con 0x7fc0200b17d0 2024-04-20T21:19:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7fc01cc00640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc00006c8f0 0x7fc00006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7fcf39200640 1 Processor -- start 2024-04-20T21:19:55.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7f6887a00640 1 Processor -- start 2024-04-20T21:19:55.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7fd167400640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd14806c8f0 0x7fd14806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7fd166a00640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:6800/540495591,v1:172.21.15.71:6801/540495591] conn(0x7fd148076070 0x7fd1480784b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7f472f400640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f471c06c940 0x7f471c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7f6887a00640 1 -- start start 2024-04-20T21:19:55.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7f472f400640 1 -- 172.21.15.71:0/417155010 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f47280ad410 con 0x7f473403c360 2024-04-20T21:19:55.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7f472f400640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:6814/1038059240,v1:172.21.15.71:6816/1038059240] conn(0x7f471c0760c0 0x7f471c078500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7f472f400640 1 -- 172.21.15.71:0/417155010 --> [v2:172.21.15.71:6814/1038059240,v1:172.21.15.71:6816/1038059240] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4728030510 con 0x7f471c0760c0 2024-04-20T21:19:55.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7f472f400640 1 -- 172.21.15.71:0/417155010 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f47280ad7c0 con 0x7f473403c360 2024-04-20T21:19:55.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7f473aa00640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f471c06c940 0x7f471c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7eff07200640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff080d4270 0x7eff080b2fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efef0033000 tx=0x7efef0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7f6887a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68800b17d0 0x7f6880158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7f6887a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68800d1a00 0x7f688006e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7f6887a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68800d4270 0x7f68800cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7f6887a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f68800d53b0 con 0x7f68800d1a00 2024-04-20T21:19:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7f6887a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68800cfe60 con 0x7f68800b17d0 2024-04-20T21:19:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7f6887a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6880161f70 con 0x7f68800d4270 2024-04-20T21:19:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7f865f400640 1 -- 172.21.15.71:0/1717161639 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8658018020 con 0x7f866806bdd0 2024-04-20T21:19:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7fd166a00640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:6800/540495591,v1:172.21.15.71:6801/540495591] conn(0x7fd148076070 0x7fd1480784b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7fc01cc00640 1 -- 172.21.15.71:0/43606478 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc01408b990 con 0x7fc0200b17d0 2024-04-20T21:19:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7fc01fe00640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc00006c8f0 0x7fc00006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7fc01cc00640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:6824/2731317252,v1:172.21.15.71:6825/2731317252] conn(0x7fc000075ff0 0x7fc000078430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7fc01cc00640 1 -- 172.21.15.71:0/43606478 --> [v2:172.21.15.71:6824/2731317252,v1:172.21.15.71:6825/2731317252] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc01400ee50 con 0x7fc000075ff0 2024-04-20T21:19:55.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7fc01cc00640 1 -- 172.21.15.71:0/43606478 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc01408bd40 con 0x7fc0200b17d0 2024-04-20T21:19:55.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.317+0000 7fcf39200640 1 -- start start 2024-04-20T21:19:55.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7fcf39200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf3406c6d0 0x7fcf340cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7fcf39200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf34161d50 0x7fcf340b9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7fcf39200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf3415b360 0x7fcf340b9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7fcf39200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3406cb60 con 0x7fcf34161d50 2024-04-20T21:19:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7fcf39200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf340d33c0 con 0x7fcf3406c6d0 2024-04-20T21:19:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.318+0000 7fcf39200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3406cce0 con 0x7fcf3415b360 2024-04-20T21:19:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f42cf200640 1 Processor -- start 2024-04-20T21:19:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7fd167400640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd14806c8f0 0x7fd14806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd158009560 tx=0x7fd15803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7efefea00640 1 -- 172.21.15.71:0/526791304 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef0048070 con 0x7eff080d4270 2024-04-20T21:19:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff080cb6b0 con 0x7eff080d4270 2024-04-20T21:19:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff080cbc70 con 0x7eff080d4270 2024-04-20T21:19:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f6885000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68800b17d0 0x7f6880158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f42cf200640 1 -- start start 2024-04-20T21:19:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f6885000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68800b17d0 0x7f6880158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:41898/0 (socket says 172.21.15.71:41898) 2024-04-20T21:19:55.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f6885000640 1 -- 172.21.15.71:0/2272119477 learned_addr learned my addr 172.21.15.71:0/2272119477 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7fd15f400640 1 -- 172.21.15.71:0/223934634 <== osd.0 v2:172.21.15.71:6800/540495591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd16000bf30 con 0x7fd148076070 2024-04-20T21:19:55.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f6885a00640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68800d4270 0x7f68800cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7fcf33400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf3406c6d0 0x7fcf340cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f473be00640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:6814/1038059240,v1:172.21.15.71:6816/1038059240] conn(0x7f471c0760c0 0x7f471c078500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.320+0000 7fc01fe00640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc00006c8f0 0x7fc00006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc00c036000 tx=0x7fc00c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7fc025600640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:6824/2731317252,v1:172.21.15.71:6825/2731317252] conn(0x7fc000075ff0 0x7fc000078430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7fcf33400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf3406c6d0 0x7fcf340cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:41914/0 (socket says 172.21.15.71:41914) 2024-04-20T21:19:55.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.320+0000 7efefea00640 1 -- 172.21.15.71:0/526791304 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef0039d10 con 0x7eff080d4270 2024-04-20T21:19:55.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.320+0000 7efefea00640 1 -- 172.21.15.71:0/526791304 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef0034040 con 0x7eff080d4270 2024-04-20T21:19:55.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.320+0000 7f6885000640 1 -- 172.21.15.71:0/2272119477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68800d4270 msgr2=0x7f68800cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.320+0000 7f6885000640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68800d4270 0x7f68800cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.320+0000 7f6885000640 1 -- 172.21.15.71:0/2272119477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68800d1a00 msgr2=0x7f688006e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.320+0000 7f6885000640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68800d1a00 0x7f688006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.320+0000 7f6885000640 1 -- 172.21.15.71:0/2272119477 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688006e750 con 0x7f68800b17d0 2024-04-20T21:19:55.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7f42cf200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42c806f090 0x7f42c815bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7f42cf200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42c80d0a70 0x7f42c815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7f42cf200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42c8162c00 0x7f42c814c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7f42cf200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f42c806dbb0 con 0x7f42c8162c00 2024-04-20T21:19:55.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7f42cf200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42c806e890 con 0x7f42c80d0a70 2024-04-20T21:19:55.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7f42cf200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f42c806dd30 con 0x7f42c806f090 2024-04-20T21:19:55.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7f6885000640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68800b17d0 0x7f6880158440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f687800c7f0 tx=0x7f687800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7fcf32a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf34161d50 0x7fcf340b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7fcf33e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf3415b360 0x7fcf340b9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7fcf33400640 1 -- 172.21.15.71:0/2019115027 learned_addr learned my addr 172.21.15.71:0/2019115027 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f865f400640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f864806c8f0 0x7f864806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f865f400640 1 -- 172.21.15.71:0/1717161639 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f865808c640 con 0x7f866806bdd0 2024-04-20T21:19:55.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f865f400640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:6808/2463711085,v1:172.21.15.71:6809/2463711085] conn(0x7f8648075fe0 0x7f8648078420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7f473be00640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:6814/1038059240,v1:172.21.15.71:6816/1038059240] conn(0x7f471c0760c0 0x7f471c078500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7f473aa00640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f471c06c940 0x7f471c06ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f47340eb070 tx=0x7f4730007da0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f865f400640 1 -- 172.21.15.71:0/1717161639 --> [v2:172.21.15.71:6808/2463711085,v1:172.21.15.71:6809/2463711085] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f865801ee70 con 0x7f8648075fe0 2024-04-20T21:19:55.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.319+0000 7f865f400640 1 -- 172.21.15.71:0/1717161639 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f865808c9f0 con 0x7f866806bdd0 2024-04-20T21:19:55.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.320+0000 7f8666a00640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f864806c8f0 0x7f864806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.321+0000 7f8667e00640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:6808/2463711085,v1:172.21.15.71:6809/2463711085] conn(0x7f8648075fe0 0x7f8648078420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7fcf33400640 1 -- 172.21.15.71:0/2019115027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf3415b360 msgr2=0x7fcf340b9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7fcf33400640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf3415b360 0x7fcf340b9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7fcf33400640 1 -- 172.21.15.71:0/2019115027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf34161d50 msgr2=0x7fcf340b9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7fcf33400640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf34161d50 0x7fcf340b9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7fcf33400640 1 -- 172.21.15.71:0/2019115027 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3415a180 con 0x7fcf3406c6d0 2024-04-20T21:19:55.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efee0001030 con 0x7eff080d4270 2024-04-20T21:19:55.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7f42c7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42c80d0a70 0x7f42c815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7f42cd200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42c8162c00 0x7f42c814c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7f42cd200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42c8162c00 0x7f42c814c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44830/0 (socket says 172.21.15.71:44830) 2024-04-20T21:19:55.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7f42cd200640 1 -- 172.21.15.71:0/1468802037 learned_addr learned my addr 172.21.15.71:0/1468802037 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7f8666a00640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f864806c8f0 0x7f864806edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f86540097a0 tx=0x7f8654008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7f8667e00640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:6808/2463711085,v1:172.21.15.71:6809/2463711085] conn(0x7f8648075fe0 0x7f8648078420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7f687cc00640 1 -- 172.21.15.71:0/2272119477 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878016020 con 0x7f68800b17d0 2024-04-20T21:19:55.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7f687cc00640 1 -- 172.21.15.71:0/2272119477 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687800aa50 con 0x7f68800b17d0 2024-04-20T21:19:55.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.322+0000 7f687cc00640 1 -- 172.21.15.71:0/2272119477 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687800ae40 con 0x7f68800b17d0 2024-04-20T21:19:55.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7fcf33400640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf3406c6d0 0x7fcf340cd640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00efc0 tx=0x7fcf2c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7f42c7e00640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42c806f090 0x7f42c815bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7f6887a00640 1 -- 172.21.15.71:0/2272119477 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68800cc1f0 con 0x7f68800b17d0 2024-04-20T21:19:55.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7f6887a00640 1 -- 172.21.15.71:0/2272119477 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68800cc7b0 con 0x7f68800b17d0 2024-04-20T21:19:55.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7f472f400640 1 -- 172.21.15.71:0/417155010 <== osd.1 v2:172.21.15.71:6814/1038059240 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4728030510 con 0x7f471c0760c0 2024-04-20T21:19:55.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7f42cd200640 1 -- 172.21.15.71:0/1468802037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42c806f090 msgr2=0x7f42c815bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7f42cd200640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42c806f090 0x7f42c815bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7f42cd200640 1 -- 172.21.15.71:0/1468802037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42c80d0a70 msgr2=0x7f42c815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7f42cd200640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42c80d0a70 0x7f42c815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7f42cd200640 1 -- 172.21.15.71:0/1468802037 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c815ae80 con 0x7f42c8162c00 2024-04-20T21:19:55.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7fcf2b400640 1 -- 172.21.15.71:0/2019115027 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c018020 con 0x7fcf3406c6d0 2024-04-20T21:19:55.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7fcf39200640 1 -- 172.21.15.71:0/2019115027 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf341590e0 con 0x7fcf3406c6d0 2024-04-20T21:19:55.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.323+0000 7fcf39200640 1 -- 172.21.15.71:0/2019115027 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf341596a0 con 0x7fcf3406c6d0 2024-04-20T21:19:55.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.324+0000 7f6887a00640 1 -- 172.21.15.71:0/2272119477 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6880068a80 con 0x7f68800b17d0 2024-04-20T21:19:55.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.324+0000 7fcf2b400640 1 -- 172.21.15.71:0/2019115027 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c014480 con 0x7fcf3406c6d0 2024-04-20T21:19:55.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.324+0000 7fcf2b400640 1 -- 172.21.15.71:0/2019115027 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c014850 con 0x7fcf3406c6d0 2024-04-20T21:19:55.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.325+0000 7f865f400640 1 -- 172.21.15.71:0/1717161639 <== osd.2 v2:172.21.15.71:6808/2463711085 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f865801ee70 con 0x7f8648075fe0 2024-04-20T21:19:55.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.325+0000 7fc025600640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:6824/2731317252,v1:172.21.15.71:6825/2731317252] conn(0x7fc000075ff0 0x7fc000078430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.325+0000 7efefea00640 1 -- 172.21.15.71:0/526791304 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efef004b070 con 0x7eff080d4270 2024-04-20T21:19:55.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.326+0000 7f42cd200640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42c8162c00 0x7f42c814c350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009f40 tx=0x7f42c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.326+0000 7efefea00640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7efee406c920 0x7efee406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.326+0000 7f42bfe00640 1 -- 172.21.15.71:0/1468802037 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0043020 con 0x7f42c8162c00 2024-04-20T21:19:55.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.326+0000 7f42bfe00640 1 -- 172.21.15.71:0/1468802037 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c003e450 con 0x7f42c8162c00 2024-04-20T21:19:55.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.326+0000 7f42bfe00640 1 -- 172.21.15.71:0/1468802037 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c003e880 con 0x7f42c8162c00 2024-04-20T21:19:55.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.327+0000 7fc01cc00640 1 -- 172.21.15.71:0/43606478 <== osd.3 v2:172.21.15.71:6824/2731317252 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc01400ee50 con 0x7fc000075ff0 2024-04-20T21:19:55.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.327+0000 7f42cf200640 1 -- 172.21.15.71:0/1468802037 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c815b160 con 0x7f42c8162c00 2024-04-20T21:19:55.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.327+0000 7f42cf200640 1 -- 172.21.15.71:0/1468802037 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c815b720 con 0x7f42c8162c00 2024-04-20T21:19:55.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.326+0000 7efefea00640 1 -- 172.21.15.71:0/526791304 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efef00adc70 con 0x7eff080d4270 2024-04-20T21:19:55.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.327+0000 7efefea00640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.137:6814/2530248769,v1:172.21.15.137:6816/2530248769] conn(0x7efee4076020 0x7efee4078460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.327+0000 7efefea00640 1 -- 172.21.15.71:0/526791304 --> [v2:172.21.15.137:6814/2530248769,v1:172.21.15.137:6816/2530248769] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efee4078b30 con 0x7efee4076020 2024-04-20T21:19:55.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.327+0000 7efefea00640 1 -- 172.21.15.71:0/526791304 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efef00b0370 con 0x7eff080d4270 2024-04-20T21:19:55.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.328+0000 7fcf39200640 1 -- 172.21.15.71:0/2019115027 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf0c001030 con 0x7fcf3406c6d0 2024-04-20T21:19:55.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.328+0000 7eff05e00640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.137:6814/2530248769,v1:172.21.15.137:6816/2530248769] conn(0x7efee4076020 0x7efee4078460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.328+0000 7f42cf200640 1 -- 172.21.15.71:0/1468802037 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42c8068980 con 0x7f42c8162c00 2024-04-20T21:19:55.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.329+0000 7f687cc00640 1 -- 172.21.15.71:0/2272119477 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6878019020 con 0x7f68800b17d0 2024-04-20T21:19:55.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.329+0000 7fcf2b400640 1 -- 172.21.15.71:0/2019115027 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf2c005d10 con 0x7fcf3406c6d0 2024-04-20T21:19:55.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.329+0000 7eff05e00640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.137:6814/2530248769,v1:172.21.15.137:6816/2530248769] conn(0x7efee4076020 0x7efee4078460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.330+0000 7f42bfe00640 1 -- 172.21.15.71:0/1468802037 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42c0046020 con 0x7f42c8162c00 2024-04-20T21:19:55.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.331+0000 7eff06800640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7efee406c920 0x7efee406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.330+0000 7f687cc00640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f686006c9c0 0x7f686006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.330+0000 7f687cc00640 1 -- 172.21.15.71:0/2272119477 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f687808c170 con 0x7f68800b17d0 2024-04-20T21:19:55.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.331+0000 7f687cc00640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.137:6800/604238808,v1:172.21.15.137:6801/604238808] conn(0x7f6860076130 0x7f6860078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.331+0000 7f687cc00640 1 -- 172.21.15.71:0/2272119477 --> [v2:172.21.15.137:6800/604238808,v1:172.21.15.137:6801/604238808] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6878010e50 con 0x7f6860076130 2024-04-20T21:19:55.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.331+0000 7f687cc00640 1 -- 172.21.15.71:0/2272119477 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f687808c560 con 0x7f68800b17d0 2024-04-20T21:19:55.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.331+0000 7f687fe00640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f686006c9c0 0x7f686006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.330+0000 7fcf2b400640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fcf1006c8f0 0x7fcf1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.330+0000 7fcf2b400640 1 -- 172.21.15.71:0/2019115027 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcf2c08cc70 con 0x7fcf3406c6d0 2024-04-20T21:19:55.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.330+0000 7fcf2b400640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.137:6815/3627885436,v1:172.21.15.137:6818/3627885436] conn(0x7fcf10075ff0 0x7fcf10078430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.330+0000 7fcf2b400640 1 -- 172.21.15.71:0/2019115027 --> [v2:172.21.15.137:6815/3627885436,v1:172.21.15.137:6818/3627885436] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf2c0020b0 con 0x7fcf10075ff0 2024-04-20T21:19:55.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.330+0000 7fcf2b400640 1 -- 172.21.15.71:0/2019115027 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcf2c08f290 con 0x7fcf3406c6d0 2024-04-20T21:19:55.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.331+0000 7fcf33e00640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.137:6815/3627885436,v1:172.21.15.137:6818/3627885436] conn(0x7fcf10075ff0 0x7fcf10078430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.332+0000 7fcf32a00640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fcf1006c8f0 0x7fcf1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.331+0000 7f6885a00640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.137:6800/604238808,v1:172.21.15.137:6801/604238808] conn(0x7f6860076130 0x7f6860078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.332+0000 7efefea00640 1 -- 172.21.15.71:0/526791304 <== osd.5 v2:172.21.15.137:6814/2530248769 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efee4078b30 con 0x7efee4076020 2024-04-20T21:19:55.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.332+0000 7eff06800640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7efee406c920 0x7efee406ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff00004fd0 tx=0x7eff00004d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.333+0000 7f687fe00640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f686006c9c0 0x7f686006ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f686c036000 tx=0x7f686c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.332+0000 7f42bfe00640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f42a806c9c0 0x7f42a806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.332+0000 7f42bfe00640 1 -- 172.21.15.71:0/1468802037 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f42c00ae560 con 0x7f42c8162c00 2024-04-20T21:19:55.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.333+0000 7f42bfe00640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.137:6808/576639340,v1:172.21.15.137:6809/576639340] conn(0x7f42a80760b0 0x7f42a80784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.333+0000 7f42bfe00640 1 -- 172.21.15.71:0/1468802037 --> [v2:172.21.15.137:6808/576639340,v1:172.21.15.137:6809/576639340] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42a8078bc0 con 0x7f42a80760b0 2024-04-20T21:19:55.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.333+0000 7f42bfe00640 1 -- 172.21.15.71:0/1468802037 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f42c00b5050 con 0x7f42c8162c00 2024-04-20T21:19:55.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.333+0000 7f42c7e00640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f42a806c9c0 0x7f42a806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.334+0000 7f42c7400640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.137:6808/576639340,v1:172.21.15.137:6809/576639340] conn(0x7f42a80760b0 0x7f42a80784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.334+0000 7f6885a00640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.137:6800/604238808,v1:172.21.15.137:6801/604238808] conn(0x7f6860076130 0x7f6860078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.332+0000 7fcf33e00640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.137:6815/3627885436,v1:172.21.15.137:6818/3627885436] conn(0x7fcf10075ff0 0x7fcf10078430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.334+0000 7fcf32a00640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fcf1006c8f0 0x7fcf1006edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcf24034000 tx=0x7fcf24008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.335+0000 7f42c7e00640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f42a806c9c0 0x7f42a806ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f42b8006fd0 tx=0x7f42b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.335+0000 7f42c7400640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.137:6808/576639340,v1:172.21.15.137:6809/576639340] conn(0x7f42a80760b0 0x7f42a80784f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.335+0000 7fcf2b400640 1 -- 172.21.15.71:0/2019115027 <== osd.4 v2:172.21.15.137:6815/3627885436 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf2c0020b0 con 0x7fcf10075ff0 2024-04-20T21:19:55.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.336+0000 7f687cc00640 1 -- 172.21.15.71:0/2272119477 <== osd.6 v2:172.21.15.137:6800/604238808 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6878010e50 con 0x7f6860076130 2024-04-20T21:19:55.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.337+0000 7f42bfe00640 1 -- 172.21.15.71:0/1468802037 <== osd.7 v2:172.21.15.137:6808/576639340 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42a8078bc0 con 0x7f42a80760b0 2024-04-20T21:19:55.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.356+0000 7fd16d000640 1 -- 172.21.15.71:0/223934634 --> [v2:172.21.15.71:6800/540495591,v1:172.21.15.71:6801/540495591] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd16815f950 con 0x7fd148076070 2024-04-20T21:19:55.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.357+0000 7fd15f400640 1 -- 172.21.15.71:0/223934634 <== osd.0 v2:172.21.15.71:6800/540495591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd1540047e0 con 0x7fd148076070 2024-04-20T21:19:55.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.358+0000 7fcf39200640 1 -- 172.21.15.71:0/2019115027 --> [v2:172.21.15.137:6815/3627885436,v1:172.21.15.137:6818/3627885436] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf0c002dd0 con 0x7fcf10075ff0 2024-04-20T21:19:55.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.358+0000 7fd16d000640 1 -- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:6800/540495591,v1:172.21.15.71:6801/540495591] conn(0x7fd148076070 msgr2=0x7fd1480784b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.358+0000 7fd16d000640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:6800/540495591,v1:172.21.15.71:6801/540495591] conn(0x7fd148076070 0x7fd1480784b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.359+0000 7fcf2b400640 1 -- 172.21.15.71:0/2019115027 <== osd.4 v2:172.21.15.137:6815/3627885436 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf0c002dd0 con 0x7fcf10075ff0 2024-04-20T21:19:55.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.359+0000 7fd16d000640 1 -- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd14806c8f0 msgr2=0x7fd14806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.359+0000 7fd16d000640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd14806c8f0 0x7fd14806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd158009560 tx=0x7fd15803b040 comp rx=0 tx=0).stop 2024-04-20T21:19:55.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.359+0000 7fd16d000640 1 -- 172.21.15.71:0/223934634 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd168162670 msgr2=0x7fd1680cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.359+0000 7fd16d000640 1 --2- 172.21.15.71:0/223934634 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd168162670 0x7fd1680cce10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1600012e0 tx=0x7fd16000cb90 comp rx=0 tx=0).stop 2024-04-20T21:19:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.359+0000 7fd167e00640 1 -- 172.21.15.71:0/223934634 reap_dead start 2024-04-20T21:19:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.359+0000 7fd16d000640 1 -- 172.21.15.71:0/223934634 shutdown_connections 2024-04-20T21:19:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.359+0000 7fd16d000640 1 -- 172.21.15.71:0/223934634 >> 172.21.15.71:0/223934634 conn(0x7fd16809d6d0 msgr2=0x7fd1680d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.360+0000 7fd16d000640 1 -- 172.21.15.71:0/223934634 shutdown_connections 2024-04-20T21:19:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.360+0000 7fd16d000640 1 -- 172.21.15.71:0/223934634 wait complete. 2024-04-20T21:19:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.360+0000 7f4740a00640 1 -- 172.21.15.71:0/417155010 --> [v2:172.21.15.71:6814/1038059240,v1:172.21.15.71:6816/1038059240] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47340578f0 con 0x7f471c0760c0 2024-04-20T21:19:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.360+0000 7fc027600640 1 -- 172.21.15.71:0/43606478 --> [v2:172.21.15.71:6824/2731317252,v1:172.21.15.71:6825/2731317252] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbffc002dd0 con 0x7fc000075ff0 2024-04-20T21:19:55.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.361+0000 7fcf39200640 1 -- 172.21.15.71:0/2019115027 >> [v2:172.21.15.137:6815/3627885436,v1:172.21.15.137:6818/3627885436] conn(0x7fcf10075ff0 msgr2=0x7fcf10078430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.361+0000 7fcf39200640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.137:6815/3627885436,v1:172.21.15.137:6818/3627885436] conn(0x7fcf10075ff0 0x7fcf10078430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.361+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 --> [v2:172.21.15.71:6808/2463711085,v1:172.21.15.71:6809/2463711085] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8668150db0 con 0x7f8648075fe0 2024-04-20T21:19:55.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.361+0000 7fcf39200640 1 -- 172.21.15.71:0/2019115027 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fcf1006c8f0 msgr2=0x7fcf1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.361+0000 7fcf39200640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fcf1006c8f0 0x7fcf1006edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcf24034000 tx=0x7fcf24008030 comp rx=0 tx=0).stop 2024-04-20T21:19:55.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.361+0000 7fcf39200640 1 -- 172.21.15.71:0/2019115027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf3406c6d0 msgr2=0x7fcf340cd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.361+0000 7fcf39200640 1 --2- 172.21.15.71:0/2019115027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf3406c6d0 0x7fcf340cd640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00efc0 tx=0x7fcf2c00c490 comp rx=0 tx=0).stop 2024-04-20T21:19:55.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.361+0000 7f865f400640 1 -- 172.21.15.71:0/1717161639 <== osd.2 v2:172.21.15.71:6808/2463711085 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8668150db0 con 0x7f8648075fe0 2024-04-20T21:19:55.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.361+0000 7f472f400640 1 -- 172.21.15.71:0/417155010 <== osd.1 v2:172.21.15.71:6814/1038059240 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f47340578f0 con 0x7f471c0760c0 2024-04-20T21:19:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:6808/2463711085,v1:172.21.15.71:6809/2463711085] conn(0x7f8648075fe0 msgr2=0x7f8648078420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7f866e400640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:6808/2463711085,v1:172.21.15.71:6809/2463711085] conn(0x7f8648075fe0 0x7f8648078420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f864806c8f0 msgr2=0x7f864806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7f866e400640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f864806c8f0 0x7f864806edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f86540097a0 tx=0x7f8654008030 comp rx=0 tx=0).stop 2024-04-20T21:19:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f866806bdd0 msgr2=0x7f8668151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7f866e400640 1 --2- 172.21.15.71:0/1717161639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f866806bdd0 0x7f8668151120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f865800b460 tx=0x7f865800b920 comp rx=0 tx=0).stop 2024-04-20T21:19:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7fcf33e00640 1 -- 172.21.15.71:0/2019115027 reap_dead start 2024-04-20T21:19:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7fcf39200640 1 -- 172.21.15.71:0/2019115027 shutdown_connections 2024-04-20T21:19:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7fcf39200640 1 -- 172.21.15.71:0/2019115027 >> 172.21.15.71:0/2019115027 conn(0x7fcf340d4450 msgr2=0x7fcf340b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7fcf39200640 1 -- 172.21.15.71:0/2019115027 shutdown_connections 2024-04-20T21:19:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7fcf39200640 1 -- 172.21.15.71:0/2019115027 wait complete. 2024-04-20T21:19:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.362+0000 7fc01cc00640 1 -- 172.21.15.71:0/43606478 <== osd.3 v2:172.21.15.71:6824/2731317252 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbffc002dd0 con 0x7fc000075ff0 2024-04-20T21:19:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7f8667e00640 1 -- 172.21.15.71:0/1717161639 reap_dead start 2024-04-20T21:19:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 shutdown_connections 2024-04-20T21:19:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 >> 172.21.15.71:0/1717161639 conn(0x7f8668072090 msgr2=0x7f86680b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7f4740a00640 1 -- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:6814/1038059240,v1:172.21.15.71:6816/1038059240] conn(0x7f471c0760c0 msgr2=0x7f471c078500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7fc027600640 1 -- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:6824/2731317252,v1:172.21.15.71:6825/2731317252] conn(0x7fc000075ff0 msgr2=0x7fc000078430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7fc027600640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:6824/2731317252,v1:172.21.15.71:6825/2731317252] conn(0x7fc000075ff0 0x7fc000078430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7f4740a00640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:6814/1038059240,v1:172.21.15.71:6816/1038059240] conn(0x7f471c0760c0 0x7f471c078500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 shutdown_connections 2024-04-20T21:19:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7fc027600640 1 -- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc00006c8f0 msgr2=0x7fc00006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7fc027600640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc00006c8f0 0x7fc00006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc00c036000 tx=0x7fc00c008030 comp rx=0 tx=0).stop 2024-04-20T21:19:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7fc027600640 1 -- 172.21.15.71:0/43606478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0200b17d0 msgr2=0x7fc0200cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7f866e400640 1 -- 172.21.15.71:0/1717161639 wait complete. 2024-04-20T21:19:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.363+0000 7fc027600640 1 --2- 172.21.15.71:0/43606478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0200b17d0 0x7fc0200cb6b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc01400c480 tx=0x7fc01400c940 comp rx=0 tx=0).stop 2024-04-20T21:19:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.364+0000 7fc025600640 1 -- 172.21.15.71:0/43606478 reap_dead start 2024-04-20T21:19:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.364+0000 7f4740a00640 1 -- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f471c06c940 msgr2=0x7f471c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.364+0000 7f4740a00640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f471c06c940 0x7f471c06ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f47340eb070 tx=0x7f4730007da0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.364+0000 7f4740a00640 1 -- 172.21.15.71:0/417155010 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473403c360 msgr2=0x7f47340086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.364+0000 7f4740a00640 1 --2- 172.21.15.71:0/417155010 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473403c360 0x7f47340086a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47280098c0 tx=0x7f47280046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.365+0000 7f473be00640 1 -- 172.21.15.71:0/417155010 reap_dead start 2024-04-20T21:19:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.365+0000 7f4740a00640 1 -- 172.21.15.71:0/417155010 shutdown_connections 2024-04-20T21:19:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.365+0000 7f4740a00640 1 -- 172.21.15.71:0/417155010 >> 172.21.15.71:0/417155010 conn(0x7f4734056cd0 msgr2=0x7f4734054880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.365+0000 7f4740a00640 1 -- 172.21.15.71:0/417155010 shutdown_connections 2024-04-20T21:19:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.365+0000 7f4740a00640 1 -- 172.21.15.71:0/417155010 wait complete. 2024-04-20T21:19:55.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.366+0000 7fc027600640 1 -- 172.21.15.71:0/43606478 shutdown_connections 2024-04-20T21:19:55.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.366+0000 7fc027600640 1 -- 172.21.15.71:0/43606478 >> 172.21.15.71:0/43606478 conn(0x7fc0200b99c0 msgr2=0x7fc0200b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.367+0000 7fc027600640 1 -- 172.21.15.71:0/43606478 shutdown_connections 2024-04-20T21:19:55.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.367+0000 7fc027600640 1 -- 172.21.15.71:0/43606478 wait complete. 2024-04-20T21:19:55.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.368+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 --> [v2:172.21.15.137:6814/2530248769,v1:172.21.15.137:6816/2530248769] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efee0002dd0 con 0x7efee4076020 2024-04-20T21:19:55.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.368+0000 7f42cf200640 1 -- 172.21.15.71:0/1468802037 --> [v2:172.21.15.137:6808/576639340,v1:172.21.15.137:6809/576639340] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f42c8072720 con 0x7f42a80760b0 2024-04-20T21:19:55.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.369+0000 7efefea00640 1 -- 172.21.15.71:0/526791304 <== osd.5 v2:172.21.15.137:6814/2530248769 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efee0002dd0 con 0x7efee4076020 2024-04-20T21:19:55.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.369+0000 7f42bfe00640 1 -- 172.21.15.71:0/1468802037 <== osd.7 v2:172.21.15.137:6808/576639340 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f42c8072720 con 0x7f42a80760b0 2024-04-20T21:19:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.370+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 >> [v2:172.21.15.137:6814/2530248769,v1:172.21.15.137:6816/2530248769] conn(0x7efee4076020 msgr2=0x7efee4078460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.370+0000 7eff0d400640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.137:6814/2530248769,v1:172.21.15.137:6816/2530248769] conn(0x7efee4076020 0x7efee4078460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.370+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7efee406c920 msgr2=0x7efee406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.370+0000 7f42cf200640 1 -- 172.21.15.71:0/1468802037 >> [v2:172.21.15.137:6808/576639340,v1:172.21.15.137:6809/576639340] conn(0x7f42a80760b0 msgr2=0x7f42a80784f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.370+0000 7f42cf200640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.137:6808/576639340,v1:172.21.15.137:6809/576639340] conn(0x7f42a80760b0 0x7f42a80784f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.370+0000 7f42cf200640 1 -- 172.21.15.71:0/1468802037 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f42a806c9c0 msgr2=0x7f42a806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.371+0000 7f42cf200640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f42a806c9c0 0x7f42a806ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f42b8006fd0 tx=0x7f42b8008040 comp rx=0 tx=0).stop 2024-04-20T21:19:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.371+0000 7f42cf200640 1 -- 172.21.15.71:0/1468802037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42c8162c00 msgr2=0x7f42c814c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.371+0000 7f42cf200640 1 --2- 172.21.15.71:0/1468802037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42c8162c00 0x7f42c814c350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009f40 tx=0x7f42c0004a40 comp rx=0 tx=0).stop 2024-04-20T21:19:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.371+0000 7f42cd200640 1 -- 172.21.15.71:0/1468802037 reap_dead start 2024-04-20T21:19:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.370+0000 7eff0d400640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7efee406c920 0x7efee406ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff00004fd0 tx=0x7eff00004d60 comp rx=0 tx=0).stop 2024-04-20T21:19:55.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.370+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff080d4270 msgr2=0x7eff080b2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.370+0000 7eff0d400640 1 --2- 172.21.15.71:0/526791304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff080d4270 0x7eff080b2fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efef0033000 tx=0x7efef0004730 comp rx=0 tx=0).stop 2024-04-20T21:19:55.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.370+0000 7eff07200640 1 -- 172.21.15.71:0/526791304 reap_dead start 2024-04-20T21:19:55.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.371+0000 7f42cf200640 1 -- 172.21.15.71:0/1468802037 shutdown_connections 2024-04-20T21:19:55.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.371+0000 7f42cf200640 1 -- 172.21.15.71:0/1468802037 >> 172.21.15.71:0/1468802037 conn(0x7f42c80b3350 msgr2=0x7f42c80b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.371+0000 7f42cf200640 1 -- 172.21.15.71:0/1468802037 shutdown_connections 2024-04-20T21:19:55.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.371+0000 7f42cf200640 1 -- 172.21.15.71:0/1468802037 wait complete. 2024-04-20T21:19:55.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.372+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 shutdown_connections 2024-04-20T21:19:55.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.372+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 >> 172.21.15.71:0/526791304 conn(0x7eff080b99c0 msgr2=0x7eff080d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.372+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 shutdown_connections 2024-04-20T21:19:55.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.372+0000 7eff0d400640 1 -- 172.21.15.71:0/526791304 wait complete. 2024-04-20T21:19:55.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.375+0000 7f6887a00640 1 -- 172.21.15.71:0/2272119477 --> [v2:172.21.15.137:6800/604238808,v1:172.21.15.137:6801/604238808] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6880069090 con 0x7f6860076130 2024-04-20T21:19:55.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.377+0000 7f687cc00640 1 -- 172.21.15.71:0/2272119477 <== osd.6 v2:172.21.15.137:6800/604238808 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6880069090 con 0x7f6860076130 2024-04-20T21:19:55.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.380+0000 7f6876000640 1 -- 172.21.15.71:0/2272119477 >> [v2:172.21.15.137:6800/604238808,v1:172.21.15.137:6801/604238808] conn(0x7f6860076130 msgr2=0x7f6860078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.380+0000 7f6876000640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.137:6800/604238808,v1:172.21.15.137:6801/604238808] conn(0x7f6860076130 0x7f6860078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.380+0000 7f6876000640 1 -- 172.21.15.71:0/2272119477 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f686006c9c0 msgr2=0x7f686006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.380+0000 7f6876000640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f686006c9c0 0x7f686006ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f686c036000 tx=0x7f686c030000 comp rx=0 tx=0).stop 2024-04-20T21:19:55.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.380+0000 7f6876000640 1 -- 172.21.15.71:0/2272119477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68800b17d0 msgr2=0x7f6880158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.380+0000 7f6876000640 1 --2- 172.21.15.71:0/2272119477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68800b17d0 0x7f6880158440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f687800c7f0 tx=0x7f687800ccb0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.380+0000 7f6885a00640 1 -- 172.21.15.71:0/2272119477 reap_dead start 2024-04-20T21:19:55.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.381+0000 7f6876000640 1 -- 172.21.15.71:0/2272119477 shutdown_connections 2024-04-20T21:19:55.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.381+0000 7f6876000640 1 -- 172.21.15.71:0/2272119477 >> 172.21.15.71:0/2272119477 conn(0x7f68800b99c0 msgr2=0x7f6880067750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.381+0000 7f6876000640 1 -- 172.21.15.71:0/2272119477 shutdown_connections 2024-04-20T21:19:55.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.382+0000 7f6876000640 1 -- 172.21.15.71:0/2272119477 wait complete. 2024-04-20T21:19:55.415 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2024-04-20T21:19:55.416 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-20T21:19:55.417 INFO:teuthology.orchestra.run.smithi071.stdout:55834574860 2024-04-20T21:19:55.417 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-20T21:19:55.418 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2024-04-20T21:19:55.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-20T21:19:55.419 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2024-04-20T21:19:55.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-20T21:19:55.420 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2024-04-20T21:19:55.420 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-20T21:19:55.421 INFO:teuthology.orchestra.run.smithi071.stdout:55834574859 2024-04-20T21:19:55.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-20T21:19:55.422 INFO:teuthology.orchestra.run.smithi071.stdout:55834574860 2024-04-20T21:19:55.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-20T21:19:55.423 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2024-04-20T21:19:55.423 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-20T21:19:55.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.735+0000 7f6d33800640 1 Processor -- start 2024-04-20T21:19:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.736+0000 7f6d33800640 1 -- start start 2024-04-20T21:19:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.737+0000 7f6d33800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d2c15a7d0 0x7f6d2c0ad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.737+0000 7f6d33800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d2c0ad810 con 0x7f6d2c06de00 2024-04-20T21:19:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.737+0000 7f6d33800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d2c0adaf0 con 0x7f6d2c06bdd0 2024-04-20T21:19:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.737+0000 7f6d33800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2c0addd0 con 0x7f6d2c15a7d0 2024-04-20T21:19:55.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.738+0000 7f6d31800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6d2c06de00 0x7f6d2c0ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46326/0 (socket says 172.21.15.71:46326) 2024-04-20T21:19:55.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.738+0000 7f6d31800640 1 -- 172.21.15.71:0/171589618 learned_addr learned my addr 172.21.15.71:0/171589618 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:55.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.738+0000 7f6d30e00640 1 --2- 172.21.15.71:0/171589618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d2c15a7d0 0x7f6d2c0ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.739+0000 7fd40a800640 1 Processor -- start 2024-04-20T21:19:55.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.739+0000 7fd40a800640 1 -- start start 2024-04-20T21:19:55.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.741+0000 7fd40a800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4040d4270 0x7fd4040d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.741+0000 7fd40a800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4040d0380 0x7fd4040d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.741+0000 7fd40a800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4040d0d10 con 0x7fd4040d4650 2024-04-20T21:19:55.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.741+0000 7fd40a800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd4040d40c0 con 0x7fd4040d4270 2024-04-20T21:19:55.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.741+0000 7fd40a800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd4040d3820 con 0x7fd4040d0380 2024-04-20T21:19:55.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.742+0000 7fd403e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4040d0380 0x7fd4040d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.739+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4064408185 0 0) 0x7f6d2c0ad810 con 0x7f6d2c06de00 2024-04-20T21:19:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.739+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d10003520 con 0x7f6d2c06de00 2024-04-20T21:19:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 281032467 0 0) 0x7f6d10003520 con 0x7f6d2c06de00 2024-04-20T21:19:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d2c15a7d0 msgr2=0x7f6d2c0ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 --2- 172.21.15.71:0/171589618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d2c15a7d0 0x7f6d2c0ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 >> v1:172.21.15.137:6789/0 conn(0x7f6d2c06bdd0 legacy=0x7f6d2c15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c0ae0b0 con 0x7f6d2c06de00 2024-04-20T21:19:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f6d18004e60 con 0x7f6d2c06de00 2024-04-20T21:19:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 >> v1:172.21.15.71:6789/0 conn(0x7f6d2c06de00 legacy=0x7f6d2c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 --2- 172.21.15.71:0/171589618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d100039e0 0x7f6d10003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 --2- 172.21.15.71:0/171589618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100043d0 0x7f6d100048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 --2- 172.21.15.71:0/171589618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d100050a0 0x7f6d1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c0addd0 con 0x7f6d100050a0 2024-04-20T21:19:55.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d100147c0 con 0x7f6d100043d0 2024-04-20T21:19:55.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.740+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6d100149c0 con 0x7f6d100039e0 2024-04-20T21:19:55.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.742+0000 7f4052600640 1 Processor -- start 2024-04-20T21:19:55.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.742+0000 7f4052600640 1 -- start start 2024-04-20T21:19:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.742+0000 7fd403e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4040d0380 0x7fd4040d07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:41936/0 (socket says 172.21.15.71:41936) 2024-04-20T21:19:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.742+0000 7fd402a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd4040d4650 0x7fd4040b1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:40248/0 (socket says 172.21.15.71:40248) 2024-04-20T21:19:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.742+0000 7fd402a00640 1 -- 172.21.15.71:0/1496133096 learned_addr learned my addr 172.21.15.71:0/1496133096 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.743+0000 7fd403e00640 1 -- 172.21.15.71:0/1496133096 >> v2:172.21.15.71:3300/0 conn(0x7fd4040d4270 msgr2=0x7fd4040d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.743+0000 7fd403e00640 1 --2- 172.21.15.71:0/1496133096 >> v2:172.21.15.71:3300/0 conn(0x7fd4040d4270 0x7fd4040d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.743+0000 7fd403e00640 1 -- 172.21.15.71:0/1496133096 >> v1:172.21.15.137:6789/0 conn(0x7fd4040d4650 legacy=0x7fd4040b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.744+0000 7fd403e00640 1 -- 172.21.15.71:0/1496133096 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4040d3b00 con 0x7fd4040d0380 2024-04-20T21:19:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.741+0000 7f6d31800640 1 --2- 172.21.15.71:0/171589618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d100050a0 0x7f6d1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.741+0000 7f6d31800640 1 -- 172.21.15.71:0/171589618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d100039e0 msgr2=0x7f6d10003e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-20T21:19:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.741+0000 7f6d31800640 1 --2- 172.21.15.71:0/171589618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d100039e0 0x7f6d10003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.741+0000 7f6d31800640 1 -- 172.21.15.71:0/171589618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100043d0 msgr2=0x7f6d100048a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-20T21:19:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.741+0000 7f6d31800640 1 --2- 172.21.15.71:0/171589618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100043d0 0x7f6d100048a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.742+0000 7f6d31800640 1 -- 172.21.15.71:0/171589618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c0ae0b0 con 0x7f6d100050a0 2024-04-20T21:19:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.744+0000 7f6d31800640 1 --2- 172.21.15.71:0/171589618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d100050a0 0x7f6d1000b9c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800d780 tx=0x7f6d10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf2c407187eed34 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.744+0000 7f4052600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f40440e30c0 0x7f4044057d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.744+0000 7f4052600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 0x7f4044053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.744+0000 7f4052600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40440582d0 con 0x7f4044054130 2024-04-20T21:19:55.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.744+0000 7f4052600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4044058570 con 0x7f40440e30c0 2024-04-20T21:19:55.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.744+0000 7f4052600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4044058850 con 0x7f404403e840 2024-04-20T21:19:55.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.745+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18001b60 con 0x7f6d100050a0 2024-04-20T21:19:55.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.745+0000 7f404be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 0x7f4044053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.745+0000 7f404be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 0x7f4044053bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:37244/0 (socket says 172.21.15.71:37244) 2024-04-20T21:19:55.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.746+0000 7fd403e00640 1 --2- 172.21.15.71:0/1496133096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4040d0380 0x7fd4040d07d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd404068550 tx=0x7fd3f002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97a725405e632d3f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.746+0000 7f404be00640 1 -- 172.21.15.71:0/337634558 learned_addr learned my addr 172.21.15.71:0/337634558 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.746+0000 7fd402000640 1 -- 172.21.15.71:0/1496133096 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0037070 con 0x7fd4040d0380 2024-04-20T21:19:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.745+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d18037070 con 0x7f6d100050a0 2024-04-20T21:19:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.745+0000 7f6d2b400640 1 -- 172.21.15.71:0/171589618 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18001b60 con 0x7f6d100050a0 2024-04-20T21:19:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.746+0000 7f6d33800640 1 -- 172.21.15.71:0/171589618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d100050a0 msgr2=0x7f6d1000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.746+0000 7f6d33800640 1 --2- 172.21.15.71:0/171589618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d100050a0 0x7f6d1000b9c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800d780 tx=0x7f6d10005830 comp rx=0 tx=0).stop 2024-04-20T21:19:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.746+0000 7f6d31800640 1 -- 172.21.15.71:0/171589618 reap_dead start 2024-04-20T21:19:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.747+0000 7fd402000640 1 -- 172.21.15.71:0/1496133096 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f0030710 con 0x7fd4040d0380 2024-04-20T21:19:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.747+0000 7fd402000640 1 -- 172.21.15.71:0/1496133096 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0030ae0 con 0x7fd4040d0380 2024-04-20T21:19:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.746+0000 7f4051200640 1 --2- 172.21.15.71:0/337634558 >> v2:172.21.15.71:3300/0 conn(0x7f40440e30c0 0x7f4044057d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.747+0000 7f6d33800640 1 -- 172.21.15.71:0/171589618 shutdown_connections 2024-04-20T21:19:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.747+0000 7f6d33800640 1 -- 172.21.15.71:0/171589618 >> 172.21.15.71:0/171589618 conn(0x7f6d2c072090 msgr2=0x7f6d2c0b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.748+0000 7fd40a800640 1 -- 172.21.15.71:0/1496133096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4040d0380 msgr2=0x7fd4040d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.748+0000 7fd40a800640 1 --2- 172.21.15.71:0/1496133096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4040d0380 0x7fd4040d07d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd404068550 tx=0x7fd3f002b710 comp rx=0 tx=0).stop 2024-04-20T21:19:55.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.748+0000 7f6d33800640 1 -- 172.21.15.71:0/171589618 shutdown_connections 2024-04-20T21:19:55.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.748+0000 7f404be00640 1 -- 172.21.15.71:0/337634558 >> v2:172.21.15.71:3300/0 conn(0x7f40440e30c0 msgr2=0x7f4044057d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.748+0000 7f6d33800640 1 -- 172.21.15.71:0/171589618 wait complete. 2024-04-20T21:19:55.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.748+0000 7f404be00640 1 --2- 172.21.15.71:0/337634558 >> v2:172.21.15.71:3300/0 conn(0x7f40440e30c0 0x7f4044057d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.748+0000 7f404be00640 1 -- 172.21.15.71:0/337634558 >> v1:172.21.15.137:6789/0 conn(0x7f4044054130 legacy=0x7f40440e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.749+0000 7f404be00640 1 -- 172.21.15.71:0/337634558 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4044058b30 con 0x7f404403e840 2024-04-20T21:19:55.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.749+0000 7f4051200640 1 --2- 172.21.15.71:0/337634558 >> v2:172.21.15.71:3300/0 conn(0x7f40440e30c0 0x7f4044057d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:55.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.750+0000 7fd40a800640 1 -- 172.21.15.71:0/1496133096 shutdown_connections 2024-04-20T21:19:55.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.750+0000 7fd40a800640 1 --2- 172.21.15.71:0/1496133096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4040d0380 0x7fd4040d07d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.750+0000 7fd40a800640 1 --2- 172.21.15.71:0/1496133096 >> v2:172.21.15.71:3300/0 conn(0x7fd4040d4270 0x7fd4040d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.750+0000 7fd40a800640 1 -- 172.21.15.71:0/1496133096 >> 172.21.15.71:0/1496133096 conn(0x7fd4040b99c0 msgr2=0x7fd4040b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.750+0000 7fd40a800640 1 -- 172.21.15.71:0/1496133096 shutdown_connections 2024-04-20T21:19:55.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.750+0000 7fd40a800640 1 -- 172.21.15.71:0/1496133096 wait complete. 2024-04-20T21:19:55.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.752+0000 7f404be00640 1 --2- 172.21.15.71:0/337634558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 0x7f4044053bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4038009870 tx=0x7f403802ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ef8d089c6a44de8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.750+0000 7f6d33800640 1 Processor -- start 2024-04-20T21:19:55.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.751+0000 7f6d33800640 1 -- start start 2024-04-20T21:19:55.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.752+0000 7f6d33800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100050a0 0x7f6d2c147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.752+0000 7f6d33800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d2c14d930 0x7f6d2c14ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.753+0000 7f6d33800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d2c09b8d0 0x7f6d2c09bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.753+0000 7f8ca6600640 1 Processor -- start 2024-04-20T21:19:55.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.753+0000 7f6d33800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c06baf0 con 0x7f6d2c14d930 2024-04-20T21:19:55.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.753+0000 7f6d33800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c06b970 con 0x7f6d100050a0 2024-04-20T21:19:55.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.753+0000 7f6d33800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2c0b3bf0 con 0x7f6d2c09b8d0 2024-04-20T21:19:55.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.754+0000 7f6d2be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d2c14d930 0x7f6d2c14ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.754+0000 7f6d2be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d2c14d930 0x7f6d2c14ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44856/0 (socket says 172.21.15.71:44856) 2024-04-20T21:19:55.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.754+0000 7f6d2be00640 1 -- 172.21.15.71:0/2795591497 learned_addr learned my addr 172.21.15.71:0/2795591497 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.753+0000 7f8ca6600640 1 -- start start 2024-04-20T21:19:55.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.754+0000 7f6d31800640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d2c09b8d0 0x7f6d2c09bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.754+0000 7f4c1ae00640 1 Processor -- start 2024-04-20T21:19:55.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.754+0000 7f4c1ae00640 1 -- start start 2024-04-20T21:19:55.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.755+0000 7f6d30e00640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100050a0 0x7f6d2c147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.755+0000 7f8ca6600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ca00b3330 0x7f8ca00d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.755+0000 7f8ca6600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca006c190 con 0x7f8ca006cde0 2024-04-20T21:19:55.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.755+0000 7f8ca6600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca006c470 con 0x7f8ca0161d50 2024-04-20T21:19:55.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.755+0000 7f8ca6600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca0162130 con 0x7f8ca00b3330 2024-04-20T21:19:55.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.755+0000 7f6d2be00640 1 -- 172.21.15.71:0/2795591497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d2c09b8d0 msgr2=0x7f6d2c09bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.755+0000 7f6d2be00640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d2c09b8d0 0x7f6d2c09bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.755+0000 7f6d2be00640 1 -- 172.21.15.71:0/2795591497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100050a0 msgr2=0x7f6d2c147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.755+0000 7f8ca5c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ca00b3330 0x7f8ca00d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.755+0000 7f8ca5c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ca00b3330 0x7f8ca00d38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44864/0 (socket says 172.21.15.71:44864) 2024-04-20T21:19:55.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.755+0000 7f8ca5c00640 1 -- 172.21.15.71:0/3822637959 learned_addr learned my addr 172.21.15.71:0/3822637959 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.756+0000 7fd40a800640 1 Processor -- start 2024-04-20T21:19:55.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.756+0000 7f6d2be00640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100050a0 0x7f6d2c147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.756+0000 7f8ca5c00640 1 -- 172.21.15.71:0/3822637959 >> v1:172.21.15.137:6789/0 conn(0x7f8ca0161d50 legacy=0x7f8ca006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.756+0000 7f8ca5c00640 1 -- 172.21.15.71:0/3822637959 >> v1:172.21.15.71:6789/0 conn(0x7f8ca006cde0 legacy=0x7f8ca00b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.756+0000 7fd40a800640 1 -- start start 2024-04-20T21:19:55.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.756+0000 7f6d2be00640 1 -- 172.21.15.71:0/2795591497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c1f0030 con 0x7f6d2c14d930 2024-04-20T21:19:55.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.756+0000 7f6d30e00640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100050a0 0x7f6d2c147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:55.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.757+0000 7f6d2be00640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d2c14d930 0x7f6d2c14ddb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00c4b0 tx=0x7f6d1c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.757+0000 7f4c1ae00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c1415c240 0x7f4c1406dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.756+0000 7f8ca5c00640 1 -- 172.21.15.71:0/3822637959 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca00d2e00 con 0x7f8ca00b3330 2024-04-20T21:19:55.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.757+0000 7f4c1ae00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c1415fa90 con 0x7f4c14162f80 2024-04-20T21:19:55.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.757+0000 7f4c1ae00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c141624a0 con 0x7f4c1406e130 2024-04-20T21:19:55.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.757+0000 7f4c1ae00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4c14162af0 con 0x7f4c1415c240 2024-04-20T21:19:55.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.757+0000 7f404b400640 1 -- 172.21.15.71:0/337634558 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403802f830 con 0x7f404403e840 2024-04-20T21:19:55.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.757+0000 7f404b400640 1 -- 172.21.15.71:0/337634558 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f403802f9d0 con 0x7f404403e840 2024-04-20T21:19:55.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.757+0000 7f404b400640 1 -- 172.21.15.71:0/337634558 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403802fda0 con 0x7f404403e840 2024-04-20T21:19:55.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.757+0000 7f4c13400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4c14162f80 0x7f4c1415ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46340/0 (socket says 172.21.15.71:46340) 2024-04-20T21:19:55.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.757+0000 7f4c13400640 1 -- 172.21.15.71:0/1443340980 learned_addr learned my addr 172.21.15.71:0/1443340980 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:55.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.758+0000 7f6d28c00640 1 -- 172.21.15.71:0/2795591497 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0052d0 con 0x7f6d2c14d930 2024-04-20T21:19:55.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.758+0000 7f6d33800640 1 -- 172.21.15.71:0/2795591497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2c1f0310 con 0x7f6d2c14d930 2024-04-20T21:19:55.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.758+0000 7f6d33800640 1 -- 172.21.15.71:0/2795591497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2c1f08d0 con 0x7f6d2c14d930 2024-04-20T21:19:55.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.758+0000 7f8ca5c00640 1 --2- 172.21.15.71:0/3822637959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca00b3330 0x7f8ca00d38e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009e50 tx=0x7f8c9802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb080ebdafe249f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.758+0000 7fd40a800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4040d0380 0x7fd4040c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.758+0000 7fd40a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4040d4270 0x7fd40415dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.758+0000 7fd40a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4040d4650 0x7fd4040cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.758+0000 7fd40a800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4040b19a0 con 0x7fd4040d4270 2024-04-20T21:19:55.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.758+0000 7fd40a800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd4040cfe60 con 0x7fd4040d4650 2024-04-20T21:19:55.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.758+0000 7fd40a800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd4040d53b0 con 0x7fd4040d0380 2024-04-20T21:19:55.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.758+0000 7f4c13e00640 1 --2- 172.21.15.71:0/1443340980 >> v2:172.21.15.71:3300/0 conn(0x7f4c1415c240 0x7f4c1406dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7f4052600640 1 -- 172.21.15.71:0/337634558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 msgr2=0x7f4044053bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7f4692e00640 1 Processor -- start 2024-04-20T21:19:55.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7f6d28c00640 1 -- 172.21.15.71:0/2795591497 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c005490 con 0x7f6d2c14d930 2024-04-20T21:19:55.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7f6d28c00640 1 -- 172.21.15.71:0/2795591497 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c012870 con 0x7f6d2c14d930 2024-04-20T21:19:55.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7f4052600640 1 --2- 172.21.15.71:0/337634558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 0x7f4044053bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4038009870 tx=0x7f403802ba10 comp rx=0 tx=0).stop 2024-04-20T21:19:55.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7f4692e00640 1 -- start start 2024-04-20T21:19:55.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7f8c9fe00640 1 -- 172.21.15.71:0/3822637959 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9802cbb0 con 0x7f8ca00b3330 2024-04-20T21:19:55.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7f4052600640 1 -- 172.21.15.71:0/337634558 shutdown_connections 2024-04-20T21:19:55.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7f4052600640 1 --2- 172.21.15.71:0/337634558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 0x7f4044053bf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7f4052600640 1 --2- 172.21.15.71:0/337634558 >> v2:172.21.15.71:3300/0 conn(0x7f40440e30c0 0x7f4044057d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.760+0000 7f4052600640 1 -- 172.21.15.71:0/337634558 >> 172.21.15.71:0/337634558 conn(0x7f40440559e0 msgr2=0x7f4044055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.760+0000 7f8c9fe00640 1 -- 172.21.15.71:0/3822637959 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9802cd50 con 0x7f8ca00b3330 2024-04-20T21:19:55.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.760+0000 7f8c9fe00640 1 -- 172.21.15.71:0/3822637959 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98034610 con 0x7f8ca00b3330 2024-04-20T21:19:55.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7fd403400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4040d0380 0x7fd4040c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.760+0000 7fd403e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4040d4650 0x7fd4040cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.760+0000 7fd403e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4040d4650 0x7fd4040cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:41956/0 (socket says 172.21.15.71:41956) 2024-04-20T21:19:55.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.760+0000 7fd403e00640 1 -- 172.21.15.71:0/1012019002 learned_addr learned my addr 172.21.15.71:0/1012019002 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.759+0000 7fd403400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4040d0380 0x7fd4040c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:37264/0 (socket says 172.21.15.71:37264) 2024-04-20T21:19:55.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.760+0000 7f4c13e00640 1 -- 172.21.15.71:0/1443340980 >> v1:172.21.15.137:6789/0 conn(0x7f4c1406e130 legacy=0x7f4c14072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.760+0000 7f4c13e00640 1 -- 172.21.15.71:0/1443340980 >> v1:172.21.15.71:6789/0 conn(0x7f4c14162f80 legacy=0x7f4c1415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.760+0000 7f4c13e00640 1 -- 172.21.15.71:0/1443340980 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c14162780 con 0x7f4c1415c240 2024-04-20T21:19:55.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7fd402a00640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4040d4270 0x7fd40415dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7fd403e00640 1 -- 172.21.15.71:0/1012019002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4040d0380 msgr2=0x7fd4040c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7fd403e00640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4040d0380 0x7fd4040c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7fd403e00640 1 -- 172.21.15.71:0/1012019002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4040d4270 msgr2=0x7fd40415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7fd403e00640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4040d4270 0x7fd40415dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7fd403e00640 1 -- 172.21.15.71:0/1012019002 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4040ca940 con 0x7fd4040d4650 2024-04-20T21:19:55.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7f4692e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f468c06bdd0 0x7f468c0ad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7f4692e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f468c0adaf0 con 0x7f468c0b3bf0 2024-04-20T21:19:55.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7f4692e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f468c0addd0 con 0x7f468c06e510 2024-04-20T21:19:55.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7f4692e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f468c0ae0b0 con 0x7f468c06bdd0 2024-04-20T21:19:55.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.760+0000 7f3fc6a00640 1 Processor -- start 2024-04-20T21:19:55.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.760+0000 7f3fc6a00640 1 -- start start 2024-04-20T21:19:55.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7f6d33800640 1 -- 172.21.15.71:0/2795591497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d04005290 con 0x7f6d2c14d930 2024-04-20T21:19:55.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7f468be00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f468c0b3bf0 0x7f468c06de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46354/0 (socket says 172.21.15.71:46354) 2024-04-20T21:19:55.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7f468be00640 1 -- 172.21.15.71:0/2411555948 learned_addr learned my addr 172.21.15.71:0/2411555948 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:55.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7f4052600640 1 -- 172.21.15.71:0/337634558 shutdown_connections 2024-04-20T21:19:55.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7f8ca6600640 1 -- 172.21.15.71:0/3822637959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca00b3330 msgr2=0x7f8ca00d38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.761+0000 7f8ca6600640 1 --2- 172.21.15.71:0/3822637959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca00b3330 0x7f8ca00d38e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009e50 tx=0x7f8c9802c010 comp rx=0 tx=0).stop 2024-04-20T21:19:55.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2227378401 0 0) 0x7f468c0adaf0 con 0x7f468c0b3bf0 2024-04-20T21:19:55.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f8ca6600640 1 -- 172.21.15.71:0/3822637959 shutdown_connections 2024-04-20T21:19:55.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f8ca6600640 1 --2- 172.21.15.71:0/3822637959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca00b3330 0x7f8ca00d38e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f8ca6600640 1 -- 172.21.15.71:0/3822637959 >> 172.21.15.71:0/3822637959 conn(0x7f8ca00d4450 msgr2=0x7f8ca00d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4670003520 con 0x7f468c0b3bf0 2024-04-20T21:19:55.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4167887478 0 0) 0x7f4670003520 con 0x7f468c0b3bf0 2024-04-20T21:19:55.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f3fc6a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00c79c0 0x7f3fc00d44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f468c06bdd0 msgr2=0x7f468c0ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f3fc6a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3fc00b6c30 0x7f3fc00d4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 --2- 172.21.15.71:0/2411555948 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f468c06bdd0 0x7f468c0ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 >> v1:172.21.15.137:6789/0 conn(0x7f468c06e510 legacy=0x7f468c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c0ae390 con 0x7f468c0b3bf0 2024-04-20T21:19:55.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f4052600640 1 -- 172.21.15.71:0/337634558 wait complete. 2024-04-20T21:19:55.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f467c001670 con 0x7f468c0b3bf0 2024-04-20T21:19:55.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f8ca6600640 1 -- 172.21.15.71:0/3822637959 shutdown_connections 2024-04-20T21:19:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 >> v1:172.21.15.71:6789/0 conn(0x7f468c0b3bf0 legacy=0x7f468c06de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 --2- 172.21.15.71:0/2411555948 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46700039e0 0x7f4670003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 --2- 172.21.15.71:0/2411555948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4670004800 0x7f4670004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 --2- 172.21.15.71:0/2411555948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4670005210 0x7f467000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f468c0ae0b0 con 0x7f4670005210 2024-04-20T21:19:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f467000c120 con 0x7f4670004800 2024-04-20T21:19:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f467000c320 con 0x7f46700039e0 2024-04-20T21:19:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.763+0000 7f4690e00640 1 --2- 172.21.15.71:0/2411555948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4670005210 0x7f467000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.763+0000 7f468be00640 1 --2- 172.21.15.71:0/2411555948 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46700039e0 0x7f4670003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f4683e00640 1 --2- 172.21.15.71:0/2411555948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4670004800 0x7f4670004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f4c13e00640 1 --2- 172.21.15.71:0/1443340980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c1415c240 0x7f4c1406dbf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c040097a0 tx=0x7f4c0402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a74289876950d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.762+0000 7f8ca6600640 1 -- 172.21.15.71:0/3822637959 wait complete. 2024-04-20T21:19:55.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.763+0000 7f3fbfe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00c79c0 0x7f3fc00d44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.763+0000 7f3fbfe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00c79c0 0x7f3fc00d44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:37276/0 (socket says 172.21.15.71:37276) 2024-04-20T21:19:55.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.763+0000 7f3fbfe00640 1 -- 172.21.15.71:0/3012394445 learned_addr learned my addr 172.21.15.71:0/3012394445 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.763+0000 7f3fc6a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fc00d3c80 con 0x7f3fc00b6030 2024-04-20T21:19:55.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.763+0000 7f3fc6a00640 1 -- 172.21.15.71:0/3012394445 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3fc00d3a30 con 0x7f3fc00b6c30 2024-04-20T21:19:55.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.763+0000 7f3fc6a00640 1 -- 172.21.15.71:0/3012394445 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc00d3f60 con 0x7f3fc00c79c0 2024-04-20T21:19:55.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f3fbf400640 1 --2- 172.21.15.71:0/3012394445 >> v2:172.21.15.137:3300/0 conn(0x7f3fc00b6c30 0x7f3fc00d4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f4690e00640 1 -- 172.21.15.71:0/2411555948 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46700039e0 msgr2=0x7f4670003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f4690e00640 1 --2- 172.21.15.71:0/2411555948 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46700039e0 0x7f4670003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f4690e00640 1 -- 172.21.15.71:0/2411555948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4670004800 msgr2=0x7f4670004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f4690e00640 1 --2- 172.21.15.71:0/2411555948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4670004800 0x7f4670004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f4690e00640 1 -- 172.21.15.71:0/2411555948 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c0ae390 con 0x7f4670005210 2024-04-20T21:19:55.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f3fbf400640 1 -- 172.21.15.71:0/3012394445 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00c79c0 msgr2=0x7f3fc00d44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f3fbf400640 1 --2- 172.21.15.71:0/3012394445 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00c79c0 0x7f3fc00d44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f3fbf400640 1 -- 172.21.15.71:0/3012394445 >> v1:172.21.15.71:6789/0 conn(0x7f3fc00b6030 legacy=0x7f3fc00d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f3fbf400640 1 -- 172.21.15.71:0/3012394445 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc00d4240 con 0x7f3fc00b6c30 2024-04-20T21:19:55.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7fd403e00640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4040d4650 0x7fd4040cc8a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009890 tx=0x7fd3f00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.764+0000 7f6d28c00640 1 -- 172.21.15.71:0/2795591497 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d1c012a10 con 0x7f6d2c14d930 2024-04-20T21:19:55.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.765+0000 7f4052600640 1 Processor -- start 2024-04-20T21:19:55.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.765+0000 7f4052600640 1 -- start start 2024-04-20T21:19:55.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.766+0000 7f6d28c00640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6d0c06c8f0 0x7f6d0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.766+0000 7fbb1ca00640 1 Processor -- start 2024-04-20T21:19:55.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.766+0000 7f3fbf400640 1 --2- 172.21.15.71:0/3012394445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fc00b6c30 0x7f3fc00d4a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0097a0 tx=0x7f3fac02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3053991a3f838608 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.766+0000 7f6d28c00640 1 -- 172.21.15.71:0/2795591497 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6d1c08bb20 con 0x7f6d2c14d930 2024-04-20T21:19:55.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.766+0000 7f8ca6600640 1 Processor -- start 2024-04-20T21:19:55.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.766+0000 7fbb1ca00640 1 -- start start 2024-04-20T21:19:55.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7f6d30e00640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6d0c06c8f0 0x7f6d0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7f3fbea00640 1 -- 172.21.15.71:0/3012394445 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac035020 con 0x7f3fc00b6c30 2024-04-20T21:19:55.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7f3fbea00640 1 -- 172.21.15.71:0/3012394445 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fac031830 con 0x7f3fc00b6c30 2024-04-20T21:19:55.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7f3fbea00640 1 -- 172.21.15.71:0/3012394445 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac031c40 con 0x7f3fc00b6c30 2024-04-20T21:19:55.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.766+0000 7f8ca6600640 1 -- start start 2024-04-20T21:19:55.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7f4052600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 0x7f40440df840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7f8ca6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca006cde0 0x7f8ca01498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7f8ca6600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca00b3330 0x7f8ca00cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7fd3fb400640 1 -- 172.21.15.71:0/1012019002 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0042070 con 0x7fd4040d4650 2024-04-20T21:19:55.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7fd3fb400640 1 -- 172.21.15.71:0/1012019002 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f0032a40 con 0x7fd4040d4650 2024-04-20T21:19:55.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7fd3fb400640 1 -- 172.21.15.71:0/1012019002 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0037040 con 0x7fd4040d4650 2024-04-20T21:19:55.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7fd40a800640 1 -- 172.21.15.71:0/1012019002 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40415e2e0 con 0x7fd4040d4650 2024-04-20T21:19:55.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7fd40a800640 1 -- 172.21.15.71:0/1012019002 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4040c8860 con 0x7fd4040d4650 2024-04-20T21:19:55.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f6d30e00640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6d0c06c8f0 0x7f6d0c06edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0b2dc0 tx=0x7f6d2400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.767+0000 7f4052600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4044054130 0x7f4044052580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f4052600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40440e30c0 0x7f404403d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f4052600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40440e34a0 con 0x7f4044054130 2024-04-20T21:19:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f4052600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f404403bfc0 con 0x7f40440e30c0 2024-04-20T21:19:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f4052600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f40440078e0 con 0x7f404403e840 2024-04-20T21:19:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f4051200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 0x7f40440df840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f8ca5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca006cde0 0x7f8ca01498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f8ca5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca006cde0 0x7f8ca01498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:41988/0 (socket says 172.21.15.71:41988) 2024-04-20T21:19:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f8ca6600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca0161d50 0x7f8ca014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f8ca6600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00b3880 con 0x7f8ca0161d50 2024-04-20T21:19:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f8ca6600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00d33c0 con 0x7f8ca006cde0 2024-04-20T21:19:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f8ca6600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca00b3a00 con 0x7f8ca00b3330 2024-04-20T21:19:55.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f4690e00640 1 --2- 172.21.15.71:0/2411555948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4670005210 0x7f467000b9c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f468c06c1b0 tx=0x7f4670005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea9a2320b09cfbd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f4051200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 0x7f40440df840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:37296/0 (socket says 172.21.15.71:37296) 2024-04-20T21:19:55.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f4051200640 1 -- 172.21.15.71:0/962364097 learned_addr learned my addr 172.21.15.71:0/962364097 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f404be00640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4044054130 0x7f4044052580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f8ca5200640 1 -- 172.21.15.71:0/1396113785 learned_addr learned my addr 172.21.15.71:0/1396113785 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.769+0000 7f8c97e00640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca00b3330 0x7f8ca00cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.769+0000 7f8ca5c00640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca0161d50 0x7f8ca014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.769+0000 7f4051c00640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40440e30c0 0x7f404403d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.769+0000 7fd40a800640 1 -- 172.21.15.71:0/1012019002 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd404068980 con 0x7fd4040d4650 2024-04-20T21:19:55.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f3fc6a00640 1 -- 172.21.15.71:0/3012394445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fc00b6c30 msgr2=0x7f3fc00d4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f3fc6a00640 1 --2- 172.21.15.71:0/3012394445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fc00b6c30 0x7f3fc00d4a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0097a0 tx=0x7f3fac02b8d0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f3fc6a00640 1 -- 172.21.15.71:0/3012394445 shutdown_connections 2024-04-20T21:19:55.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f3fc6a00640 1 --2- 172.21.15.71:0/3012394445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fc00b6c30 0x7f3fc00d4a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f3fc6a00640 1 --2- 172.21.15.71:0/3012394445 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00c79c0 0x7f3fc00d44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f3fc6a00640 1 -- 172.21.15.71:0/3012394445 >> 172.21.15.71:0/3012394445 conn(0x7f3fc009d910 msgr2=0x7f3fc00b9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.768+0000 7f3fc6a00640 1 -- 172.21.15.71:0/3012394445 shutdown_connections 2024-04-20T21:19:55.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.769+0000 7f404be00640 1 -- 172.21.15.71:0/962364097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 msgr2=0x7f40440df840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.769+0000 7f404be00640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 0x7f40440df840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.769+0000 7f3fc6a00640 1 -- 172.21.15.71:0/3012394445 wait complete. 2024-04-20T21:19:55.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.769+0000 7fbb1ca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbb18156c20 0x7fbb1806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7fbb1ca00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbb1815ca40 0x7fbb180ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7fbb1ca00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb18141c60 con 0x7fbb180ad8e0 2024-04-20T21:19:55.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7f8ca5c00640 1 -- 172.21.15.71:0/1396113785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca00b3330 msgr2=0x7f8ca00cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7f8ca5c00640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca00b3330 0x7f8ca00cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7f8ca5c00640 1 -- 172.21.15.71:0/1396113785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca006cde0 msgr2=0x7f8ca01498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7fbb1ca00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1815cf90 con 0x7fbb1815ca40 2024-04-20T21:19:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7f8ca5c00640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca006cde0 0x7f8ca01498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7f8ca5c00640 1 -- 172.21.15.71:0/1396113785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca0149df0 con 0x7f8ca0161d50 2024-04-20T21:19:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7fbb1ca00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1815d270 con 0x7fbb18156c20 2024-04-20T21:19:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.769+0000 7f404be00640 1 -- 172.21.15.71:0/962364097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40440e30c0 msgr2=0x7f404403d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.769+0000 7f404be00640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40440e30c0 0x7f404403d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.769+0000 7f404be00640 1 -- 172.21.15.71:0/962364097 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40440d5540 con 0x7f4044054130 2024-04-20T21:19:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7fbb15400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbb1815ca40 0x7fbb180ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7fbb16800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbb180ad8e0 0x7fbb180d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:40294/0 (socket says 172.21.15.71:40294) 2024-04-20T21:19:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7fbb16800640 1 -- 172.21.15.71:0/3857308690 learned_addr learned my addr 172.21.15.71:0/3857308690 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.770+0000 7f8ca5200640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca006cde0 0x7f8ca01498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:55.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.771+0000 7fbb15e00640 1 --2- 172.21.15.71:0/3857308690 >> v2:172.21.15.137:3300/0 conn(0x7fbb18156c20 0x7fbb1806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.771+0000 7f8ca5c00640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca0161d50 0x7f8ca014a320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8ca006c3a0 tx=0x7f8c98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.771+0000 7f404be00640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4044054130 0x7f4044052580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4038033000 tx=0x7f40380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.771+0000 7f3fc6a00640 1 Processor -- start 2024-04-20T21:19:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.771+0000 7f3fc6a00640 1 -- start start 2024-04-20T21:19:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684013290 con 0x7f4670005210 2024-04-20T21:19:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468400fbe0 con 0x7f4670005210 2024-04-20T21:19:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f4c12a00640 1 -- 172.21.15.71:0/1443340980 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04035020 con 0x7f4c1415c240 2024-04-20T21:19:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f4c12a00640 1 -- 172.21.15.71:0/1443340980 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c04031830 con 0x7f4c1415c240 2024-04-20T21:19:55.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f4048c00640 1 -- 172.21.15.71:0/962364097 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038037a80 con 0x7f4044054130 2024-04-20T21:19:55.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f6d28c00640 1 -- 172.21.15.71:0/2795591497 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6d1c0182b0 con 0x7f6d2c14d930 2024-04-20T21:19:55.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f4048c00640 1 -- 172.21.15.71:0/962364097 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4038037c20 con 0x7f4044054130 2024-04-20T21:19:55.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f4052600640 1 -- 172.21.15.71:0/962364097 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40440dd4a0 con 0x7f4044054130 2024-04-20T21:19:55.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f4048c00640 1 -- 172.21.15.71:0/962364097 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038037a80 con 0x7f4044054130 2024-04-20T21:19:55.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f3fc6a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00b6030 0x7f3fc0155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f4052600640 1 -- 172.21.15.71:0/962364097 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40440dda60 con 0x7f4044054130 2024-04-20T21:19:55.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f3fc6a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fc00c79c0 0x7f3fc00cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f3fc6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fc0153760 0x7f3fc00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f4c12a00640 1 -- 172.21.15.71:0/1443340980 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04031c00 con 0x7f4c1415c240 2024-04-20T21:19:55.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f3fc6a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc00d02a0 con 0x7f3fc00c79c0 2024-04-20T21:19:55.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f8c9d600640 1 -- 172.21.15.71:0/1396113785 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98043020 con 0x7f8ca0161d50 2024-04-20T21:19:55.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f8c9d600640 1 -- 172.21.15.71:0/1396113785 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9803e450 con 0x7f8ca0161d50 2024-04-20T21:19:55.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.772+0000 7f8c9d600640 1 -- 172.21.15.71:0/1396113785 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9803e860 con 0x7f8ca0161d50 2024-04-20T21:19:55.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f8ca6600640 1 -- 172.21.15.71:0/1396113785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca00cce70 con 0x7f8ca0161d50 2024-04-20T21:19:55.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f8ca6600640 1 -- 172.21.15.71:0/1396113785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca00cd430 con 0x7f8ca0161d50 2024-04-20T21:19:55.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f4692e00640 1 -- 172.21.15.71:0/2411555948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4670005210 msgr2=0x7f467000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f468b400640 1 -- 172.21.15.71:0/2411555948 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684011110 con 0x7f4670005210 2024-04-20T21:19:55.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f4692e00640 1 --2- 172.21.15.71:0/2411555948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4670005210 0x7f467000b9c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f468c06c1b0 tx=0x7f4670005830 comp rx=0 tx=0).stop 2024-04-20T21:19:55.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f4690e00640 1 -- 172.21.15.71:0/2411555948 reap_dead start 2024-04-20T21:19:55.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.774+0000 7f4c1ae00640 1 -- 172.21.15.71:0/1443340980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c1415c240 msgr2=0x7f4c1406dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.774+0000 7f4c1ae00640 1 --2- 172.21.15.71:0/1443340980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c1415c240 0x7f4c1406dbf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c040097a0 tx=0x7f4c0402b8d0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f3fc6a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc00d0120 con 0x7f3fc0153760 2024-04-20T21:19:55.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.773+0000 7f3fc6a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc00d0420 con 0x7f3fc00b6030 2024-04-20T21:19:55.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.774+0000 7f4692e00640 1 -- 172.21.15.71:0/2411555948 shutdown_connections 2024-04-20T21:19:55.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.774+0000 7f4692e00640 1 -- 172.21.15.71:0/2411555948 >> 172.21.15.71:0/2411555948 conn(0x7f468c072090 msgr2=0x7f468c0b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.771+0000 7fbb15400640 1 -- 172.21.15.71:0/3857308690 >> v2:172.21.15.137:3300/0 conn(0x7fbb18156c20 msgr2=0x7fbb1806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:55.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.771+0000 7fbb15400640 1 --2- 172.21.15.71:0/3857308690 >> v2:172.21.15.137:3300/0 conn(0x7fbb18156c20 0x7fbb1806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.771+0000 7fbb15400640 1 -- 172.21.15.71:0/3857308690 >> v1:172.21.15.137:6789/0 conn(0x7fbb180ad8e0 legacy=0x7fbb180d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.771+0000 7fbb15400640 1 -- 172.21.15.71:0/3857308690 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1815d550 con 0x7fbb1815ca40 2024-04-20T21:19:55.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.774+0000 7fbb15400640 1 --2- 172.21.15.71:0/3857308690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb1815ca40 0x7fbb180ad3a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbb1806fdc0 tx=0x7fbb0802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1707451d641bd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.775+0000 7f4c1ae00640 1 -- 172.21.15.71:0/1443340980 shutdown_connections 2024-04-20T21:19:55.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.775+0000 7f3fbfe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00b6030 0x7f3fc0155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.775+0000 7f3fc4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fc0153760 0x7f3fc00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.775+0000 7f3fc4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fc0153760 0x7f3fc00b70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:42020/0 (socket says 172.21.15.71:42020) 2024-04-20T21:19:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.775+0000 7f3fc4a00640 1 -- 172.21.15.71:0/1892136594 learned_addr learned my addr 172.21.15.71:0/1892136594 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.775+0000 7f4c1ae00640 1 --2- 172.21.15.71:0/1443340980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c1415c240 0x7f4c1406dbf0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c040097a0 tx=0x7f4c0402b8d0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.775+0000 7f4c1ae00640 1 -- 172.21.15.71:0/1443340980 >> 172.21.15.71:0/1443340980 conn(0x7f4c14072090 msgr2=0x7f4c140b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.775+0000 7f4052600640 1 -- 172.21.15.71:0/962364097 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4028005290 con 0x7f4044054130 2024-04-20T21:19:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.775+0000 7f8ca6600640 1 -- 172.21.15.71:0/1396113785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca0075b60 con 0x7f8ca0161d50 2024-04-20T21:19:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.776+0000 7f3fbf400640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fc00c79c0 0x7f3fc00cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.776+0000 7fbb14a00640 1 -- 172.21.15.71:0/3857308690 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08035020 con 0x7fbb1815ca40 2024-04-20T21:19:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.776+0000 7fbb14a00640 1 -- 172.21.15.71:0/3857308690 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb08031640 con 0x7fbb1815ca40 2024-04-20T21:19:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.776+0000 7fbb14a00640 1 -- 172.21.15.71:0/3857308690 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0802d040 con 0x7fbb1815ca40 2024-04-20T21:19:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7f4048c00640 1 -- 172.21.15.71:0/962364097 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4038049020 con 0x7f4044054130 2024-04-20T21:19:55.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7f4692e00640 1 -- 172.21.15.71:0/2411555948 shutdown_connections 2024-04-20T21:19:55.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7f3fbfe00640 1 -- 172.21.15.71:0/1892136594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fc0153760 msgr2=0x7f3fc00b70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7f3fbfe00640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fc0153760 0x7f3fc00b70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7f3fbfe00640 1 -- 172.21.15.71:0/1892136594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fc00c79c0 msgr2=0x7f3fc00cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7f3fbfe00640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fc00c79c0 0x7f3fc00cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7f3fbfe00640 1 -- 172.21.15.71:0/1892136594 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc0153bf0 con 0x7f3fc00b6030 2024-04-20T21:19:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.775+0000 7fd3fb400640 1 -- 172.21.15.71:0/1012019002 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd3f0045070 con 0x7fd4040d4650 2024-04-20T21:19:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.776+0000 7fd3fb400640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd3e406c9c0 0x7fd3e406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.776+0000 7fd3fb400640 1 -- 172.21.15.71:0/1012019002 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd3f00ae130 con 0x7fd4040d4650 2024-04-20T21:19:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7fd403400640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd3e406c9c0 0x7fd3e406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7fbb1ca00640 1 -- 172.21.15.71:0/3857308690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb1815ca40 msgr2=0x7fbb180ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7fbb1ca00640 1 --2- 172.21.15.71:0/3857308690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb1815ca40 0x7fbb180ad3a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbb1806fdc0 tx=0x7fbb0802b8f0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7f3fc4a00640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fc0153760 0x7f3fc00b70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:55.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7f4c1ae00640 1 -- 172.21.15.71:0/1443340980 shutdown_connections 2024-04-20T21:19:55.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7fbb1ca00640 1 -- 172.21.15.71:0/3857308690 shutdown_connections 2024-04-20T21:19:55.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7fbb1ca00640 1 --2- 172.21.15.71:0/3857308690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb1815ca40 0x7fbb180ad3a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7fbb1ca00640 1 --2- 172.21.15.71:0/3857308690 >> v2:172.21.15.137:3300/0 conn(0x7fbb18156c20 0x7fbb1806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7fbb1ca00640 1 -- 172.21.15.71:0/3857308690 >> 172.21.15.71:0/3857308690 conn(0x7fbb180b3350 msgr2=0x7fbb180b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:55.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.778+0000 7f3fbfe00640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00b6030 0x7f3fc0155ef0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000e880 tx=0x7f3fb000ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.778+0000 7f4048c00640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f402c06caf0 0x7f402c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.778+0000 7f4048c00640 1 -- 172.21.15.71:0/962364097 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f40380ae0d0 con 0x7f4044054130 2024-04-20T21:19:55.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.778+0000 7fbb1ca00640 1 -- 172.21.15.71:0/3857308690 shutdown_connections 2024-04-20T21:19:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.778+0000 7f3fb7e00640 1 -- 172.21.15.71:0/1892136594 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0017070 con 0x7f3fc00b6030 2024-04-20T21:19:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.778+0000 7fbb1ca00640 1 -- 172.21.15.71:0/3857308690 wait complete. 2024-04-20T21:19:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.778+0000 7f3fb7e00640 1 -- 172.21.15.71:0/1892136594 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb000c940 con 0x7f3fc00b6030 2024-04-20T21:19:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.778+0000 7f3fb7e00640 1 -- 172.21.15.71:0/1892136594 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000cd10 con 0x7f3fc00b6030 2024-04-20T21:19:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.777+0000 7f4692e00640 1 -- 172.21.15.71:0/2411555948 wait complete. 2024-04-20T21:19:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.779+0000 7fd403400640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd3e406c9c0 0x7fd3e406ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40098e0 tx=0x7fd3f4009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.779+0000 7f8c9d600640 1 -- 172.21.15.71:0/1396113785 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c98046020 con 0x7f8ca0161d50 2024-04-20T21:19:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.778+0000 7f4c1ae00640 1 -- 172.21.15.71:0/1443340980 wait complete. 2024-04-20T21:19:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.779+0000 7f3fc6a00640 1 -- 172.21.15.71:0/1892136594 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc0153ed0 con 0x7f3fc00b6030 2024-04-20T21:19:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.779+0000 7f3fc6a00640 1 -- 172.21.15.71:0/1892136594 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc0154490 con 0x7f3fc00b6030 2024-04-20T21:19:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.780+0000 7f4051200640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f402c06caf0 0x7f402c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.780+0000 7f4c1ae00640 1 Processor -- start 2024-04-20T21:19:55.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.781+0000 7f8c9d600640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8c7c06c8f0 0x7f8c7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.781+0000 7f8c9d600640 1 -- 172.21.15.71:0/1396113785 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8c980aebb0 con 0x7f8ca0161d50 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.780+0000 7f4c1ae00640 1 -- start start 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.781+0000 7f4c1ae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c1406e130 0x7f4c141528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.781+0000 7f4c1ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c14162f80 0x7f4c14147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.781+0000 7f4c1ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c14148150 0x7f4c14146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.781+0000 7f4c1ae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1415f550 con 0x7f4c1406e130 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.781+0000 7f4c1ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1415f3d0 con 0x7f4c14162f80 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.781+0000 7f4c1ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1415f6d0 con 0x7f4c14148150 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.782+0000 7f4c13e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c1406e130 0x7f4c141528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.782+0000 7f4c13e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c1406e130 0x7f4c141528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44944/0 (socket says 172.21.15.71:44944) 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.782+0000 7f4c13e00640 1 -- 172.21.15.71:0/2451197936 learned_addr learned my addr 172.21.15.71:0/2451197936 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.782+0000 7f4c13e00640 1 -- 172.21.15.71:0/2451197936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c14148150 msgr2=0x7f4c14146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.782+0000 7f4c13e00640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c14148150 0x7f4c14146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.782+0000 7f4c13e00640 1 -- 172.21.15.71:0/2451197936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c14162f80 msgr2=0x7f4c14147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.782+0000 7f4c13e00640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c14162f80 0x7f4c14147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.782+0000 7f4c13e00640 1 -- 172.21.15.71:0/2451197936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c14151560 con 0x7f4c1406e130 2024-04-20T21:19:55.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.783+0000 7f4c13e00640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c1406e130 0x7f4c141528c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4c040098c0 tx=0x7f4c040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.781+0000 7f3fb5600640 1 -- 172.21.15.71:0/1892136594 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc0068980 con 0x7f3fc00b6030 2024-04-20T21:19:55.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.783+0000 7f3fb7e00640 1 -- 172.21.15.71:0/1892136594 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3fb001a070 con 0x7f3fc00b6030 2024-04-20T21:19:55.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.782+0000 7fbb1ca00640 1 Processor -- start 2024-04-20T21:19:55.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.782+0000 7fbb1ca00640 1 -- start start 2024-04-20T21:19:55.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.784+0000 7f4051200640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f402c06caf0 0x7f402c06efb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4040009560 tx=0x7f4040009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.782+0000 7f8ca5200640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8c7c06c8f0 0x7f8c7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.783+0000 7f4692e00640 1 Processor -- start 2024-04-20T21:19:55.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.784+0000 7fbb1ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb180ad8e0 0x7fbb18099b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.784+0000 7fbb1ca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb18156c20 0x7fbb1808d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.784+0000 7fbb1ca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb1815ca40 0x7fbb180cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.784+0000 7fbb1ca00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1806bfc0 con 0x7fbb1815ca40 2024-04-20T21:19:55.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.784+0000 7fbb1ca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1806be40 con 0x7fbb180ad8e0 2024-04-20T21:19:55.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.784+0000 7fbb1ca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbb180d0a70 con 0x7fbb18156c20 2024-04-20T21:19:55.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7f8ca5200640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8c7c06c8f0 0x7f8c7c06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c90001b90 tx=0x7f8c90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7fbb15e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb180ad8e0 0x7fbb18099b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7f3fb7e00640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3fa006c8f0 0x7f3fa006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7f4048c00640 1 -- 172.21.15.71:0/962364097 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4038033030 con 0x7f4044054130 2024-04-20T21:19:55.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.784+0000 7f4692e00640 1 -- start start 2024-04-20T21:19:55.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7f4692e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4670005210 0x7f468c1f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7f4692e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f468c14a5f0 0x7f468c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7f4692e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f468c1512a0 0x7f468c0b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7f4692e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f468c0ad210 con 0x7f468c14a5f0 2024-04-20T21:19:55.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7f4692e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f468c06bb80 con 0x7f4670005210 2024-04-20T21:19:55.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7f4692e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f468c0ad390 con 0x7f468c1512a0 2024-04-20T21:19:55.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7fbb15e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb180ad8e0 0x7fbb18099b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:42036/0 (socket says 172.21.15.71:42036) 2024-04-20T21:19:55.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7fbb15e00640 1 -- 172.21.15.71:0/2628335919 learned_addr learned my addr 172.21.15.71:0/2628335919 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7fbb15400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb18156c20 0x7fbb1808d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.785+0000 7fbb16800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb1815ca40 0x7fbb180cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.786+0000 7f4683e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f468c14a5f0 0x7f468c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.786+0000 7f4683e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f468c14a5f0 0x7f468c150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44970/0 (socket says 172.21.15.71:44970) 2024-04-20T21:19:55.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.786+0000 7f4683e00640 1 -- 172.21.15.71:0/645764232 learned_addr learned my addr 172.21.15.71:0/645764232 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:55.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.786+0000 7f3fb7e00640 1 -- 172.21.15.71:0/1892136594 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3fb008c050 con 0x7f3fc00b6030 2024-04-20T21:19:55.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.786+0000 7f3fbf400640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3fa006c8f0 0x7f3fa006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.786+0000 7f468be00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4670005210 0x7f468c1f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7f4683e00640 1 -- 172.21.15.71:0/645764232 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f468c1512a0 msgr2=0x7f468c0b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7f4683e00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f468c1512a0 0x7f468c0b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7f4683e00640 1 -- 172.21.15.71:0/645764232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4670005210 msgr2=0x7f468c1f3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7f4683e00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4670005210 0x7f468c1f3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7f4683e00640 1 -- 172.21.15.71:0/645764232 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c151800 con 0x7f468c14a5f0 2024-04-20T21:19:55.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7fbb15e00640 1 -- 172.21.15.71:0/2628335919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb18156c20 msgr2=0x7fbb1808d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7fbb15e00640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb18156c20 0x7fbb1808d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7fbb15e00640 1 -- 172.21.15.71:0/2628335919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb1815ca40 msgr2=0x7fbb180cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:55.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7fbb15e00640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb1815ca40 0x7fbb180cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:55.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7fbb15e00640 1 -- 172.21.15.71:0/2628335919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb180cccd0 con 0x7fbb180ad8e0 2024-04-20T21:19:55.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7fbb15400640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb18156c20 0x7fbb1808d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:55.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7f4683e00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f468c14a5f0 0x7f468c150d60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f467400e510 tx=0x7f467400e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7fbb16800640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb1815ca40 0x7fbb180cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:55.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.787+0000 7f3fbf400640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3fa006c8f0 0x7f3fa006edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3fac036000 tx=0x7f3fac008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.788+0000 7fbb15e00640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb180ad8e0 0x7fbb18099b00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400d800 tx=0x7fbb0400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.789+0000 7f4c0be00640 1 -- 172.21.15.71:0/2451197936 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04041070 con 0x7f4c1406e130 2024-04-20T21:19:55.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.789+0000 7f4c0be00640 1 -- 172.21.15.71:0/2451197936 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0403aba0 con 0x7f4c1406e130 2024-04-20T21:19:55.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.789+0000 7f4c0be00640 1 -- 172.21.15.71:0/2451197936 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04035040 con 0x7f4c1406e130 2024-04-20T21:19:55.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.790+0000 7f4c1ae00640 1 -- 172.21.15.71:0/2451197936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c14151820 con 0x7f4c1406e130 2024-04-20T21:19:55.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.790+0000 7f8c9d600640 1 -- 172.21.15.71:0/1396113785 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8c9804d030 con 0x7f8ca0161d50 2024-04-20T21:19:55.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.790+0000 7f4c1ae00640 1 -- 172.21.15.71:0/2451197936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c14151de0 con 0x7f4c1406e130 2024-04-20T21:19:55.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.789+0000 7f4688c00640 1 -- 172.21.15.71:0/645764232 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46740135f0 con 0x7f468c14a5f0 2024-04-20T21:19:55.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.789+0000 7f4688c00640 1 -- 172.21.15.71:0/645764232 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467401a070 con 0x7f468c14a5f0 2024-04-20T21:19:55.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.789+0000 7f4688c00640 1 -- 172.21.15.71:0/645764232 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46740139f0 con 0x7f468c14a5f0 2024-04-20T21:19:55.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.790+0000 7f4692e00640 1 -- 172.21.15.71:0/645764232 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468c151ae0 con 0x7f468c14a5f0 2024-04-20T21:19:55.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.790+0000 7f4692e00640 1 -- 172.21.15.71:0/645764232 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468c1f3790 con 0x7f468c14a5f0 2024-04-20T21:19:55.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.791+0000 7f4692e00640 1 -- 172.21.15.71:0/645764232 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468c1f3990 con 0x7f468c14a5f0 2024-04-20T21:19:55.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.792+0000 7f4c1ae00640 1 -- 172.21.15.71:0/2451197936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c14068980 con 0x7f4c1406e130 2024-04-20T21:19:55.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.792+0000 7fbb0e000640 1 -- 172.21.15.71:0/2628335919 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400b6c0 con 0x7fbb180ad8e0 2024-04-20T21:19:55.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.792+0000 7fbb0e000640 1 -- 172.21.15.71:0/2628335919 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb04019070 con 0x7fbb180ad8e0 2024-04-20T21:19:55.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.792+0000 7fbb0e000640 1 -- 172.21.15.71:0/2628335919 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400ba80 con 0x7fbb180ad8e0 2024-04-20T21:19:55.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.792+0000 7fbb1ca00640 1 -- 172.21.15.71:0/2628335919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1815e440 con 0x7fbb180ad8e0 2024-04-20T21:19:55.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.792+0000 7fbb1ca00640 1 -- 172.21.15.71:0/2628335919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb180ccf70 con 0x7fbb180ad8e0 2024-04-20T21:19:55.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.792+0000 7fd3fb400640 1 -- 172.21.15.71:0/1012019002 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd3f007bbb0 con 0x7fd4040d4650 2024-04-20T21:19:55.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.793+0000 7fbb1ca00640 1 -- 172.21.15.71:0/2628335919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb18068980 con 0x7fbb180ad8e0 2024-04-20T21:19:55.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.794+0000 7f4688c00640 1 -- 172.21.15.71:0/645764232 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4674013b90 con 0x7f468c14a5f0 2024-04-20T21:19:55.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.793+0000 7f4c0be00640 1 -- 172.21.15.71:0/2451197936 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c0404c060 con 0x7f4c1406e130 2024-04-20T21:19:55.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.795+0000 7f4c0be00640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4bf406c940 0x7f4bf406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.795+0000 7f4c0be00640 1 -- 172.21.15.71:0/2451197936 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4c040ad770 con 0x7f4c1406e130 2024-04-20T21:19:55.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.795+0000 7f4688c00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f466806c970 0x7f466806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.796+0000 7f4688c00640 1 -- 172.21.15.71:0/645764232 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f467408bf70 con 0x7f468c14a5f0 2024-04-20T21:19:55.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.796+0000 7f4c13400640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4bf406c940 0x7f4bf406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.796+0000 7f468be00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f466806c970 0x7f466806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.797+0000 7fbb0e000640 1 -- 172.21.15.71:0/2628335919 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb0400bc20 con 0x7fbb180ad8e0 2024-04-20T21:19:55.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.797+0000 7f468be00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f466806c970 0x7f466806ee30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f467c000ff0 tx=0x7f467c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.797+0000 7f4c13400640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4bf406c940 0x7f4bf406ee00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4c14161260 tx=0x7f4c0c001660 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.798+0000 7fbb0e000640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbaf806c9c0 0x7fbaf806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:55.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.798+0000 7fbb0e000640 1 -- 172.21.15.71:0/2628335919 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbb0408cd70 con 0x7fbb180ad8e0 2024-04-20T21:19:55.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.799+0000 7fbb15400640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbaf806c9c0 0x7fbaf806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:55.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.800+0000 7fbb15400640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbaf806c9c0 0x7fbaf806ee80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb08036000 tx=0x7fbb0803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:55.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.801+0000 7f3fb7e00640 1 -- 172.21.15.71:0/1892136594 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3fb0059c60 con 0x7f3fc00b6030 2024-04-20T21:19:55.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.807+0000 7f4c0be00640 1 -- 172.21.15.71:0/2451197936 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4c0407b8d0 con 0x7f4c1406e130 2024-04-20T21:19:55.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.810+0000 7fbb0e000640 1 -- 172.21.15.71:0/2628335919 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbb0405a7f0 con 0x7fbb180ad8e0 2024-04-20T21:19:55.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:55.816+0000 7f4688c00640 1 -- 172.21.15.71:0/645764232 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f468c1f3990 con 0x7f468c14a5f0 2024-04-20T21:19:56.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.208+0000 7f6d33800640 1 -- 172.21.15.71:0/2795591497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6d04005580 con 0x7f6d2c14d930 2024-04-20T21:19:56.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.209+0000 7f6d28c00640 1 -- 172.21.15.71:0/2795591497 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6d1c059b70 con 0x7f6d2c14d930 2024-04-20T21:19:56.210 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2024-04-20T21:19:56.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.213+0000 7f6d33800640 1 -- 172.21.15.71:0/2795591497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6d0c06c8f0 msgr2=0x7f6d0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.213+0000 7f6d33800640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6d0c06c8f0 0x7f6d0c06edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0b2dc0 tx=0x7f6d2400b040 comp rx=0 tx=0).stop 2024-04-20T21:19:56.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.213+0000 7f6d33800640 1 -- 172.21.15.71:0/2795591497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d2c14d930 msgr2=0x7f6d2c14ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.213+0000 7f6d33800640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d2c14d930 0x7f6d2c14ddb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00c4b0 tx=0x7f6d1c00c970 comp rx=0 tx=0).stop 2024-04-20T21:19:56.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.214+0000 7f6d33800640 1 -- 172.21.15.71:0/2795591497 shutdown_connections 2024-04-20T21:19:56.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.215+0000 7f6d33800640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6d0c06c8f0 0x7f6d0c06edb0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0b2dc0 tx=0x7f6d2400b040 comp rx=0 tx=0).stop 2024-04-20T21:19:56.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.215+0000 7f6d33800640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d2c09b8d0 0x7f6d2c09bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.215+0000 7f6d33800640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d2c14d930 0x7f6d2c14ddb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.215+0000 7f6d33800640 1 --2- 172.21.15.71:0/2795591497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100050a0 0x7f6d2c147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.215+0000 7f6d33800640 1 -- 172.21.15.71:0/2795591497 >> 172.21.15.71:0/2795591497 conn(0x7f6d2c072090 msgr2=0x7f6d2c155050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:56.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.215+0000 7f4052600640 1 -- 172.21.15.71:0/962364097 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4028005580 con 0x7f4044054130 2024-04-20T21:19:56.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.215+0000 7f6d33800640 1 -- 172.21.15.71:0/2795591497 shutdown_connections 2024-04-20T21:19:56.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.216+0000 7f6d33800640 1 -- 172.21.15.71:0/2795591497 wait complete. 2024-04-20T21:19:56.216 INFO:teuthology.orchestra.run.smithi071.stdout:55834574856 2024-04-20T21:19:56.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.216+0000 7f4048c00640 1 -- 172.21.15.71:0/962364097 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f403807c120 con 0x7f4044054130 2024-04-20T21:19:56.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.219+0000 7f4052600640 1 -- 172.21.15.71:0/962364097 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f402c06caf0 msgr2=0x7f402c06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.219+0000 7f4052600640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f402c06caf0 0x7f402c06efb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4040009560 tx=0x7f4040009190 comp rx=0 tx=0).stop 2024-04-20T21:19:56.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.219+0000 7f4052600640 1 -- 172.21.15.71:0/962364097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4044054130 msgr2=0x7f4044052580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.219+0000 7f4052600640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4044054130 0x7f4044052580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4038033000 tx=0x7f40380046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.220+0000 7f4052600640 1 -- 172.21.15.71:0/962364097 shutdown_connections 2024-04-20T21:19:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.220+0000 7f4052600640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f402c06caf0 0x7f402c06efb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.220+0000 7f4052600640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40440e30c0 0x7f404403d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.220+0000 7f4052600640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4044054130 0x7f4044052580 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.220+0000 7f4052600640 1 --2- 172.21.15.71:0/962364097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404403e840 0x7f40440df840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.220+0000 7f4052600640 1 -- 172.21.15.71:0/962364097 >> 172.21.15.71:0/962364097 conn(0x7f40440559e0 msgr2=0x7f4044038f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.220+0000 7f4052600640 1 -- 172.21.15.71:0/962364097 shutdown_connections 2024-04-20T21:19:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.220+0000 7f4052600640 1 -- 172.21.15.71:0/962364097 wait complete. 2024-04-20T21:19:56.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.229+0000 7f8ca6600640 1 -- 172.21.15.71:0/1396113785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8ca00cb2e0 con 0x7f8ca0161d50 2024-04-20T21:19:56.231 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2024-04-20T21:19:56.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.230+0000 7f8c9d600640 1 -- 172.21.15.71:0/1396113785 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8c9807c6d0 con 0x7f8ca0161d50 2024-04-20T21:19:56.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.233+0000 7f8ca6600640 1 -- 172.21.15.71:0/1396113785 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8c7c06c8f0 msgr2=0x7f8c7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.233+0000 7f3fb5600640 1 -- 172.21.15.71:0/1892136594 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3fc00733c0 con 0x7f3fc00b6030 2024-04-20T21:19:56.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.233+0000 7f8ca6600640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8c7c06c8f0 0x7f8c7c06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c90001b90 tx=0x7f8c90009040 comp rx=0 tx=0).stop 2024-04-20T21:19:56.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.233+0000 7f8ca6600640 1 -- 172.21.15.71:0/1396113785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca0161d50 msgr2=0x7f8ca014a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.233+0000 7f8ca6600640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca0161d50 0x7f8ca014a320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8ca006c3a0 tx=0x7f8c98004a40 comp rx=0 tx=0).stop 2024-04-20T21:19:56.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.234+0000 7f8ca6600640 1 -- 172.21.15.71:0/1396113785 shutdown_connections 2024-04-20T21:19:56.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.234+0000 7f8ca6600640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8c7c06c8f0 0x7f8c7c06edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.234+0000 7f8ca6600640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca0161d50 0x7f8ca014a320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.234+0000 7f8ca6600640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ca00b3330 0x7f8ca00cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.234+0000 7f8ca6600640 1 --2- 172.21.15.71:0/1396113785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca006cde0 0x7f8ca01498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.234+0000 7f8ca6600640 1 -- 172.21.15.71:0/1396113785 >> 172.21.15.71:0/1396113785 conn(0x7f8ca00d4450 msgr2=0x7f8ca00b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:56.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.234+0000 7f8ca6600640 1 -- 172.21.15.71:0/1396113785 shutdown_connections 2024-04-20T21:19:56.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.234+0000 7f8ca6600640 1 -- 172.21.15.71:0/1396113785 wait complete. 2024-04-20T21:19:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.237+0000 7fd40a800640 1 -- 172.21.15.71:0/1012019002 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd4040b14e0 con 0x7fd4040d4650 2024-04-20T21:19:56.237 INFO:teuthology.orchestra.run.smithi071.stdout:55834574859 2024-04-20T21:19:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.235+0000 7f3fb7e00640 1 -- 172.21.15.71:0/1892136594 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3fb005df60 con 0x7f3fc00b6030 2024-04-20T21:19:56.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.238+0000 7f3fc6a00640 1 -- 172.21.15.71:0/1892136594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3fa006c8f0 msgr2=0x7f3fa006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.238+0000 7f3fc6a00640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3fa006c8f0 0x7f3fa006edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3fac036000 tx=0x7f3fac008030 comp rx=0 tx=0).stop 2024-04-20T21:19:56.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.238+0000 7fd3fb400640 1 -- 172.21.15.71:0/1012019002 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd3f007feb0 con 0x7fd4040d4650 2024-04-20T21:19:56.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.238+0000 7f3fc6a00640 1 -- 172.21.15.71:0/1892136594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00b6030 msgr2=0x7f3fc0155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.238+0000 7f3fc6a00640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00b6030 0x7f3fc0155ef0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000e880 tx=0x7f3fb000ed40 comp rx=0 tx=0).stop 2024-04-20T21:19:56.239 INFO:teuthology.orchestra.run.smithi071.stdout:55834574859 2024-04-20T21:19:56.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.239+0000 7f3fc6a00640 1 -- 172.21.15.71:0/1892136594 shutdown_connections 2024-04-20T21:19:56.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.240+0000 7f3fc6a00640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3fa006c8f0 0x7f3fa006edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.240+0000 7f3fc6a00640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fc0153760 0x7f3fc00b70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.240+0000 7f3fc6a00640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fc00c79c0 0x7f3fc00cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.240+0000 7f3fc6a00640 1 --2- 172.21.15.71:0/1892136594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3fc00b6030 0x7f3fc0155ef0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.240+0000 7f3fc6a00640 1 -- 172.21.15.71:0/1892136594 >> 172.21.15.71:0/1892136594 conn(0x7f3fc009d910 msgr2=0x7f3fc00b6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:56.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7f3fc6a00640 1 -- 172.21.15.71:0/1892136594 shutdown_connections 2024-04-20T21:19:56.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7f3fc6a00640 1 -- 172.21.15.71:0/1892136594 wait complete. 2024-04-20T21:19:56.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7fd40a800640 1 -- 172.21.15.71:0/1012019002 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd3e406c9c0 msgr2=0x7fd3e406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7fd40a800640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd3e406c9c0 0x7fd3e406ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40098e0 tx=0x7fd3f4009060 comp rx=0 tx=0).stop 2024-04-20T21:19:56.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7fd40a800640 1 -- 172.21.15.71:0/1012019002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4040d4650 msgr2=0x7fd4040cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7fd40a800640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4040d4650 0x7fd4040cc8a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009890 tx=0x7fd3f00046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-04-20T21:19:56.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7fd40a800640 1 -- 172.21.15.71:0/1012019002 shutdown_connections 2024-04-20T21:19:56.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7fd40a800640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd3e406c9c0 0x7fd3e406ee80 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40098e0 tx=0x7fd3f4009060 comp rx=0 tx=0).stop 2024-04-20T21:19:56.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7fd40a800640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4040d4650 0x7fd4040cc8a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7fd40a800640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4040d4270 0x7fd40415dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7fd40a800640 1 --2- 172.21.15.71:0/1012019002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4040d0380 0x7fd4040c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.241+0000 7fd40a800640 1 -- 172.21.15.71:0/1012019002 >> 172.21.15.71:0/1012019002 conn(0x7fd4040b99c0 msgr2=0x7fd4040b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:56.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.243+0000 7fd40a800640 1 -- 172.21.15.71:0/1012019002 shutdown_connections 2024-04-20T21:19:56.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.243+0000 7fd40a800640 1 -- 172.21.15.71:0/1012019002 wait complete. 2024-04-20T21:19:56.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.247+0000 7f4c1ae00640 1 -- 172.21.15.71:0/2451197936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4c140d0f40 con 0x7f4c1406e130 2024-04-20T21:19:56.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.248+0000 7fbb1ca00640 1 -- 172.21.15.71:0/2628335919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbb180cfd90 con 0x7fbb180ad8e0 2024-04-20T21:19:56.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.248+0000 7f4c0be00640 1 -- 172.21.15.71:0/2451197936 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c0407b1d0 con 0x7f4c1406e130 2024-04-20T21:19:56.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.248+0000 7fbb0e000640 1 -- 172.21.15.71:0/2628335919 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb0405eaf0 con 0x7fbb180ad8e0 2024-04-20T21:19:56.249 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2024-04-20T21:19:56.249 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2024-04-20T21:19:56.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-04-20T21:19:56.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.251+0000 7f4692e00640 1 -- 172.21.15.71:0/645764232 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f468c068980 con 0x7f468c14a5f0 2024-04-20T21:19:56.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 -- 172.21.15.71:0/2451197936 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4bf406c940 msgr2=0x7f4bf406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4bf406c940 0x7f4bf406ee00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4c14161260 tx=0x7f4c0c001660 comp rx=0 tx=0).stop 2024-04-20T21:19:56.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 -- 172.21.15.71:0/2451197936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c1406e130 msgr2=0x7f4c141528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c1406e130 0x7f4c141528c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4c040098c0 tx=0x7f4c040046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 -- 172.21.15.71:0/2451197936 shutdown_connections 2024-04-20T21:19:56.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4bf406c940 0x7f4bf406ee00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c14148150 0x7f4c14146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c14162f80 0x7f4c14147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 --2- 172.21.15.71:0/2451197936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c1406e130 0x7f4c141528c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 -- 172.21.15.71:0/2451197936 >> 172.21.15.71:0/2451197936 conn(0x7f4c14072090 msgr2=0x7f4c14067770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:56.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 -- 172.21.15.71:0/2451197936 shutdown_connections 2024-04-20T21:19:56.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.252+0000 7f4c1ae00640 1 -- 172.21.15.71:0/2451197936 wait complete. 2024-04-20T21:19:56.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.253+0000 7fbb1ca00640 1 -- 172.21.15.71:0/2628335919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbaf806c9c0 msgr2=0x7fbaf806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.253+0000 7fbb1ca00640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbaf806c9c0 0x7fbaf806ee80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb08036000 tx=0x7fbb0803c040 comp rx=0 tx=0).stop 2024-04-20T21:19:56.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.253+0000 7fbb1ca00640 1 -- 172.21.15.71:0/2628335919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb180ad8e0 msgr2=0x7fbb18099b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.253+0000 7fbb1ca00640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb180ad8e0 0x7fbb18099b00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400d800 tx=0x7fbb0400dcc0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.253+0000 7f4688c00640 1 -- 172.21.15.71:0/645764232 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f467405a1d0 con 0x7f468c14a5f0 2024-04-20T21:19:56.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.253+0000 7fbb1ca00640 1 -- 172.21.15.71:0/2628335919 shutdown_connections 2024-04-20T21:19:56.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.253+0000 7fbb1ca00640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbaf806c9c0 0x7fbaf806ee80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.253+0000 7fbb1ca00640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb1815ca40 0x7fbb180cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.253+0000 7fbb1ca00640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb18156c20 0x7fbb1808d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.253+0000 7fbb1ca00640 1 --2- 172.21.15.71:0/2628335919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb180ad8e0 0x7fbb18099b00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.253+0000 7fbb1ca00640 1 -- 172.21.15.71:0/2628335919 >> 172.21.15.71:0/2628335919 conn(0x7fbb180b3350 msgr2=0x7fbb1815ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:56.255 INFO:teuthology.orchestra.run.smithi071.stdout:55834574856 2024-04-20T21:19:56.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.254+0000 7fbb1ca00640 1 -- 172.21.15.71:0/2628335919 shutdown_connections 2024-04-20T21:19:56.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.254+0000 7fbb1ca00640 1 -- 172.21.15.71:0/2628335919 wait complete. 2024-04-20T21:19:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.256+0000 7f4692e00640 1 -- 172.21.15.71:0/645764232 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f466806c970 msgr2=0x7f466806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.256+0000 7f4692e00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f466806c970 0x7f466806ee30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f467c000ff0 tx=0x7f467c009040 comp rx=0 tx=0).stop 2024-04-20T21:19:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.256+0000 7f4692e00640 1 -- 172.21.15.71:0/645764232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f468c14a5f0 msgr2=0x7f468c150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.256+0000 7f4692e00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f468c14a5f0 0x7f468c150d60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f467400e510 tx=0x7f467400e9d0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-04-20T21:19:56.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.257+0000 7f4692e00640 1 -- 172.21.15.71:0/645764232 shutdown_connections 2024-04-20T21:19:56.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.257+0000 7f4692e00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f466806c970 0x7f466806ee30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.257+0000 7f4692e00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f468c1512a0 0x7f468c0b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.257+0000 7f4692e00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f468c14a5f0 0x7f468c150d60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.257+0000 7f4692e00640 1 --2- 172.21.15.71:0/645764232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4670005210 0x7f468c1f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:56.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.257+0000 7f4692e00640 1 -- 172.21.15.71:0/645764232 >> 172.21.15.71:0/645764232 conn(0x7f468c072090 msgr2=0x7f468c159d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:56.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.258+0000 7f4692e00640 1 -- 172.21.15.71:0/645764232 shutdown_connections 2024-04-20T21:19:56.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:56.258+0000 7f4692e00640 1 -- 172.21.15.71:0/645764232 wait complete. 2024-04-20T21:19:56.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.0 2024-04-20T21:19:56.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.7 2024-04-20T21:19:56.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2024-04-20T21:19:56.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-04-20T21:19:56.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-04-20T21:19:57.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-20T21:19:57.251 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-20T21:19:57.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-20T21:19:57.267 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-20T21:19:57.271 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-20T21:19:57.278 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-20T21:19:57.280 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-20T21:19:57.281 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-20T21:19:57.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.502+0000 7f26a9600640 1 Processor -- start 2024-04-20T21:19:57.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.503+0000 7f26a9600640 1 -- start start 2024-04-20T21:19:57.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.505+0000 7f26a9600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f26a40d4270 0x7f26a40d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.506+0000 7f26a3400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f26a40d0380 0x7f26a40d07d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46374/0 (socket says 172.21.15.71:46374) 2024-04-20T21:19:57.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.507+0000 7f26a2000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f26a40d4650 0x7f26a40b1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:40306/0 (socket says 172.21.15.71:40306) 2024-04-20T21:19:57.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.507+0000 7f26a3400640 1 -- 172.21.15.71:0/81923347 learned_addr learned my addr 172.21.15.71:0/81923347 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:57.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.507+0000 7f26a9600640 1 -- 172.21.15.71:0/81923347 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a40d3820 con 0x7f26a40d0380 2024-04-20T21:19:57.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.507+0000 7f26a9600640 1 -- 172.21.15.71:0/81923347 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a40d3b00 con 0x7f26a40d4650 2024-04-20T21:19:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.507+0000 7f26a9600640 1 -- 172.21.15.71:0/81923347 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f26a40d40c0 con 0x7f26a40d4270 2024-04-20T21:19:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.507+0000 7f26a2a00640 1 --2- 172.21.15.71:0/81923347 >> v2:172.21.15.137:3300/0 conn(0x7f26a40d4270 0x7f26a40d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285491867 0 0) 0x7f26a40d3820 con 0x7f26a40d0380 2024-04-20T21:19:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2688003520 con 0x7f26a40d0380 2024-04-20T21:19:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1483522263 0 0) 0x7f26a40d3b00 con 0x7f26a40d4650 2024-04-20T21:19:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26a40d3820 con 0x7f26a40d4650 2024-04-20T21:19:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2221395469 0 0) 0x7f2688003520 con 0x7f26a40d0380 2024-04-20T21:19:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 >> v2:172.21.15.137:3300/0 conn(0x7f26a40d4270 msgr2=0x7f26a40d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 --2- 172.21.15.71:0/81923347 >> v2:172.21.15.137:3300/0 conn(0x7f26a40d4270 0x7f26a40d1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 >> v1:172.21.15.137:6789/0 conn(0x7f26a40d4650 legacy=0x7f26a40b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a40d3de0 con 0x7f26a40d0380 2024-04-20T21:19:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f269c001920 con 0x7f26a40d0380 2024-04-20T21:19:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 >> v1:172.21.15.71:6789/0 conn(0x7f26a40d0380 legacy=0x7f26a40d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 --2- 172.21.15.71:0/81923347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2688004c40 0x7f2688005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 --2- 172.21.15.71:0/81923347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26880037a0 0x7f2688003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 --2- 172.21.15.71:0/81923347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2688004280 0x7f268800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f26a40d40c0 con 0x7f26880037a0 2024-04-20T21:19:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.508+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f268800c190 con 0x7f2688004c40 2024-04-20T21:19:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.509+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f268800c390 con 0x7f2688004280 2024-04-20T21:19:57.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.509+0000 7f26a2000640 1 --2- 172.21.15.71:0/81923347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26880037a0 0x7f2688003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.509+0000 7f26a2a00640 1 --2- 172.21.15.71:0/81923347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2688004c40 0x7f2688005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.510+0000 7f26a3400640 1 --2- 172.21.15.71:0/81923347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2688004280 0x7f268800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.510+0000 7f937f200640 1 Processor -- start 2024-04-20T21:19:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.511+0000 7f26a2000640 1 -- 172.21.15.71:0/81923347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2688004280 msgr2=0x7f268800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.511+0000 7f26a2000640 1 --2- 172.21.15.71:0/81923347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2688004280 0x7f268800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.511+0000 7f26a2000640 1 -- 172.21.15.71:0/81923347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2688004c40 msgr2=0x7f2688005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.511+0000 7f26a2000640 1 --2- 172.21.15.71:0/81923347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2688004c40 0x7f2688005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.511+0000 7f26a2000640 1 -- 172.21.15.71:0/81923347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2688003520 con 0x7f26880037a0 2024-04-20T21:19:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.513+0000 7f26a3400640 1 -- 172.21.15.71:0/81923347 reap_dead start 2024-04-20T21:19:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.511+0000 7f937f200640 1 -- start start 2024-04-20T21:19:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.513+0000 7f937f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374005e80 0x7f93740062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.513+0000 7f937f200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9374006800 0x7f9374006c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.513+0000 7f937f200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9374053710 con 0x7f93740eacf0 2024-04-20T21:19:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.513+0000 7f937f200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9374054320 con 0x7f9374006800 2024-04-20T21:19:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.513+0000 7f937f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f93740539f0 con 0x7f9374005e80 2024-04-20T21:19:57.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.514+0000 7f26a2000640 1 --2- 172.21.15.71:0/81923347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26880037a0 0x7f2688003c20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f26940018c0 tx=0x7f2688005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90054c02579cc1a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.514+0000 7f937e800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9374006800 0x7f9374006c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.514+0000 7f937e800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9374006800 0x7f9374006c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44990/0 (socket says 172.21.15.71:44990) 2024-04-20T21:19:57.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.514+0000 7f937e800640 1 -- 172.21.15.71:0/2421342836 learned_addr learned my addr 172.21.15.71:0/2421342836 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.515+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694001510 con 0x7f26880037a0 2024-04-20T21:19:57.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.514+0000 7f937d400640 1 --2- 172.21.15.71:0/2421342836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374005e80 0x7f93740062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.515+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2694007270 con 0x7f26880037a0 2024-04-20T21:19:57.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.516+0000 7f937e800640 1 -- 172.21.15.71:0/2421342836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374005e80 msgr2=0x7f93740062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.516+0000 7f937e800640 1 --2- 172.21.15.71:0/2421342836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374005e80 0x7f93740062c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.516+0000 7f937e800640 1 -- 172.21.15.71:0/2421342836 >> v1:172.21.15.137:6789/0 conn(0x7f93740eacf0 legacy=0x7f937404fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.516+0000 7f26a1600640 1 -- 172.21.15.71:0/81923347 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26940047e0 con 0x7f26880037a0 2024-04-20T21:19:57.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.516+0000 7f26a9600640 1 -- 172.21.15.71:0/81923347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26880037a0 msgr2=0x7f2688003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.516+0000 7f26a9600640 1 --2- 172.21.15.71:0/81923347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26880037a0 0x7f2688003c20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f26940018c0 tx=0x7f2688005830 comp rx=0 tx=0).stop 2024-04-20T21:19:57.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.517+0000 7f26a9600640 1 -- 172.21.15.71:0/81923347 shutdown_connections 2024-04-20T21:19:57.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.517+0000 7f26a9600640 1 --2- 172.21.15.71:0/81923347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26880037a0 0x7f2688003c20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.517+0000 7f26a9600640 1 -- 172.21.15.71:0/81923347 >> 172.21.15.71:0/81923347 conn(0x7f26a40b99c0 msgr2=0x7f26a40b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:57.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.516+0000 7f937e800640 1 -- 172.21.15.71:0/2421342836 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9374053cd0 con 0x7f9374006800 2024-04-20T21:19:57.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.517+0000 7f937d400640 1 --2- 172.21.15.71:0/2421342836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374005e80 0x7f93740062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:57.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.518+0000 7f26a9600640 1 -- 172.21.15.71:0/81923347 shutdown_connections 2024-04-20T21:19:57.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.518+0000 7f26a9600640 1 -- 172.21.15.71:0/81923347 wait complete. 2024-04-20T21:19:57.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.518+0000 7f937e800640 1 --2- 172.21.15.71:0/2421342836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9374006800 0x7f9374006c90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9378065480 tx=0x7f93780a71f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10be303e29dc004 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.519+0000 7f937ca00640 1 -- 172.21.15.71:0/2421342836 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93780b4070 con 0x7f9374006800 2024-04-20T21:19:57.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.519+0000 7f937ca00640 1 -- 172.21.15.71:0/2421342836 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93780af640 con 0x7f9374006800 2024-04-20T21:19:57.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.519+0000 7f937ca00640 1 -- 172.21.15.71:0/2421342836 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93780a7e60 con 0x7f9374006800 2024-04-20T21:19:57.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.520+0000 7f937f200640 1 -- 172.21.15.71:0/2421342836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9374006800 msgr2=0x7f9374006c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.521+0000 7f937f200640 1 --2- 172.21.15.71:0/2421342836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9374006800 0x7f9374006c90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9378065480 tx=0x7f93780a71f0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.521+0000 7f937f200640 1 -- 172.21.15.71:0/2421342836 shutdown_connections 2024-04-20T21:19:57.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.521+0000 7f937f200640 1 --2- 172.21.15.71:0/2421342836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374005e80 0x7f93740062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.521+0000 7f937f200640 1 --2- 172.21.15.71:0/2421342836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9374006800 0x7f9374006c90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.522+0000 7f937f200640 1 -- 172.21.15.71:0/2421342836 >> 172.21.15.71:0/2421342836 conn(0x7f9374009fa0 msgr2=0x7f937400a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.522+0000 7f26a9600640 1 Processor -- start 2024-04-20T21:19:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.522+0000 7f26a9600640 1 -- start start 2024-04-20T21:19:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.522+0000 7f937f200640 1 -- 172.21.15.71:0/2421342836 shutdown_connections 2024-04-20T21:19:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.522+0000 7f937f200640 1 -- 172.21.15.71:0/2421342836 wait complete. 2024-04-20T21:19:57.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.524+0000 7f26a9600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26880037a0 0x7f26a40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.524+0000 7f26a9600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26a41527f0 0x7f26a4152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.524+0000 7f26a9600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a40cb920 0x7f26a40cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.524+0000 7f26a9600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f26a40d4ae0 con 0x7f26a41527f0 2024-04-20T21:19:57.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.524+0000 7f26a9600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26a40d53b0 con 0x7f26a40cb920 2024-04-20T21:19:57.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.524+0000 7f26a9600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f26a40d4c60 con 0x7f26880037a0 2024-04-20T21:19:57.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.525+0000 7f26a3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a40cb920 0x7f26a40cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.525+0000 7f26a2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26880037a0 0x7f26a40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.525+0000 7f26a2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26880037a0 0x7f26a40b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:37388/0 (socket says 172.21.15.71:37388) 2024-04-20T21:19:57.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.525+0000 7f26a2a00640 1 -- 172.21.15.71:0/2539101608 learned_addr learned my addr 172.21.15.71:0/2539101608 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.525+0000 7f26a3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a40cb920 0x7f26a40cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:42094/0 (socket says 172.21.15.71:42094) 2024-04-20T21:19:57.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.526+0000 7f26a2000640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26a41527f0 0x7f26a4152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.526+0000 7f937f200640 1 Processor -- start 2024-04-20T21:19:57.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.526+0000 7f26a2a00640 1 -- 172.21.15.71:0/2539101608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a40cb920 msgr2=0x7f26a40cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.526+0000 7f26a2a00640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a40cb920 0x7f26a40cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.526+0000 7f26a2a00640 1 -- 172.21.15.71:0/2539101608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26a41527f0 msgr2=0x7f26a4152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.526+0000 7f937f200640 1 -- start start 2024-04-20T21:19:57.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.526+0000 7f26a2a00640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26a41527f0 0x7f26a4152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.526+0000 7f26a2a00640 1 -- 172.21.15.71:0/2539101608 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a41531b0 con 0x7f26880037a0 2024-04-20T21:19:57.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.526+0000 7f26a2000640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26a41527f0 0x7f26a4152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:57.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.527+0000 7f26a3400640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a40cb920 0x7f26a40cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:19:57.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.528+0000 7f26a2a00640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26880037a0 0x7f26a40b58a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f269000b7f0 tx=0x7f269000bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.528+0000 7f937f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9374005e80 0x7f93740db5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.528+0000 7f269aa00640 1 -- 172.21.15.71:0/2539101608 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690018070 con 0x7f26880037a0 2024-04-20T21:19:57.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.528+0000 7f269aa00640 1 -- 172.21.15.71:0/2539101608 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2690010830 con 0x7f26880037a0 2024-04-20T21:19:57.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.528+0000 7f269aa00640 1 -- 172.21.15.71:0/2539101608 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690018070 con 0x7f26880037a0 2024-04-20T21:19:57.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.529+0000 7f937f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374006800 0x7f93740dd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.529+0000 7f26a9600640 1 -- 172.21.15.71:0/2539101608 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a40cc6c0 con 0x7f26880037a0 2024-04-20T21:19:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.529+0000 7f937f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93740eacf0 0x7f937404dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.529+0000 7f26a9600640 1 -- 172.21.15.71:0/2539101608 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a40ccc80 con 0x7f26880037a0 2024-04-20T21:19:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.529+0000 7f937f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93740547b0 con 0x7f93740eacf0 2024-04-20T21:19:57.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.529+0000 7f937f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9374050190 con 0x7f9374005e80 2024-04-20T21:19:57.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.529+0000 7f937f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9374054930 con 0x7f9374006800 2024-04-20T21:19:57.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.529+0000 7f937d400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374006800 0x7f93740dd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.530+0000 7f937d400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374006800 0x7f93740dd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:37404/0 (socket says 172.21.15.71:37404) 2024-04-20T21:19:57.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.530+0000 7f937d400640 1 -- 172.21.15.71:0/1509740090 learned_addr learned my addr 172.21.15.71:0/1509740090 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.530+0000 7f937de00640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9374005e80 0x7f93740db5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.530+0000 7f937e800640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93740eacf0 0x7f937404dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.531+0000 7f937e800640 1 -- 172.21.15.71:0/1509740090 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374006800 msgr2=0x7f93740dd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.531+0000 7f937e800640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374006800 0x7f93740dd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.531+0000 7f937e800640 1 -- 172.21.15.71:0/1509740090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9374005e80 msgr2=0x7f93740db5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.531+0000 7f937e800640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9374005e80 0x7f93740db5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.531+0000 7f937e800640 1 -- 172.21.15.71:0/1509740090 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937404b410 con 0x7f93740eacf0 2024-04-20T21:19:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.531+0000 7f937e800640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93740eacf0 0x7f937404dd10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f937807ab10 tx=0x7f937806b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.532+0000 7f9372000640 1 -- 172.21.15.71:0/1509740090 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93780bd020 con 0x7f93740eacf0 2024-04-20T21:19:57.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.532+0000 7f937f200640 1 -- 172.21.15.71:0/1509740090 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93740d88c0 con 0x7f93740eacf0 2024-04-20T21:19:57.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.532+0000 7f9372000640 1 -- 172.21.15.71:0/1509740090 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93780b5040 con 0x7f93740eacf0 2024-04-20T21:19:57.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.532+0000 7f9372000640 1 -- 172.21.15.71:0/1509740090 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93780b4070 con 0x7f93740eacf0 2024-04-20T21:19:57.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.534+0000 7f937f200640 1 -- 172.21.15.71:0/1509740090 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93740d8b60 con 0x7f93740eacf0 2024-04-20T21:19:57.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.535+0000 7f26a9600640 1 -- 172.21.15.71:0/2539101608 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26a4068980 con 0x7f26880037a0 2024-04-20T21:19:57.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.535+0000 7f937f200640 1 -- 172.21.15.71:0/1509740090 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9374005380 con 0x7f93740eacf0 2024-04-20T21:19:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.536+0000 7f269aa00640 1 -- 172.21.15.71:0/2539101608 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f269001b070 con 0x7f26880037a0 2024-04-20T21:19:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.537+0000 7f269aa00640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f268406caf0 0x7f268406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.538+0000 7f269aa00640 1 -- 172.21.15.71:0/2539101608 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f269008c0a0 con 0x7f26880037a0 2024-04-20T21:19:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.537+0000 7f9372000640 1 -- 172.21.15.71:0/1509740090 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93780c0020 con 0x7f93740eacf0 2024-04-20T21:19:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.539+0000 7f26a2000640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f268406caf0 0x7f268406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.541+0000 7f26a2000640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f268406caf0 0x7f268406efb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2694034000 tx=0x7f2694007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.539+0000 7f9372000640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f935c06c8f0 0x7f935c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.542+0000 7f937de00640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f935c06c8f0 0x7f935c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.543+0000 7f937de00640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f935c06c8f0 0x7f935c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9368000f60 tx=0x7f9368009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.547+0000 7f9372000640 1 -- 172.21.15.71:0/1509740090 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f93780f4790 con 0x7f93740eacf0 2024-04-20T21:19:57.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.549+0000 7f9372000640 1 -- 172.21.15.71:0/1509740090 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f93780c7070 con 0x7f93740eacf0 2024-04-20T21:19:57.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.554+0000 7f269aa00640 1 -- 172.21.15.71:0/2539101608 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f269005a200 con 0x7f26880037a0 2024-04-20T21:19:57.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.577+0000 7f1b79000640 1 Processor -- start 2024-04-20T21:19:57.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.578+0000 7f1b79000640 1 -- start start 2024-04-20T21:19:57.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.579+0000 7f4d33800640 1 Processor -- start 2024-04-20T21:19:57.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.579+0000 7f4d33800640 1 -- start start 2024-04-20T21:19:57.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.580+0000 7f1b79000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1b740b3bf0 0x7f1b740ad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.580+0000 7f1b79000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1b7406e510 0x7f1b7415a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.580+0000 7f1b79000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b740adaf0 con 0x7f1b7406bdd0 2024-04-20T21:19:57.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.580+0000 7f1b79000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1b740addd0 con 0x7f1b740b3bf0 2024-04-20T21:19:57.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.580+0000 7f1b79000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1b740ae0b0 con 0x7f1b7406e510 2024-04-20T21:19:57.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.581+0000 7f4d33800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4d2c0ceff0 0x7f4d2c159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.581+0000 7f4d33800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d2c0cf3d0 0x7f4d2c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.581+0000 7f4d33800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c15cc20 0x7f4d2c15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.581+0000 7f4d33800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4d2c15d950 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.581+0000 7f4d33800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4d2c0d0480 con 0x7f4d2c0cf3d0 2024-04-20T21:19:57.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.581+0000 7f4d33800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2c0d0760 con 0x7f4d2c15cc20 2024-04-20T21:19:57.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.582+0000 7f1b71e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1b740b3bf0 0x7f1b740ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.582+0000 7f1b71e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1b740b3bf0 0x7f1b740ad210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45022/0 (socket says 172.21.15.71:45022) 2024-04-20T21:19:57.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.582+0000 7f1b71e00640 1 -- 172.21.15.71:0/1698320616 learned_addr learned my addr 172.21.15.71:0/1698320616 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.582+0000 7f4d30e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4d2c0ceff0 0x7f4d2c159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.582+0000 7f4d30e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4d2c0ceff0 0x7f4d2c159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45024/0 (socket says 172.21.15.71:45024) 2024-04-20T21:19:57.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.582+0000 7f4d30e00640 1 -- 172.21.15.71:0/1327599962 learned_addr learned my addr 172.21.15.71:0/1327599962 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.582+0000 7f4d31800640 1 --2- 172.21.15.71:0/1327599962 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c15cc20 0x7f4d2c15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.583+0000 7f4d30e00640 1 -- 172.21.15.71:0/1327599962 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c15cc20 msgr2=0x7f4d2c15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.583+0000 7f4d30e00640 1 --2- 172.21.15.71:0/1327599962 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c15cc20 0x7f4d2c15d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.583+0000 7f4d30e00640 1 -- 172.21.15.71:0/1327599962 >> v2:172.21.15.137:3300/0 conn(0x7f4d2c0cf3d0 msgr2=0x7f4d2c15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.583+0000 7f4d2be00640 1 --2- 172.21.15.71:0/1327599962 >> v2:172.21.15.137:3300/0 conn(0x7f4d2c0cf3d0 0x7f4d2c15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.583+0000 7f1b71e00640 1 -- 172.21.15.71:0/1698320616 >> v2:172.21.15.137:3300/0 conn(0x7f1b7406e510 msgr2=0x7f1b7415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.583+0000 7f1b71e00640 1 --2- 172.21.15.71:0/1698320616 >> v2:172.21.15.137:3300/0 conn(0x7f1b7406e510 0x7f1b7415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.584+0000 7f1b71e00640 1 -- 172.21.15.71:0/1698320616 >> v1:172.21.15.71:6789/0 conn(0x7f1b7406bdd0 legacy=0x7f1b7406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.583+0000 7f4d30e00640 1 --2- 172.21.15.71:0/1327599962 >> v2:172.21.15.137:3300/0 conn(0x7f4d2c0cf3d0 0x7f4d2c15a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.583+0000 7f4d30e00640 1 -- 172.21.15.71:0/1327599962 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2c0d0a40 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.584+0000 7f4d2be00640 1 --2- 172.21.15.71:0/1327599962 >> v2:172.21.15.137:3300/0 conn(0x7f4d2c0cf3d0 0x7f4d2c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:57.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.584+0000 7f1b71e00640 1 -- 172.21.15.71:0/1698320616 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b740ae390 con 0x7f1b740b3bf0 2024-04-20T21:19:57.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.585+0000 7f4d30e00640 1 --2- 172.21.15.71:0/1327599962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d2c0ceff0 0x7f4d2c159c30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0b3f10 tx=0x7f4d2002b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70de6b307126898a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.586+0000 7f4d2b400640 1 -- 172.21.15.71:0/1327599962 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20034070 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.586+0000 7f4d2b400640 1 -- 172.21.15.71:0/1327599962 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d20030800 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.586+0000 7f4d2b400640 1 -- 172.21.15.71:0/1327599962 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20034070 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.586+0000 7f1b71e00640 1 --2- 172.21.15.71:0/1698320616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b740b3bf0 0x7f1b740ad210 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b740cc830 tx=0x7f1b6402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad80731ae23c95d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.586+0000 7f1b71400640 1 -- 172.21.15.71:0/1698320616 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64037070 con 0x7f1b740b3bf0 2024-04-20T21:19:57.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.587+0000 7f1b71400640 1 -- 172.21.15.71:0/1698320616 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b64004230 con 0x7f1b740b3bf0 2024-04-20T21:19:57.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.587+0000 7f1b71400640 1 -- 172.21.15.71:0/1698320616 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64037070 con 0x7f1b740b3bf0 2024-04-20T21:19:57.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.587+0000 7f4d33800640 1 -- 172.21.15.71:0/1327599962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d2c0ceff0 msgr2=0x7f4d2c159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.587+0000 7f4d33800640 1 --2- 172.21.15.71:0/1327599962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d2c0ceff0 0x7f4d2c159c30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0b3f10 tx=0x7f4d2002b940 comp rx=0 tx=0).stop 2024-04-20T21:19:57.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.587+0000 7f4d33800640 1 -- 172.21.15.71:0/1327599962 shutdown_connections 2024-04-20T21:19:57.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.587+0000 7f4d33800640 1 --2- 172.21.15.71:0/1327599962 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c15cc20 0x7f4d2c15d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.587+0000 7f4d33800640 1 --2- 172.21.15.71:0/1327599962 >> v2:172.21.15.137:3300/0 conn(0x7f4d2c0cf3d0 0x7f4d2c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.587+0000 7f4d33800640 1 --2- 172.21.15.71:0/1327599962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d2c0ceff0 0x7f4d2c159c30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.587+0000 7f4d33800640 1 -- 172.21.15.71:0/1327599962 >> 172.21.15.71:0/1327599962 conn(0x7f4d2c071800 msgr2=0x7f4d2c071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.587+0000 7f1b79000640 1 -- 172.21.15.71:0/1698320616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b740b3bf0 msgr2=0x7f1b740ad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.587+0000 7f1b79000640 1 --2- 172.21.15.71:0/1698320616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b740b3bf0 0x7f1b740ad210 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b740cc830 tx=0x7f1b6402b7e0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.588+0000 7f4467e00640 1 Processor -- start 2024-04-20T21:19:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.588+0000 7f4467e00640 1 -- start start 2024-04-20T21:19:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.588+0000 7f1b79000640 1 -- 172.21.15.71:0/1698320616 shutdown_connections 2024-04-20T21:19:57.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.588+0000 7f1b79000640 1 --2- 172.21.15.71:0/1698320616 >> v2:172.21.15.137:3300/0 conn(0x7f1b7406e510 0x7f1b7415a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.588+0000 7f1b79000640 1 --2- 172.21.15.71:0/1698320616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b740b3bf0 0x7f1b740ad210 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.588+0000 7f1b79000640 1 -- 172.21.15.71:0/1698320616 >> 172.21.15.71:0/1698320616 conn(0x7f1b74072090 msgr2=0x7f1b740b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:57.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.589+0000 7f4d33800640 1 -- 172.21.15.71:0/1327599962 shutdown_connections 2024-04-20T21:19:57.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.589+0000 7f4d33800640 1 -- 172.21.15.71:0/1327599962 wait complete. 2024-04-20T21:19:57.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.589+0000 7f1b79000640 1 -- 172.21.15.71:0/1698320616 shutdown_connections 2024-04-20T21:19:57.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.589+0000 7f1b79000640 1 -- 172.21.15.71:0/1698320616 wait complete. 2024-04-20T21:19:57.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.590+0000 7fe929e00640 1 Processor -- start 2024-04-20T21:19:57.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.590+0000 7f4467e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4468161d50 0x7f44680d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.590+0000 7fe929e00640 1 -- start start 2024-04-20T21:19:57.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.590+0000 7f4467e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44680b3330 0x7f44680b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.590+0000 7f4467e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f446806c190 con 0x7f446806c6d0 2024-04-20T21:19:57.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.590+0000 7f4467e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4468162130 con 0x7f4468161d50 2024-04-20T21:19:57.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.590+0000 7f4467e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f446806c470 con 0x7f44680b3330 2024-04-20T21:19:57.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.591+0000 7f1b79000640 1 Processor -- start 2024-04-20T21:19:57.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.591+0000 7f445e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44680b3330 0x7f44680b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.591+0000 7f4467400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f446806c6d0 0x7f44680cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46394/0 (socket says 172.21.15.71:46394) 2024-04-20T21:19:57.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.591+0000 7f4467400640 1 -- 172.21.15.71:0/2122522202 learned_addr learned my addr 172.21.15.71:0/2122522202 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:57.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.591+0000 7f4d33800640 1 Processor -- start 2024-04-20T21:19:57.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.591+0000 7f1b79000640 1 -- start start 2024-04-20T21:19:57.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.592+0000 7f4466a00640 1 --2- 172.21.15.71:0/2122522202 >> v2:172.21.15.137:3300/0 conn(0x7f4468161d50 0x7f44680d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.592+0000 7f5d08a00640 1 Processor -- start 2024-04-20T21:19:57.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.591+0000 7f4d33800640 1 -- start start 2024-04-20T21:19:57.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.592+0000 7f4466000640 1 -- 172.21.15.71:0/2122522202 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199079047 0 0) 0x7f446806c190 con 0x7f446806c6d0 2024-04-20T21:19:57.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.592+0000 7f4466000640 1 -- 172.21.15.71:0/2122522202 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f444c003520 con 0x7f446806c6d0 2024-04-20T21:19:57.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f1b79000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7406bdd0 0x7f1b7409a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f1b79000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b7406e510 0x7f1b7409a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f1b79000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b740b3bf0 0x7f1b74140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f1b79000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7415ac20 con 0x7f1b7406e510 2024-04-20T21:19:57.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f1b79000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7415aaa0 con 0x7f1b7406bdd0 2024-04-20T21:19:57.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f1b79000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7415ada0 con 0x7f1b740b3bf0 2024-04-20T21:19:57.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f4d33800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c0ceff0 0x7f4d2c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f4d33800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d2c0cf3d0 0x7f4d2c149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f1b6be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b7406e510 0x7f1b7409a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f4d33800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d2c15cc20 0x7f4d2c149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f4d33800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c1602b0 con 0x7f4d2c0cf3d0 2024-04-20T21:19:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.592+0000 7f445e000640 1 -- 172.21.15.71:0/2122522202 >> v2:172.21.15.137:3300/0 conn(0x7f4468161d50 msgr2=0x7f44680d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.592+0000 7f445e000640 1 --2- 172.21.15.71:0/2122522202 >> v2:172.21.15.137:3300/0 conn(0x7f4468161d50 0x7f44680d38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.592+0000 7f445e000640 1 -- 172.21.15.71:0/2122522202 >> v1:172.21.15.71:6789/0 conn(0x7f446806c6d0 legacy=0x7f44680cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.592+0000 7f445e000640 1 -- 172.21.15.71:0/2122522202 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44680d2e00 con 0x7f44680b3330 2024-04-20T21:19:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.592+0000 7f5d08a00640 1 -- start start 2024-04-20T21:19:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f5d08a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5d040d1a00 0x7f5d040b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f5d08a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5d040b17d0 0x7f5d040d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f5d08a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d040d1e90 con 0x7f5d040d4270 2024-04-20T21:19:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f5d08a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5d040d40c0 con 0x7f5d040d1a00 2024-04-20T21:19:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f5d08a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5d040d3820 con 0x7f5d040b17d0 2024-04-20T21:19:57.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f4d33800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c160130 con 0x7f4d2c15cc20 2024-04-20T21:19:57.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.593+0000 7f4d33800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2c160430 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7fe929e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9240d4380 0x7fe9240d4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7fe929e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe9241621d0 0x7fe924162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7fe929e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9240cf950 con 0x7fe92415e550 2024-04-20T21:19:57.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f1b71e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7406bdd0 0x7f1b7409a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f1b72800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b740b3bf0 0x7f1b74140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f1b72800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b740b3bf0 0x7f1b74140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:37434/0 (socket says 172.21.15.71:37434) 2024-04-20T21:19:57.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f1b72800640 1 -- 172.21.15.71:0/1071124267 learned_addr learned my addr 172.21.15.71:0/1071124267 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7fe929e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe924162e90 con 0x7fe9241621d0 2024-04-20T21:19:57.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7fe929e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe9240cfbf0 con 0x7fe9240d4380 2024-04-20T21:19:57.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f4d30e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c0ceff0 0x7f4d2c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f4d30e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c0ceff0 0x7f4d2c15bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:37450/0 (socket says 172.21.15.71:37450) 2024-04-20T21:19:57.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.594+0000 7f4d30e00640 1 -- 172.21.15.71:0/3317731511 learned_addr learned my addr 172.21.15.71:0/3317731511 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f445e000640 1 --2- 172.21.15.71:0/2122522202 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44680b3330 0x7f44680b3880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44580097a0 tx=0x7f445802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a38190b29081e001 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f1b71e00640 1 -- 172.21.15.71:0/1071124267 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b740b3bf0 msgr2=0x7f1b74140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f1b71e00640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b740b3bf0 0x7f1b74140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f1b71e00640 1 -- 172.21.15.71:0/1071124267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b7406e510 msgr2=0x7f1b7409a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f1b71e00640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b7406e510 0x7f1b7409a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f1b71e00640 1 -- 172.21.15.71:0/1071124267 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7409c180 con 0x7f1b7406bdd0 2024-04-20T21:19:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f5d01400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5d040d1a00 0x7f5d040b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f5d01400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5d040d1a00 0x7f5d040b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45058/0 (socket says 172.21.15.71:45058) 2024-04-20T21:19:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f5d01400640 1 -- 172.21.15.71:0/2286826863 learned_addr learned my addr 172.21.15.71:0/2286826863 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f4466000640 1 -- 172.21.15.71:0/2122522202 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458035020 con 0x7f44680b3330 2024-04-20T21:19:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f4466000640 1 -- 172.21.15.71:0/2122522202 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4458031640 con 0x7f44680b3330 2024-04-20T21:19:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f4466000640 1 -- 172.21.15.71:0/2122522202 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445802d040 con 0x7f44680b3330 2024-04-20T21:19:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f4d30e00640 1 -- 172.21.15.71:0/3317731511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d2c15cc20 msgr2=0x7f4d2c149890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T21:19:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f4d30e00640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d2c15cc20 0x7f4d2c149890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f4d30e00640 1 -- 172.21.15.71:0/3317731511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d2c0cf3d0 msgr2=0x7f4d2c149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f4d30e00640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d2c0cf3d0 0x7f4d2c149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f4d30e00640 1 -- 172.21.15.71:0/3317731511 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2c1fc3f0 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7fe928a00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe92415e550 0x7fe9240d06b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46406/0 (socket says 172.21.15.71:46406) 2024-04-20T21:19:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7fe928a00640 1 -- 172.21.15.71:0/501803482 learned_addr learned my addr 172.21.15.71:0/501803482 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:57.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.596+0000 7f4d30e00640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c0ceff0 0x7f4d2c15bf00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4d20009960 tx=0x7f4d200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.596+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1142585481 0 0) 0x7fe9240cf950 con 0x7fe92415e550 2024-04-20T21:19:57.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.596+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe90c003520 con 0x7fe92415e550 2024-04-20T21:19:57.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.595+0000 7f5d02800640 1 --2- 172.21.15.71:0/2286826863 >> v2:172.21.15.137:3300/0 conn(0x7f5d040b17d0 0x7f5d040d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.596+0000 7f5d01400640 1 -- 172.21.15.71:0/2286826863 >> v2:172.21.15.137:3300/0 conn(0x7f5d040b17d0 msgr2=0x7f5d040d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.596+0000 7fe923e00640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9240d4380 0x7fe9240d4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.596+0000 7fe929400640 1 --2- 172.21.15.71:0/501803482 >> v2:172.21.15.137:3300/0 conn(0x7fe9241621d0 0x7fe924162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.596+0000 7f5d01400640 1 --2- 172.21.15.71:0/2286826863 >> v2:172.21.15.137:3300/0 conn(0x7f5d040b17d0 0x7f5d040d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7f5d01400640 1 -- 172.21.15.71:0/2286826863 >> v1:172.21.15.71:6789/0 conn(0x7f5d040d4270 legacy=0x7f5d040d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.596+0000 7f1b71e00640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7406bdd0 0x7f1b7409a160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b64004000 tx=0x7f1b640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7f4d28c00640 1 -- 172.21.15.71:0/3317731511 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20047070 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7f4d28c00640 1 -- 172.21.15.71:0/3317731511 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d20030600 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7f4d28c00640 1 -- 172.21.15.71:0/3317731511 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20034040 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1071701710 0 0) 0x7fe90c003520 con 0x7fe92415e550 2024-04-20T21:19:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7f4d33800640 1 -- 172.21.15.71:0/3317731511 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d2c1fc6d0 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7f4d33800640 1 -- 172.21.15.71:0/3317731511 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d2c1fcc90 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9240d4380 msgr2=0x7fe9240d4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9240d4380 0x7fe9240d4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 >> v2:172.21.15.137:3300/0 conn(0x7fe9241621d0 msgr2=0x7fe924162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 --2- 172.21.15.71:0/501803482 >> v2:172.21.15.137:3300/0 conn(0x7fe9241621d0 0x7fe924162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9240cfed0 con 0x7fe92415e550 2024-04-20T21:19:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fe918001670 con 0x7fe92415e550 2024-04-20T21:19:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 >> v1:172.21.15.71:6789/0 conn(0x7fe92415e550 legacy=0x7fe9240d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90c0039b0 0x7fe90c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe90c004800 0x7fe90c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe90c0051c0 0x7fe90c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe924162e90 con 0x7fe90c004800 2024-04-20T21:19:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe9240cfbf0 con 0x7fe90c0039b0 2024-04-20T21:19:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe90c00c090 con 0x7fe90c0051c0 2024-04-20T21:19:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7f1b6a000640 1 -- 172.21.15.71:0/1071124267 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64042070 con 0x7f1b7406bdd0 2024-04-20T21:19:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7f1b6a000640 1 -- 172.21.15.71:0/1071124267 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b64030710 con 0x7f1b7406bdd0 2024-04-20T21:19:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7f1b6a000640 1 -- 172.21.15.71:0/1071124267 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64037040 con 0x7f1b7406bdd0 2024-04-20T21:19:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7f5d01400640 1 -- 172.21.15.71:0/2286826863 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d040d3b00 con 0x7f5d040d1a00 2024-04-20T21:19:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.597+0000 7fe923e00640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe90c004800 0x7fe90c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.598+0000 7f4467e00640 1 -- 172.21.15.71:0/2122522202 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44680b3330 msgr2=0x7f44680b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.598+0000 7fe928a00640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90c0039b0 0x7fe90c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.598+0000 7f5d02800640 1 --2- 172.21.15.71:0/2286826863 >> v2:172.21.15.137:3300/0 conn(0x7f5d040b17d0 0x7f5d040d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:19:57.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.598+0000 7fe929400640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe90c0051c0 0x7fe90c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.598+0000 7fe923e00640 1 -- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe90c0051c0 msgr2=0x7fe90c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.598+0000 7fe923e00640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe90c0051c0 0x7fe90c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.598+0000 7fe923e00640 1 -- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90c0039b0 msgr2=0x7fe90c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.598+0000 7fe923e00640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90c0039b0 0x7fe90c003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.598+0000 7fe923e00640 1 -- 172.21.15.71:0/501803482 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9240cfed0 con 0x7fe90c004800 2024-04-20T21:19:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.598+0000 7fe929400640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe90c0051c0 0x7fe90c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.599+0000 7f4467e00640 1 --2- 172.21.15.71:0/2122522202 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44680b3330 0x7f44680b3880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44580097a0 tx=0x7f445802b8f0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.599+0000 7f4d33800640 1 -- 172.21.15.71:0/3317731511 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d2c068980 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.599+0000 7f4467e00640 1 -- 172.21.15.71:0/2122522202 shutdown_connections 2024-04-20T21:19:57.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.599+0000 7f4467e00640 1 --2- 172.21.15.71:0/2122522202 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44680b3330 0x7f44680b3880 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.599+0000 7f4467e00640 1 --2- 172.21.15.71:0/2122522202 >> v2:172.21.15.137:3300/0 conn(0x7f4468161d50 0x7f44680d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.599+0000 7f4467e00640 1 -- 172.21.15.71:0/2122522202 >> 172.21.15.71:0/2122522202 conn(0x7f44680d4450 msgr2=0x7f44680d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:57.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.599+0000 7f1b79000640 1 -- 172.21.15.71:0/1071124267 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b74141ca0 con 0x7f1b7406bdd0 2024-04-20T21:19:57.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.599+0000 7f1b79000640 1 -- 172.21.15.71:0/1071124267 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7409c6d0 con 0x7f1b7406bdd0 2024-04-20T21:19:57.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.600+0000 7f5d01400640 1 --2- 172.21.15.71:0/2286826863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d040d1a00 0x7f5d040b1290 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5d04068550 tx=0x7f5cf002b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516f6063888769b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.599+0000 7f4467e00640 1 -- 172.21.15.71:0/2122522202 shutdown_connections 2024-04-20T21:19:57.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.600+0000 7f4467e00640 1 -- 172.21.15.71:0/2122522202 wait complete. 2024-04-20T21:19:57.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.600+0000 7f1b79000640 1 -- 172.21.15.71:0/1071124267 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b74068980 con 0x7f1b7406bdd0 2024-04-20T21:19:57.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.602+0000 7f4467e00640 1 Processor -- start 2024-04-20T21:19:57.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.602+0000 7f4467e00640 1 -- start start 2024-04-20T21:19:57.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.602+0000 7f4d28c00640 1 -- 172.21.15.71:0/3317731511 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d2004a070 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.601+0000 7f5d00a00640 1 -- 172.21.15.71:0/2286826863 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0034070 con 0x7f5d040d1a00 2024-04-20T21:19:57.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.601+0000 7f5d00a00640 1 -- 172.21.15.71:0/2286826863 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf0030870 con 0x7f5d040d1a00 2024-04-20T21:19:57.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.601+0000 7f5d00a00640 1 -- 172.21.15.71:0/2286826863 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0030c40 con 0x7f5d040d1a00 2024-04-20T21:19:57.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.602+0000 7f5d08a00640 1 -- 172.21.15.71:0/2286826863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d040d1a00 msgr2=0x7f5d040b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.602+0000 7f5d08a00640 1 --2- 172.21.15.71:0/2286826863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d040d1a00 0x7f5d040b1290 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5d04068550 tx=0x7f5cf002b9b0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.600+0000 7fe923e00640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe90c004800 0x7fe90c004c80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe91000b910 tx=0x7fe90c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2137c6ff2520c3a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.601+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91003a070 con 0x7fe90c004800 2024-04-20T21:19:57.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.601+0000 7fe923400640 1 -- 172.21.15.71:0/501803482 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe910035670 con 0x7fe90c004800 2024-04-20T21:19:57.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.602+0000 7fe929e00640 1 -- 172.21.15.71:0/501803482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe90c004800 msgr2=0x7fe90c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.602+0000 7fe929e00640 1 --2- 172.21.15.71:0/501803482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe90c004800 0x7fe90c004c80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe91000b910 tx=0x7fe90c005830 comp rx=0 tx=0).stop 2024-04-20T21:19:57.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.602+0000 7fe929400640 1 -- 172.21.15.71:0/501803482 reap_dead start 2024-04-20T21:19:57.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.602+0000 7fe929e00640 1 -- 172.21.15.71:0/501803482 shutdown_connections 2024-04-20T21:19:57.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.602+0000 7fe929e00640 1 -- 172.21.15.71:0/501803482 >> 172.21.15.71:0/501803482 conn(0x7fe92408bf80 msgr2=0x7fe92409d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:57.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.601+0000 7f5ac0600640 1 Processor -- start 2024-04-20T21:19:57.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.601+0000 7f5ac0600640 1 -- start start 2024-04-20T21:19:57.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f5ac0600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ab815a7d0 0x7f5ab80ad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f5d08a00640 1 -- 172.21.15.71:0/2286826863 shutdown_connections 2024-04-20T21:19:57.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f5d08a00640 1 --2- 172.21.15.71:0/2286826863 >> v2:172.21.15.137:3300/0 conn(0x7f5d040b17d0 0x7f5d040d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f5d08a00640 1 --2- 172.21.15.71:0/2286826863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d040d1a00 0x7f5d040b1290 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f5ac0600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5ab806bdd0 0x7f5ab815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f5ac0600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab815b0f0 con 0x7f5ab80b3bf0 2024-04-20T21:19:57.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f5ac0600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab80ad810 con 0x7f5ab815a7d0 2024-04-20T21:19:57.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f5ac0600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab80adaf0 con 0x7f5ab806bdd0 2024-04-20T21:19:57.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f5abdc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ab815a7d0 0x7f5ab80ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f4d28c00640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4d0c06c920 0x7f4d0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f4d28c00640 1 -- 172.21.15.71:0/3317731511 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4d200adcc0 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7fe929e00640 1 -- 172.21.15.71:0/501803482 shutdown_connections 2024-04-20T21:19:57.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f4d2be00640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4d0c06c920 0x7f4d0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.603+0000 7f5d08a00640 1 -- 172.21.15.71:0/2286826863 >> 172.21.15.71:0/2286826863 conn(0x7f5d040b99c0 msgr2=0x7f5d040b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:57.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7fe929e00640 1 -- 172.21.15.71:0/501803482 wait complete. 2024-04-20T21:19:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f5abdc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ab815a7d0 0x7f5ab80ad210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45080/0 (socket says 172.21.15.71:45080) 2024-04-20T21:19:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f5abdc00640 1 -- 172.21.15.71:0/1525035296 learned_addr learned my addr 172.21.15.71:0/1525035296 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f1b6a000640 1 -- 172.21.15.71:0/1071124267 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b64045070 con 0x7f1b7406bdd0 2024-04-20T21:19:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f5abd200640 1 --2- 172.21.15.71:0/1525035296 >> v2:172.21.15.137:3300/0 conn(0x7f5ab806bdd0 0x7f5ab815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f5abdc00640 1 -- 172.21.15.71:0/1525035296 >> v2:172.21.15.137:3300/0 conn(0x7f5ab806bdd0 msgr2=0x7f5ab815abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f5abdc00640 1 --2- 172.21.15.71:0/1525035296 >> v2:172.21.15.137:3300/0 conn(0x7f5ab806bdd0 0x7f5ab815abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f5abdc00640 1 -- 172.21.15.71:0/1525035296 >> v1:172.21.15.137:6789/0 conn(0x7f5ab80b3bf0 legacy=0x7f5ab8072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f5abdc00640 1 -- 172.21.15.71:0/1525035296 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab80addd0 con 0x7f5ab815a7d0 2024-04-20T21:19:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.605+0000 7f5d08a00640 1 -- 172.21.15.71:0/2286826863 shutdown_connections 2024-04-20T21:19:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.605+0000 7f5d08a00640 1 -- 172.21.15.71:0/2286826863 wait complete. 2024-04-20T21:19:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f4467e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f446806c6d0 0x7f44681f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f4467e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44680b3330 0x7f44680cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f4467e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4468161d50 0x7f44680cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f4467e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f446806cb60 con 0x7f4468161d50 2024-04-20T21:19:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f4467e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f44680d33c0 con 0x7f446806c6d0 2024-04-20T21:19:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.604+0000 7f4467e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f446806cce0 con 0x7f44680b3330 2024-04-20T21:19:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.605+0000 7f4467400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4468161d50 0x7f44680cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.605+0000 7f4466a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f446806c6d0 0x7f44681f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.605+0000 7f4466a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f446806c6d0 0x7f44681f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:42190/0 (socket says 172.21.15.71:42190) 2024-04-20T21:19:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.605+0000 7f4466a00640 1 -- 172.21.15.71:0/1567334259 learned_addr learned my addr 172.21.15.71:0/1567334259 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.606+0000 7f445e000640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44680b3330 0x7f44680cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.605+0000 7f4d2be00640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4d0c06c920 0x7f4d0c06ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d18006fd0 tx=0x7f4d18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.606+0000 7f4467400640 1 -- 172.21.15.71:0/1567334259 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44680b3330 msgr2=0x7f44680cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.606+0000 7f4467400640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44680b3330 0x7f44680cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.606+0000 7f4467400640 1 -- 172.21.15.71:0/1567334259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f446806c6d0 msgr2=0x7f44681f8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.606+0000 7f4467400640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f446806c6d0 0x7f44681f8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.606+0000 7f4467400640 1 -- 172.21.15.71:0/1567334259 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44680732f0 con 0x7f4468161d50 2024-04-20T21:19:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.606+0000 7f5abdc00640 1 --2- 172.21.15.71:0/1525035296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab815a7d0 0x7f5ab80ad210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80b1d00 tx=0x7f5aac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3dc63ebc515f0f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.606+0000 7fe929e00640 1 Processor -- start 2024-04-20T21:19:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7f1b6a000640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1b5006c970 0x7f1b5006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7f4467400640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4468161d50 0x7f44680cc850 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f446000caa0 tx=0x7f446000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7fe929e00640 1 -- start start 2024-04-20T21:19:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7f5ab7e00640 1 -- 172.21.15.71:0/1525035296 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac02ca80 con 0x7f5ab815a7d0 2024-04-20T21:19:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7f5ab7e00640 1 -- 172.21.15.71:0/1525035296 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aac02cc20 con 0x7f5ab815a7d0 2024-04-20T21:19:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7f5ab7e00640 1 -- 172.21.15.71:0/1525035296 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac0343f0 con 0x7f5ab815a7d0 2024-04-20T21:19:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7f445f400640 1 -- 172.21.15.71:0/1567334259 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460017070 con 0x7f4468161d50 2024-04-20T21:19:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7f445f400640 1 -- 172.21.15.71:0/1567334259 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446000aba0 con 0x7f4468161d50 2024-04-20T21:19:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7f445f400640 1 -- 172.21.15.71:0/1567334259 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460012400 con 0x7f4468161d50 2024-04-20T21:19:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7f5d08a00640 1 Processor -- start 2024-04-20T21:19:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.608+0000 7f5d08a00640 1 -- start start 2024-04-20T21:19:57.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7f4467e00640 1 -- 172.21.15.71:0/1567334259 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4468072d30 con 0x7f4468161d50 2024-04-20T21:19:57.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.608+0000 7f4467e00640 1 -- 172.21.15.71:0/1567334259 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44681f8750 con 0x7f4468161d50 2024-04-20T21:19:57.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.607+0000 7f1b6a000640 1 -- 172.21.15.71:0/1071124267 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1b640ae100 con 0x7f1b7406bdd0 2024-04-20T21:19:57.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.609+0000 7f1b6be00640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1b5006c970 0x7f1b5006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.609+0000 7f5d08a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d040b17d0 0x7f5d040ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.609+0000 7f5d08a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5d040d1a00 0x7f5d041f8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.609+0000 7f5d08a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d040d4270 0x7f5d041f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.609+0000 7f5d08a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5d040d53b0 con 0x7f5d040d4270 2024-04-20T21:19:57.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.609+0000 7f5d08a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d040cfe60 con 0x7f5d040b17d0 2024-04-20T21:19:57.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5ac0600640 1 -- 172.21.15.71:0/1525035296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab815a7d0 msgr2=0x7f5ab80ad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5ac0600640 1 --2- 172.21.15.71:0/1525035296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab815a7d0 0x7f5ab80ad210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80b1d00 tx=0x7f5aac02bee0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.609+0000 7f5d08a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5d04161f70 con 0x7f5d040d1a00 2024-04-20T21:19:57.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f1b6be00640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1b5006c970 0x7f1b5006ee30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b74140380 tx=0x7f1b5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.609+0000 7f5d02800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d040d4270 0x7f5d041f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5d02800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d040d4270 0x7f5d041f85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45088/0 (socket says 172.21.15.71:45088) 2024-04-20T21:19:57.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5d02800640 1 -- 172.21.15.71:0/4107652624 learned_addr learned my addr 172.21.15.71:0/4107652624 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5ac0600640 1 -- 172.21.15.71:0/1525035296 shutdown_connections 2024-04-20T21:19:57.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5ac0600640 1 --2- 172.21.15.71:0/1525035296 >> v2:172.21.15.137:3300/0 conn(0x7f5ab806bdd0 0x7f5ab815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5ac0600640 1 --2- 172.21.15.71:0/1525035296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab815a7d0 0x7f5ab80ad210 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5ac0600640 1 -- 172.21.15.71:0/1525035296 >> 172.21.15.71:0/1525035296 conn(0x7f5ab8072090 msgr2=0x7f5ab80b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:57.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5d01e00640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d040b17d0 0x7f5d040ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5d01400640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5d040d1a00 0x7f5d041f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f4467e00640 1 -- 172.21.15.71:0/1567334259 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4468075b60 con 0x7f4468161d50 2024-04-20T21:19:57.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5d02800640 1 -- 172.21.15.71:0/4107652624 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5d040d1a00 msgr2=0x7f5d041f8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5d02800640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5d040d1a00 0x7f5d041f8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5d02800640 1 -- 172.21.15.71:0/4107652624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d040b17d0 msgr2=0x7f5d040ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5d02800640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d040b17d0 0x7f5d040ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5d02800640 1 -- 172.21.15.71:0/4107652624 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d040ce4e0 con 0x7f5d040d4270 2024-04-20T21:19:57.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7f5ac0600640 1 -- 172.21.15.71:0/1525035296 shutdown_connections 2024-04-20T21:19:57.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.610+0000 7fe929e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92415d870 0x7fe9240c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.611+0000 7f5d01e00640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d040b17d0 0x7f5d040ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:57.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.611+0000 7fe929e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe92415f820 0x7fe9241f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.611+0000 7f5d02800640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d040d4270 0x7f5d041f85d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc007ef0 tx=0x7f5cfc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.611+0000 7fe929e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9241611a0 0x7fe924161620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.611+0000 7fe929e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe92415eab0 con 0x7fe9241611a0 2024-04-20T21:19:57.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.611+0000 7fe929e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe92415e930 con 0x7fe92415d870 2024-04-20T21:19:57.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.611+0000 7fe929e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe9240d4810 con 0x7fe92415f820 2024-04-20T21:19:57.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.611+0000 7f5cfa000640 1 -- 172.21.15.71:0/4107652624 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc01a070 con 0x7f5d040d4270 2024-04-20T21:19:57.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7f5cfa000640 1 -- 172.21.15.71:0/4107652624 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc015600 con 0x7f5d040d4270 2024-04-20T21:19:57.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7f5cfa000640 1 -- 172.21.15.71:0/4107652624 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0159f0 con 0x7f5d040d4270 2024-04-20T21:19:57.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.611+0000 7fe923e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe92415f820 0x7fe9241f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.611+0000 7fe923e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe92415f820 0x7fe9241f89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:37514/0 (socket says 172.21.15.71:37514) 2024-04-20T21:19:57.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7fe923e00640 1 -- 172.21.15.71:0/3019281061 learned_addr learned my addr 172.21.15.71:0/3019281061 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7fe928a00640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92415d870 0x7fe9240c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7fe929400640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9241611a0 0x7fe924161620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7f445f400640 1 -- 172.21.15.71:0/1567334259 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f446001a070 con 0x7f4468161d50 2024-04-20T21:19:57.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7fe929400640 1 -- 172.21.15.71:0/3019281061 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe92415f820 msgr2=0x7fe9241f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7fe929400640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe92415f820 0x7fe9241f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7fe929400640 1 -- 172.21.15.71:0/3019281061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92415d870 msgr2=0x7fe9240c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7fe929400640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92415d870 0x7fe9240c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7fe929400640 1 -- 172.21.15.71:0/3019281061 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9240c9190 con 0x7fe9241611a0 2024-04-20T21:19:57.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.612+0000 7fe923e00640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe92415f820 0x7fe9241f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:19:57.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.613+0000 7fe929400640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9241611a0 0x7fe924161620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe9240b9680 tx=0x7fe91c009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.611+0000 7f5ac0600640 1 -- 172.21.15.71:0/1525035296 wait complete. 2024-04-20T21:19:57.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.613+0000 7f5ac0600640 1 Processor -- start 2024-04-20T21:19:57.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.614+0000 7f5ac0600640 1 -- start start 2024-04-20T21:19:57.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.614+0000 7f445f400640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f444406c9c0 0x7f444406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.614+0000 7f445f400640 1 -- 172.21.15.71:0/1567334259 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f446008bb30 con 0x7f4468161d50 2024-04-20T21:19:57.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.614+0000 7f4466a00640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f444406c9c0 0x7f444406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.614+0000 7f5d08a00640 1 -- 172.21.15.71:0/4107652624 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0406ba10 con 0x7f5d040d4270 2024-04-20T21:19:57.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.614+0000 7f5d08a00640 1 -- 172.21.15.71:0/4107652624 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d04159f30 con 0x7f5d040d4270 2024-04-20T21:19:57.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.615+0000 7f4466a00640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f444406c9c0 0x7f444406ee80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f44681f61a0 tx=0x7f4450009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.616+0000 7f5ac0600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ab806bdd0 0x7f5ab813fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.616+0000 7f5ac0600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ab80b3bf0 0x7f5ab813e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.616+0000 7f5d08a00640 1 -- 172.21.15.71:0/4107652624 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d04068980 con 0x7f5d040d4270 2024-04-20T21:19:57.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.616+0000 7f5ac0600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab815a7d0 0x7f5ab8168ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.616+0000 7f4d28c00640 1 -- 172.21.15.71:0/3317731511 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4d20051080 con 0x7f4d2c0ceff0 2024-04-20T21:19:57.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.616+0000 7f5ac0600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab806b970 con 0x7f5ab815a7d0 2024-04-20T21:19:57.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.616+0000 7f5ac0600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab80ae390 con 0x7f5ab806bdd0 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.616+0000 7f5abdc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ab806bdd0 0x7f5ab813fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.616+0000 7f5abe600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab815a7d0 0x7f5ab8168ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.616+0000 7f5ac0600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab806baf0 con 0x7f5ab80b3bf0 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.617+0000 7f5abe600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab815a7d0 0x7f5ab8168ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45106/0 (socket says 172.21.15.71:45106) 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.617+0000 7f5abdc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ab806bdd0 0x7f5ab813fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:42210/0 (socket says 172.21.15.71:42210) 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.617+0000 7f5abdc00640 1 -- 172.21.15.71:0/1367570517 learned_addr learned my addr 172.21.15.71:0/1367570517 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.617+0000 7f5abd200640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ab80b3bf0 0x7f5ab813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.617+0000 7f5abe600640 1 -- 172.21.15.71:0/1367570517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ab80b3bf0 msgr2=0x7f5ab813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.617+0000 7f5abe600640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ab80b3bf0 0x7f5ab813e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.617+0000 7f5abe600640 1 -- 172.21.15.71:0/1367570517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ab806bdd0 msgr2=0x7f5ab813fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.617+0000 7f5abe600640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ab806bdd0 0x7f5ab813fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.617+0000 7f5abe600640 1 -- 172.21.15.71:0/1367570517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab8140110 con 0x7f5ab815a7d0 2024-04-20T21:19:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.617+0000 7f5abe600640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab815a7d0 0x7f5ab8168ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c440 tx=0x7f5ab000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.619+0000 7f1b6a000640 1 -- 172.21.15.71:0/1071124267 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1b6407bda0 con 0x7f1b7406bdd0 2024-04-20T21:19:57.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.624+0000 7fe920c00640 1 -- 172.21.15.71:0/3019281061 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c019070 con 0x7fe9241611a0 2024-04-20T21:19:57.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.624+0000 7fe929e00640 1 -- 172.21.15.71:0/3019281061 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9240c9470 con 0x7fe9241611a0 2024-04-20T21:19:57.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.624+0000 7f5ab5600640 1 -- 172.21.15.71:0/1367570517 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0011790 con 0x7f5ab815a7d0 2024-04-20T21:19:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.624+0000 7f445f400640 1 -- 172.21.15.71:0/1567334259 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f44600595b0 con 0x7f4468161d50 2024-04-20T21:19:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.624+0000 7f5ac0600640 1 -- 172.21.15.71:0/1367570517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab813e890 con 0x7f5ab815a7d0 2024-04-20T21:19:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.624+0000 7f5ac0600640 1 -- 172.21.15.71:0/1367570517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab813ee10 con 0x7f5ab815a7d0 2024-04-20T21:19:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.625+0000 7f5ab5600640 1 -- 172.21.15.71:0/1367570517 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab0017070 con 0x7f5ab815a7d0 2024-04-20T21:19:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.625+0000 7f5ab5600640 1 -- 172.21.15.71:0/1367570517 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0011b30 con 0x7f5ab815a7d0 2024-04-20T21:19:57.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.624+0000 7fe929e00640 1 -- 172.21.15.71:0/3019281061 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9240c9a30 con 0x7fe9241611a0 2024-04-20T21:19:57.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.626+0000 7fe920c00640 1 -- 172.21.15.71:0/3019281061 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c007c90 con 0x7fe9241611a0 2024-04-20T21:19:57.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.626+0000 7fe920c00640 1 -- 172.21.15.71:0/3019281061 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c023060 con 0x7fe9241611a0 2024-04-20T21:19:57.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.627+0000 7fe929e00640 1 -- 172.21.15.71:0/3019281061 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe924075b30 con 0x7fe9241611a0 2024-04-20T21:19:57.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.629+0000 7f5ac0600640 1 -- 172.21.15.71:0/1367570517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a94005290 con 0x7f5ab815a7d0 2024-04-20T21:19:57.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.633+0000 7f5ab5600640 1 -- 172.21.15.71:0/1367570517 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ab001c460 con 0x7f5ab815a7d0 2024-04-20T21:19:57.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.635+0000 7f5ab5600640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a9806c8f0 0x7f5a9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.636+0000 7fe920c00640 1 -- 172.21.15.71:0/3019281061 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe91c01c070 con 0x7fe9241611a0 2024-04-20T21:19:57.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.636+0000 7f5abdc00640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a9806c8f0 0x7f5a9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.638+0000 7fe920c00640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90406caf0 0x7fe90406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.638+0000 7fe928a00640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90406caf0 0x7fe90406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.640+0000 7fe928a00640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90406caf0 0x7fe90406efb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe918001050 tx=0x7fe918009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.641+0000 7f5abdc00640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a9806c8f0 0x7f5a9806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5aac02bf20 tx=0x7f5aac030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.640+0000 7f5cfa000640 1 -- 172.21.15.71:0/4107652624 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5cfc005d10 con 0x7f5d040d4270 2024-04-20T21:19:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.641+0000 7f5cfa000640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5ce406c9f0 0x7f5ce406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.642+0000 7f5cfa000640 1 -- 172.21.15.71:0/4107652624 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5cfc08c640 con 0x7f5d040d4270 2024-04-20T21:19:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.643+0000 7f5cfa000640 1 -- 172.21.15.71:0/4107652624 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5cfc024080 con 0x7f5d040d4270 2024-04-20T21:19:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.643+0000 7f5ab5600640 1 -- 172.21.15.71:0/1367570517 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5ab00575f0 con 0x7f5ab815a7d0 2024-04-20T21:19:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.643+0000 7fe920c00640 1 -- 172.21.15.71:0/3019281061 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe91c056fc0 con 0x7fe9241611a0 2024-04-20T21:19:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.644+0000 7f5d01e00640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5ce406c9f0 0x7f5ce406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.645+0000 7f5d01e00640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5ce406c9f0 0x7f5ce406eeb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4000f60 tx=0x7f5cf4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:57.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.654+0000 7fe920c00640 1 -- 172.21.15.71:0/3019281061 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe91c058f20 con 0x7fe9241611a0 2024-04-20T21:19:57.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.661+0000 7f5ab5600640 1 -- 172.21.15.71:0/1367570517 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5ab0059c50 con 0x7f5ab815a7d0 2024-04-20T21:19:57.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.978+0000 7f26a9600640 1 -- 172.21.15.71:0/2539101608 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f26a40d31e0 con 0x7f26880037a0 2024-04-20T21:19:57.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.979+0000 7f269aa00640 1 -- 172.21.15.71:0/2539101608 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2690059b00 con 0x7f26880037a0 2024-04-20T21:19:57.980 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2024-04-20T21:19:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.982+0000 7f937f200640 1 -- 172.21.15.71:0/1509740090 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f93740d8d30 con 0x7f93740eacf0 2024-04-20T21:19:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.983+0000 7f26a9600640 1 -- 172.21.15.71:0/2539101608 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f268406caf0 msgr2=0x7f268406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.983+0000 7f26a9600640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f268406caf0 0x7f268406efb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2694034000 tx=0x7f2694007000 comp rx=0 tx=0).stop 2024-04-20T21:19:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.983+0000 7f9372000640 1 -- 172.21.15.71:0/1509740090 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f93780f6df0 con 0x7f93740eacf0 2024-04-20T21:19:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.983+0000 7f26a9600640 1 -- 172.21.15.71:0/2539101608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26880037a0 msgr2=0x7f26a40b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.983+0000 7f26a9600640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26880037a0 0x7f26a40b58a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f269000b7f0 tx=0x7f269000bcb0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.984+0000 7f26a9600640 1 -- 172.21.15.71:0/2539101608 shutdown_connections 2024-04-20T21:19:57.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.984+0000 7f26a9600640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f268406caf0 0x7f268406efb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.984+0000 7f26a9600640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a40cb920 0x7f26a40cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.984+0000 7f26a9600640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26a41527f0 0x7f26a4152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.984+0000 7f26a9600640 1 --2- 172.21.15.71:0/2539101608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26880037a0 0x7f26a40b58a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.984+0000 7f26a9600640 1 -- 172.21.15.71:0/2539101608 >> 172.21.15.71:0/2539101608 conn(0x7f26a40b99c0 msgr2=0x7f26a40b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:57.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.984+0000 7f26a9600640 1 -- 172.21.15.71:0/2539101608 shutdown_connections 2024-04-20T21:19:57.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.984+0000 7f26a9600640 1 -- 172.21.15.71:0/2539101608 wait complete. 2024-04-20T21:19:57.987 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2024-04-20T21:19:57.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.987+0000 7f937f200640 1 -- 172.21.15.71:0/1509740090 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f935c06c8f0 msgr2=0x7f935c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.987+0000 7f937f200640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f935c06c8f0 0x7f935c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9368000f60 tx=0x7f9368009040 comp rx=0 tx=0).stop 2024-04-20T21:19:57.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.988+0000 7f937f200640 1 -- 172.21.15.71:0/1509740090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93740eacf0 msgr2=0x7f937404dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:57.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.988+0000 7f937f200640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93740eacf0 0x7f937404dd10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f937807ab10 tx=0x7f937806b710 comp rx=0 tx=0).stop 2024-04-20T21:19:57.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.989+0000 7f937f200640 1 -- 172.21.15.71:0/1509740090 shutdown_connections 2024-04-20T21:19:57.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.989+0000 7f937f200640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f935c06c8f0 0x7f935c06edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.989+0000 7f937f200640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93740eacf0 0x7f937404dd10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.989+0000 7f937f200640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9374006800 0x7f93740dd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.989+0000 7f937f200640 1 --2- 172.21.15.71:0/1509740090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9374005e80 0x7f93740db5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:57.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.989+0000 7f937f200640 1 -- 172.21.15.71:0/1509740090 >> 172.21.15.71:0/1509740090 conn(0x7f9374009fa0 msgr2=0x7f93740389c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:57.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.990+0000 7f937f200640 1 -- 172.21.15.71:0/1509740090 shutdown_connections 2024-04-20T21:19:57.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:57.990+0000 7f937f200640 1 -- 172.21.15.71:0/1509740090 wait complete. 2024-04-20T21:19:58.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-04-20T21:19:58.012 DEBUG:teuthology.parallel:result is None 2024-04-20T21:19:58.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-04-20T21:19:58.019 DEBUG:teuthology.parallel:result is None 2024-04-20T21:19:58.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.031+0000 7f1b79000640 1 -- 172.21.15.71:0/1071124267 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1b7406e140 con 0x7f1b7406bdd0 2024-04-20T21:19:58.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.032+0000 7f1b6a000640 1 -- 172.21.15.71:0/1071124267 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b640800a0 con 0x7f1b7406bdd0 2024-04-20T21:19:58.032 INFO:teuthology.orchestra.run.smithi071.stdout:55834574860 2024-04-20T21:19:58.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.034+0000 7f1b79000640 1 -- 172.21.15.71:0/1071124267 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1b5006c970 msgr2=0x7f1b5006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.034+0000 7f1b79000640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1b5006c970 0x7f1b5006ee30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b74140380 tx=0x7f1b5c009040 comp rx=0 tx=0).stop 2024-04-20T21:19:58.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.034+0000 7f1b79000640 1 -- 172.21.15.71:0/1071124267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7406bdd0 msgr2=0x7f1b7409a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.034+0000 7f1b79000640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7406bdd0 0x7f1b7409a160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b64004000 tx=0x7f1b640046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.034+0000 7f1b79000640 1 -- 172.21.15.71:0/1071124267 shutdown_connections 2024-04-20T21:19:58.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.034+0000 7f1b79000640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1b5006c970 0x7f1b5006ee30 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b74140380 tx=0x7f1b5c009040 comp rx=0 tx=0).stop 2024-04-20T21:19:58.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.034+0000 7f1b79000640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b740b3bf0 0x7f1b74140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.034+0000 7f1b79000640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b7406e510 0x7f1b7409a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.034+0000 7f1b79000640 1 --2- 172.21.15.71:0/1071124267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7406bdd0 0x7f1b7409a160 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.034+0000 7f1b79000640 1 -- 172.21.15.71:0/1071124267 >> 172.21.15.71:0/1071124267 conn(0x7f1b74072090 msgr2=0x7f1b741599b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:58.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.035+0000 7f1b79000640 1 -- 172.21.15.71:0/1071124267 shutdown_connections 2024-04-20T21:19:58.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.035+0000 7f1b79000640 1 -- 172.21.15.71:0/1071124267 wait complete. 2024-04-20T21:19:58.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.043+0000 7f4d33800640 1 -- 172.21.15.71:0/3317731511 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4d2c072700 con 0x7f4d2c0ceff0 2024-04-20T21:19:58.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.044+0000 7f4d28c00640 1 -- 172.21.15.71:0/3317731511 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d2007bf40 con 0x7f4d2c0ceff0 2024-04-20T21:19:58.044 INFO:teuthology.orchestra.run.smithi071.stdout:55834574860 2024-04-20T21:19:58.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.047+0000 7f4d33800640 1 -- 172.21.15.71:0/3317731511 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4d0c06c920 msgr2=0x7f4d0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.047+0000 7f4d33800640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4d0c06c920 0x7f4d0c06ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d18006fd0 tx=0x7f4d18008040 comp rx=0 tx=0).stop 2024-04-20T21:19:58.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.047+0000 7f4d33800640 1 -- 172.21.15.71:0/3317731511 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c0ceff0 msgr2=0x7f4d2c15bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.047+0000 7f4d33800640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c0ceff0 0x7f4d2c15bf00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4d20009960 tx=0x7f4d200046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.047+0000 7f4d33800640 1 -- 172.21.15.71:0/3317731511 shutdown_connections 2024-04-20T21:19:58.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.047+0000 7f4d33800640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4d0c06c920 0x7f4d0c06ede0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.047+0000 7f4d33800640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d2c15cc20 0x7f4d2c149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.047+0000 7f4d33800640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d2c0cf3d0 0x7f4d2c149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.047+0000 7f4d33800640 1 --2- 172.21.15.71:0/3317731511 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2c0ceff0 0x7f4d2c15bf00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.047+0000 7f4d33800640 1 -- 172.21.15.71:0/3317731511 >> 172.21.15.71:0/3317731511 conn(0x7f4d2c071800 msgr2=0x7f4d2c0b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:58.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.048+0000 7f4d33800640 1 -- 172.21.15.71:0/3317731511 shutdown_connections 2024-04-20T21:19:58.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.048+0000 7fe929e00640 1 -- 172.21.15.71:0/3019281061 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe9240b9730 con 0x7fe9241611a0 2024-04-20T21:19:58.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.048+0000 7f4d33800640 1 -- 172.21.15.71:0/3317731511 wait complete. 2024-04-20T21:19:58.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.049+0000 7fe920c00640 1 -- 172.21.15.71:0/3019281061 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe91c05d220 con 0x7fe9241611a0 2024-04-20T21:19:58.049 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2024-04-20T21:19:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 -- 172.21.15.71:0/3019281061 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90406caf0 msgr2=0x7fe90406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90406caf0 0x7fe90406efb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe918001050 tx=0x7fe918009040 comp rx=0 tx=0).stop 2024-04-20T21:19:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 -- 172.21.15.71:0/3019281061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9241611a0 msgr2=0x7fe924161620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9241611a0 0x7fe924161620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe9240b9680 tx=0x7fe91c009d40 comp rx=0 tx=0).stop 2024-04-20T21:19:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 -- 172.21.15.71:0/3019281061 shutdown_connections 2024-04-20T21:19:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90406caf0 0x7fe90406efb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9241611a0 0x7fe924161620 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe92415f820 0x7fe9241f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 --2- 172.21.15.71:0/3019281061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92415d870 0x7fe9240c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 -- 172.21.15.71:0/3019281061 >> 172.21.15.71:0/3019281061 conn(0x7fe92408bf80 msgr2=0x7fe92406e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 -- 172.21.15.71:0/3019281061 shutdown_connections 2024-04-20T21:19:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.052+0000 7fe929e00640 1 -- 172.21.15.71:0/3019281061 wait complete. 2024-04-20T21:19:58.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.7 2024-04-20T21:19:58.057 DEBUG:teuthology.parallel:result is None 2024-04-20T21:19:58.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2024-04-20T21:19:58.068 DEBUG:teuthology.parallel:result is None 2024-04-20T21:19:58.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-04-20T21:19:58.069 DEBUG:teuthology.parallel:result is None 2024-04-20T21:19:58.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.069+0000 7f5ac0600640 1 -- 172.21.15.71:0/1367570517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5a94005580 con 0x7f5ab815a7d0 2024-04-20T21:19:58.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.070+0000 7f5ab5600640 1 -- 172.21.15.71:0/1367570517 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ab0059550 con 0x7f5ab815a7d0 2024-04-20T21:19:58.070 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2024-04-20T21:19:58.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 -- 172.21.15.71:0/1367570517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a9806c8f0 msgr2=0x7f5a9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a9806c8f0 0x7f5a9806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5aac02bf20 tx=0x7f5aac030000 comp rx=0 tx=0).stop 2024-04-20T21:19:58.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 -- 172.21.15.71:0/1367570517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab815a7d0 msgr2=0x7f5ab8168ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab815a7d0 0x7f5ab8168ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c440 tx=0x7f5ab000c900 comp rx=0 tx=0).stop 2024-04-20T21:19:58.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 -- 172.21.15.71:0/1367570517 shutdown_connections 2024-04-20T21:19:58.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a9806c8f0 0x7f5a9806edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab815a7d0 0x7f5ab8168ea0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ab80b3bf0 0x7f5ab813e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 --2- 172.21.15.71:0/1367570517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ab806bdd0 0x7f5ab813fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 -- 172.21.15.71:0/1367570517 >> 172.21.15.71:0/1367570517 conn(0x7f5ab8072090 msgr2=0x7f5ab8158a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:58.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 -- 172.21.15.71:0/1367570517 shutdown_connections 2024-04-20T21:19:58.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.072+0000 7f5ac0600640 1 -- 172.21.15.71:0/1367570517 wait complete. 2024-04-20T21:19:58.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.073+0000 7f4467e00640 1 -- 172.21.15.71:0/1567334259 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f44681f8530 con 0x7f4468161d50 2024-04-20T21:19:58.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.073+0000 7f445f400640 1 -- 172.21.15.71:0/1567334259 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f446005d8b0 con 0x7f4468161d50 2024-04-20T21:19:58.073 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2024-04-20T21:19:58.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.076+0000 7f4467e00640 1 -- 172.21.15.71:0/1567334259 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f444406c9c0 msgr2=0x7f444406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.076+0000 7f4467e00640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f444406c9c0 0x7f444406ee80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f44681f61a0 tx=0x7f4450009190 comp rx=0 tx=0).stop 2024-04-20T21:19:58.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.076+0000 7f4467e00640 1 -- 172.21.15.71:0/1567334259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4468161d50 msgr2=0x7f44680cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.076+0000 7f4467e00640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4468161d50 0x7f44680cc850 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f446000caa0 tx=0x7f446000cf60 comp rx=0 tx=0).stop 2024-04-20T21:19:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.076+0000 7f4467e00640 1 -- 172.21.15.71:0/1567334259 shutdown_connections 2024-04-20T21:19:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.076+0000 7f4467e00640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f444406c9c0 0x7f444406ee80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.076+0000 7f4467e00640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4468161d50 0x7f44680cc850 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.076+0000 7f4467e00640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44680b3330 0x7f44680cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.076+0000 7f4467e00640 1 --2- 172.21.15.71:0/1567334259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f446806c6d0 0x7f44681f8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.076+0000 7f4467e00640 1 -- 172.21.15.71:0/1567334259 >> 172.21.15.71:0/1567334259 conn(0x7f44680d4450 msgr2=0x7f44680cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.077+0000 7f4467e00640 1 -- 172.21.15.71:0/1567334259 shutdown_connections 2024-04-20T21:19:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.077+0000 7f4467e00640 1 -- 172.21.15.71:0/1567334259 wait complete. 2024-04-20T21:19:58.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.084+0000 7f5d08a00640 1 -- 172.21.15.71:0/4107652624 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5d040ce8f0 con 0x7f5d040d4270 2024-04-20T21:19:58.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.085+0000 7f5cfa000640 1 -- 172.21.15.71:0/4107652624 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5cfc010070 con 0x7f5d040d4270 2024-04-20T21:19:58.084 INFO:teuthology.orchestra.run.smithi071.stdout:55834574859 2024-04-20T21:19:58.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 -- 172.21.15.71:0/4107652624 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5ce406c9f0 msgr2=0x7f5ce406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5ce406c9f0 0x7f5ce406eeb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4000f60 tx=0x7f5cf4009040 comp rx=0 tx=0).stop 2024-04-20T21:19:58.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 -- 172.21.15.71:0/4107652624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d040d4270 msgr2=0x7f5d041f85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d040d4270 0x7f5d041f85d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc007ef0 tx=0x7f5cfc00d4a0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 -- 172.21.15.71:0/4107652624 shutdown_connections 2024-04-20T21:19:58.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5ce406c9f0 0x7f5ce406eeb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d040d4270 0x7f5d041f85d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5d040d1a00 0x7f5d041f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 --2- 172.21.15.71:0/4107652624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d040b17d0 0x7f5d040ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 -- 172.21.15.71:0/4107652624 >> 172.21.15.71:0/4107652624 conn(0x7f5d040b99c0 msgr2=0x7f5d040b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:58.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 -- 172.21.15.71:0/4107652624 shutdown_connections 2024-04-20T21:19:58.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.089+0000 7f5d08a00640 1 -- 172.21.15.71:0/4107652624 wait complete. 2024-04-20T21:19:58.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-04-20T21:19:58.091 DEBUG:teuthology.parallel:result is None 2024-04-20T21:19:58.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-04-20T21:19:58.098 DEBUG:teuthology.parallel:result is None 2024-04-20T21:19:58.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-04-20T21:19:58.107 DEBUG:teuthology.parallel:result is None 2024-04-20T21:19:58.107 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-20T21:19:58.107 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T21:19:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.340+0000 7fce2a400640 1 Processor -- start 2024-04-20T21:19:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.340+0000 7fce2a400640 1 -- start start 2024-04-20T21:19:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce2a400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce24159e10 0x7fce24071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce2a400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce2406da90 0x7fce24071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce2a400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce2415cc90 con 0x7fce2415a1f0 2024-04-20T21:19:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce2a400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fce24072900 con 0x7fce2406da90 2024-04-20T21:19:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce2a400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fce2415ca40 con 0x7fce24159e10 2024-04-20T21:19:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce29a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce2406da90 0x7fce24071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce29a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce2406da90 0x7fce24071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45112/0 (socket says 172.21.15.71:45112) 2024-04-20T21:19:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce29a00640 1 -- 172.21.15.71:0/2909698078 learned_addr learned my addr 172.21.15.71:0/2909698078 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce29000640 1 --2- 172.21.15.71:0/2909698078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce24159e10 0x7fce24071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce29a00640 1 -- 172.21.15.71:0/2909698078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce24159e10 msgr2=0x7fce24071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce29a00640 1 --2- 172.21.15.71:0/2909698078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce24159e10 0x7fce24071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce29a00640 1 -- 172.21.15.71:0/2909698078 >> v1:172.21.15.137:6789/0 conn(0x7fce2415a1f0 legacy=0x7fce24160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce29a00640 1 -- 172.21.15.71:0/2909698078 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2415cf70 con 0x7fce2406da90 2024-04-20T21:19:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.342+0000 7fce29000640 1 --2- 172.21.15.71:0/2909698078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce24159e10 0x7fce24071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.343+0000 7fce29a00640 1 --2- 172.21.15.71:0/2909698078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce2406da90 0x7fce24071fc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009e50 tx=0x7fce1c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8803307a72bd09f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.344+0000 7fce23e00640 1 -- 172.21.15.71:0/2909698078 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c02ca80 con 0x7fce2406da90 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.344+0000 7fce23e00640 1 -- 172.21.15.71:0/2909698078 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c02cc20 con 0x7fce2406da90 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.344+0000 7fce23e00640 1 -- 172.21.15.71:0/2909698078 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0343f0 con 0x7fce2406da90 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.344+0000 7fce2a400640 1 -- 172.21.15.71:0/2909698078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce2406da90 msgr2=0x7fce24071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.344+0000 7fce2a400640 1 --2- 172.21.15.71:0/2909698078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce2406da90 0x7fce24071fc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009e50 tx=0x7fce1c02bee0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.344+0000 7fce2a400640 1 -- 172.21.15.71:0/2909698078 shutdown_connections 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.344+0000 7fce2a400640 1 --2- 172.21.15.71:0/2909698078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce2406da90 0x7fce24071fc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.344+0000 7fce2a400640 1 --2- 172.21.15.71:0/2909698078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce24159e10 0x7fce24071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.344+0000 7fce2a400640 1 -- 172.21.15.71:0/2909698078 >> 172.21.15.71:0/2909698078 conn(0x7fce240d0040 msgr2=0x7fce240d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.345+0000 7fce2a400640 1 -- 172.21.15.71:0/2909698078 shutdown_connections 2024-04-20T21:19:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.345+0000 7fce2a400640 1 -- 172.21.15.71:0/2909698078 wait complete. 2024-04-20T21:19:58.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.346+0000 7fce2a400640 1 Processor -- start 2024-04-20T21:19:58.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.346+0000 7fce2a400640 1 -- start start 2024-04-20T21:19:58.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.347+0000 7fce2a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce2406da90 0x7fce24155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:58.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.347+0000 7fce2a400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce24159e10 0x7fce240afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:58.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.347+0000 7fce2a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce2415a1f0 0x7fce240b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.347+0000 7fce2a400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fce2415d810 con 0x7fce2406da90 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.347+0000 7fce2a400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce2415d530 con 0x7fce2415a1f0 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.347+0000 7fce2a400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fce2406b900 con 0x7fce24159e10 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.347+0000 7fce29000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce2406da90 0x7fce24155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce29000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce2406da90 0x7fce24155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45128/0 (socket says 172.21.15.71:45128) 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce29000640 1 -- 172.21.15.71:0/967748381 learned_addr learned my addr 172.21.15.71:0/967748381 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce29000640 1 -- 172.21.15.71:0/967748381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce24159e10 msgr2=0x7fce240afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce29a00640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce2415a1f0 0x7fce240b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce29000640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce24159e10 0x7fce240afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce29000640 1 -- 172.21.15.71:0/967748381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce2415a1f0 msgr2=0x7fce240b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce29000640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce2415a1f0 0x7fce240b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce29000640 1 -- 172.21.15.71:0/967748381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce241f4290 con 0x7fce2406da90 2024-04-20T21:19:58.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce29000640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce2406da90 0x7fce24155fd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce1400c820 tx=0x7fce1400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:58.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce21600640 1 -- 172.21.15.71:0/967748381 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14015070 con 0x7fce2406da90 2024-04-20T21:19:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce21600640 1 -- 172.21.15.71:0/967748381 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce14007a30 con 0x7fce2406da90 2024-04-20T21:19:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.348+0000 7fce21600640 1 -- 172.21.15.71:0/967748381 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14007e00 con 0x7fce2406da90 2024-04-20T21:19:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.349+0000 7fce2a400640 1 -- 172.21.15.71:0/967748381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce241f4570 con 0x7fce2406da90 2024-04-20T21:19:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.349+0000 7fce2a400640 1 -- 172.21.15.71:0/967748381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce241f4b30 con 0x7fce2406da90 2024-04-20T21:19:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.350+0000 7fce2a400640 1 -- 172.21.15.71:0/967748381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce2406e170 con 0x7fce2406da90 2024-04-20T21:19:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.351+0000 7fce21600640 1 -- 172.21.15.71:0/967748381 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce14018070 con 0x7fce2406da90 2024-04-20T21:19:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.352+0000 7fce21600640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fce0406c8f0 0x7fce0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.352+0000 7fce21600640 1 -- 172.21.15.71:0/967748381 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fce1408be60 con 0x7fce2406da90 2024-04-20T21:19:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.352+0000 7fce1be00640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fce0406c8f0 0x7fce0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.352+0000 7fce1be00640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fce0406c8f0 0x7fce0406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fce10006fd0 tx=0x7fce10006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.356+0000 7fce21600640 1 -- 172.21.15.71:0/967748381 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fce2406e170 con 0x7fce2406da90 2024-04-20T21:19:58.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.537+0000 7fce2a400640 1 -- 172.21.15.71:0/967748381 --> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce2406cdc0 con 0x7fce0406c8f0 2024-04-20T21:19:58.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.560+0000 7fce21600640 1 -- 172.21.15.71:0/967748381 <== mgr.4110 v2:172.21.15.71:6832/1511456036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332538 (secure 0 0 0) 0x7fce2406cdc0 con 0x7fce0406c8f0 2024-04-20T21:19:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:58.566 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.566+0000 7fce2a400640 1 -- 172.21.15.71:0/967748381 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fce0406c8f0 msgr2=0x7fce0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.566+0000 7fce2a400640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fce0406c8f0 0x7fce0406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fce10006fd0 tx=0x7fce10006bc0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.566+0000 7fce2a400640 1 -- 172.21.15.71:0/967748381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce2406da90 msgr2=0x7fce24155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.566+0000 7fce2a400640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce2406da90 0x7fce24155fd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce1400c820 tx=0x7fce1400cc20 comp rx=0 tx=0).stop 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.567+0000 7fce2a400640 1 -- 172.21.15.71:0/967748381 shutdown_connections 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.567+0000 7fce2a400640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fce0406c8f0 0x7fce0406edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.567+0000 7fce2a400640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce2415a1f0 0x7fce240b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.567+0000 7fce2a400640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce24159e10 0x7fce240afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.567+0000 7fce2a400640 1 --2- 172.21.15.71:0/967748381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce2406da90 0x7fce24155fd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.567+0000 7fce2a400640 1 -- 172.21.15.71:0/967748381 >> 172.21.15.71:0/967748381 conn(0x7fce240d0040 msgr2=0x7fce240cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.567+0000 7fce2a400640 1 -- 172.21.15.71:0/967748381 shutdown_connections 2024-04-20T21:19:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.567+0000 7fce2a400640 1 -- 172.21.15.71:0/967748381 wait complete. 2024-04-20T21:19:58.585 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-20T21:19:57.803704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2049160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004496"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250445+0000","last_change":"2024-04-20T21:19:28.364884+0000","last_active":"2024-04-20T21:19:36.250445+0000","last_peered":"2024-04-20T21:19:36.250445+0000","last_clean":"2024-04-20T21:19:36.250445+0000","last_became_active":"2024-04-20T21:19:28.364515+0000","last_became_peered":"2024-04-20T21:19:28.364515+0000","last_unstale":"2024-04-20T21:19:36.250445+0000","last_undegraded":"2024-04-20T21:19:36.250445+0000","last_fullsized":"2024-04-20T21:19:36.250445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622903+0000","last_change":"2024-04-20T21:19:29.381382+0000","last_active":"2024-04-20T21:19:35.622903+0000","last_peered":"2024-04-20T21:19:35.622903+0000","last_clean":"2024-04-20T21:19:35.622903+0000","last_became_active":"2024-04-20T21:19:29.381086+0000","last_became_peered":"2024-04-20T21:19:29.381086+0000","last_unstale":"2024-04-20T21:19:35.622903+0000","last_undegraded":"2024-04-20T21:19:35.622903+0000","last_fullsized":"2024-04-20T21:19:35.622903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:24:23.709381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622136+0000","last_change":"2024-04-20T21:19:34.116039+0000","last_active":"2024-04-20T21:19:35.622136+0000","last_peered":"2024-04-20T21:19:35.622136+0000","last_clean":"2024-04-20T21:19:35.622136+0000","last_became_active":"2024-04-20T21:19:34.114870+0000","last_became_peered":"2024-04-20T21:19:34.114870+0000","last_unstale":"2024-04-20T21:19:35.622136+0000","last_undegraded":"2024-04-20T21:19:35.622136+0000","last_fullsized":"2024-04-20T21:19:35.622136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:11:39.317180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623062+0000","last_change":"2024-04-20T21:19:28.356358+0000","last_active":"2024-04-20T21:19:35.623062+0000","last_peered":"2024-04-20T21:19:35.623062+0000","last_clean":"2024-04-20T21:19:35.623062+0000","last_became_active":"2024-04-20T21:19:28.355376+0000","last_became_peered":"2024-04-20T21:19:28.355376+0000","last_unstale":"2024-04-20T21:19:35.623062+0000","last_undegraded":"2024-04-20T21:19:35.623062+0000","last_fullsized":"2024-04-20T21:19:35.623062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:12:37.534140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250065+0000","last_change":"2024-04-20T21:19:29.393098+0000","last_active":"2024-04-20T21:19:36.250065+0000","last_peered":"2024-04-20T21:19:36.250065+0000","last_clean":"2024-04-20T21:19:36.250065+0000","last_became_active":"2024-04-20T21:19:29.392267+0000","last_became_peered":"2024-04-20T21:19:29.392267+0000","last_unstale":"2024-04-20T21:19:36.250065+0000","last_undegraded":"2024-04-20T21:19:36.250065+0000","last_fullsized":"2024-04-20T21:19:36.250065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626812+0000","last_change":"2024-04-20T21:19:33.632986+0000","last_active":"2024-04-20T21:19:35.626812+0000","last_peered":"2024-04-20T21:19:35.626812+0000","last_clean":"2024-04-20T21:19:35.626812+0000","last_became_active":"2024-04-20T21:19:33.632489+0000","last_became_peered":"2024-04-20T21:19:33.632489+0000","last_unstale":"2024-04-20T21:19:35.626812+0000","last_undegraded":"2024-04-20T21:19:35.626812+0000","last_fullsized":"2024-04-20T21:19:35.626812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:25.396766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251112+0000","last_change":"2024-04-20T21:19:28.370372+0000","last_active":"2024-04-20T21:19:36.251112+0000","last_peered":"2024-04-20T21:19:36.251112+0000","last_clean":"2024-04-20T21:19:36.251112+0000","last_became_active":"2024-04-20T21:19:28.369998+0000","last_became_peered":"2024-04-20T21:19:28.369998+0000","last_unstale":"2024-04-20T21:19:36.251112+0000","last_undegraded":"2024-04-20T21:19:36.251112+0000","last_fullsized":"2024-04-20T21:19:36.251112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:49:21.426416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777896+0000","last_change":"2024-04-20T21:19:29.383743+0000","last_active":"2024-04-20T21:19:35.777896+0000","last_peered":"2024-04-20T21:19:35.777896+0000","last_clean":"2024-04-20T21:19:35.777896+0000","last_became_active":"2024-04-20T21:19:29.383451+0000","last_became_peered":"2024-04-20T21:19:29.383451+0000","last_unstale":"2024-04-20T21:19:35.777896+0000","last_undegraded":"2024-04-20T21:19:35.777896+0000","last_fullsized":"2024-04-20T21:19:35.777896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:21.125011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630668+0000","last_change":"2024-04-20T21:19:33.632955+0000","last_active":"2024-04-20T21:19:35.630668+0000","last_peered":"2024-04-20T21:19:35.630668+0000","last_clean":"2024-04-20T21:19:35.630668+0000","last_became_active":"2024-04-20T21:19:33.632418+0000","last_became_peered":"2024-04-20T21:19:33.632418+0000","last_unstale":"2024-04-20T21:19:35.630668+0000","last_undegraded":"2024-04-20T21:19:35.630668+0000","last_fullsized":"2024-04-20T21:19:35.630668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250671+0000","last_change":"2024-04-20T21:19:28.367835+0000","last_active":"2024-04-20T21:19:36.250671+0000","last_peered":"2024-04-20T21:19:36.250671+0000","last_clean":"2024-04-20T21:19:36.250671+0000","last_became_active":"2024-04-20T21:19:28.367516+0000","last_became_peered":"2024-04-20T21:19:28.367516+0000","last_unstale":"2024-04-20T21:19:36.250671+0000","last_undegraded":"2024-04-20T21:19:36.250671+0000","last_fullsized":"2024-04-20T21:19:36.250671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:03:38.483955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778252+0000","last_change":"2024-04-20T21:19:29.382022+0000","last_active":"2024-04-20T21:19:35.778252+0000","last_peered":"2024-04-20T21:19:35.778252+0000","last_clean":"2024-04-20T21:19:35.778252+0000","last_became_active":"2024-04-20T21:19:29.381441+0000","last_became_peered":"2024-04-20T21:19:29.381441+0000","last_unstale":"2024-04-20T21:19:35.778252+0000","last_undegraded":"2024-04-20T21:19:35.778252+0000","last_fullsized":"2024-04-20T21:19:35.778252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:10:56.546673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629810+0000","last_change":"2024-04-20T21:19:33.623830+0000","last_active":"2024-04-20T21:19:35.629810+0000","last_peered":"2024-04-20T21:19:35.629810+0000","last_clean":"2024-04-20T21:19:35.629810+0000","last_became_active":"2024-04-20T21:19:33.623367+0000","last_became_peered":"2024-04-20T21:19:33.623367+0000","last_unstale":"2024-04-20T21:19:35.629810+0000","last_undegraded":"2024-04-20T21:19:35.629810+0000","last_fullsized":"2024-04-20T21:19:35.629810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:35.626728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627137+0000","last_change":"2024-04-20T21:19:29.362406+0000","last_active":"2024-04-20T21:19:35.627137+0000","last_peered":"2024-04-20T21:19:35.627137+0000","last_clean":"2024-04-20T21:19:35.627137+0000","last_became_active":"2024-04-20T21:19:29.361949+0000","last_became_peered":"2024-04-20T21:19:29.361949+0000","last_unstale":"2024-04-20T21:19:35.627137+0000","last_undegraded":"2024-04-20T21:19:35.627137+0000","last_fullsized":"2024-04-20T21:19:35.627137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250473+0000","last_change":"2024-04-20T21:19:28.366445+0000","last_active":"2024-04-20T21:19:36.250473+0000","last_peered":"2024-04-20T21:19:36.250473+0000","last_clean":"2024-04-20T21:19:36.250473+0000","last_became_active":"2024-04-20T21:19:28.365983+0000","last_became_peered":"2024-04-20T21:19:28.365983+0000","last_unstale":"2024-04-20T21:19:36.250473+0000","last_undegraded":"2024-04-20T21:19:36.250473+0000","last_fullsized":"2024-04-20T21:19:36.250473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:19:13.843410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.632337+0000","last_change":"2024-04-20T21:19:33.633939+0000","last_active":"2024-04-20T21:19:35.632337+0000","last_peered":"2024-04-20T21:19:35.632337+0000","last_clean":"2024-04-20T21:19:35.632337+0000","last_became_active":"2024-04-20T21:19:33.633480+0000","last_became_peered":"2024-04-20T21:19:33.633480+0000","last_unstale":"2024-04-20T21:19:35.632337+0000","last_undegraded":"2024-04-20T21:19:35.632337+0000","last_fullsized":"2024-04-20T21:19:35.632337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622549+0000","last_change":"2024-04-20T21:19:29.396467+0000","last_active":"2024-04-20T21:19:35.622549+0000","last_peered":"2024-04-20T21:19:35.622549+0000","last_clean":"2024-04-20T21:19:35.622549+0000","last_became_active":"2024-04-20T21:19:29.396096+0000","last_became_peered":"2024-04-20T21:19:29.396096+0000","last_unstale":"2024-04-20T21:19:35.622549+0000","last_undegraded":"2024-04-20T21:19:35.622549+0000","last_fullsized":"2024-04-20T21:19:35.622549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248714+0000","last_change":"2024-04-20T21:19:28.354943+0000","last_active":"2024-04-20T21:19:36.248714+0000","last_peered":"2024-04-20T21:19:36.248714+0000","last_clean":"2024-04-20T21:19:36.248714+0000","last_became_active":"2024-04-20T21:19:28.354543+0000","last_became_peered":"2024-04-20T21:19:28.354543+0000","last_unstale":"2024-04-20T21:19:36.248714+0000","last_undegraded":"2024-04-20T21:19:36.248714+0000","last_fullsized":"2024-04-20T21:19:36.248714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631184+0000","last_change":"2024-04-20T21:19:33.630390+0000","last_active":"2024-04-20T21:19:35.631184+0000","last_peered":"2024-04-20T21:19:35.631184+0000","last_clean":"2024-04-20T21:19:35.631184+0000","last_became_active":"2024-04-20T21:19:33.629932+0000","last_became_peered":"2024-04-20T21:19:33.629932+0000","last_unstale":"2024-04-20T21:19:35.631184+0000","last_undegraded":"2024-04-20T21:19:35.631184+0000","last_fullsized":"2024-04-20T21:19:35.631184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621975+0000","last_change":"2024-04-20T21:19:29.389415+0000","last_active":"2024-04-20T21:19:35.621975+0000","last_peered":"2024-04-20T21:19:35.621975+0000","last_clean":"2024-04-20T21:19:35.621975+0000","last_became_active":"2024-04-20T21:19:29.381155+0000","last_became_peered":"2024-04-20T21:19:29.381155+0000","last_unstale":"2024-04-20T21:19:35.621975+0000","last_undegraded":"2024-04-20T21:19:35.621975+0000","last_fullsized":"2024-04-20T21:19:35.621975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249623+0000","last_change":"2024-04-20T21:19:28.364622+0000","last_active":"2024-04-20T21:19:36.249623+0000","last_peered":"2024-04-20T21:19:36.249623+0000","last_clean":"2024-04-20T21:19:36.249623+0000","last_became_active":"2024-04-20T21:19:28.364315+0000","last_became_peered":"2024-04-20T21:19:28.364315+0000","last_unstale":"2024-04-20T21:19:36.249623+0000","last_undegraded":"2024-04-20T21:19:36.249623+0000","last_fullsized":"2024-04-20T21:19:36.249623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:18.220229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248334+0000","last_change":"2024-04-20T21:19:34.113879+0000","last_active":"2024-04-20T21:19:36.248334+0000","last_peered":"2024-04-20T21:19:36.248334+0000","last_clean":"2024-04-20T21:19:36.248334+0000","last_became_active":"2024-04-20T21:19:34.112094+0000","last_became_peered":"2024-04-20T21:19:34.112094+0000","last_unstale":"2024-04-20T21:19:36.248334+0000","last_undegraded":"2024-04-20T21:19:36.248334+0000","last_fullsized":"2024-04-20T21:19:36.248334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629286+0000","last_change":"2024-04-20T21:19:29.380675+0000","last_active":"2024-04-20T21:19:35.629286+0000","last_peered":"2024-04-20T21:19:35.629286+0000","last_clean":"2024-04-20T21:19:35.629286+0000","last_became_active":"2024-04-20T21:19:29.380380+0000","last_became_peered":"2024-04-20T21:19:29.380380+0000","last_unstale":"2024-04-20T21:19:35.629286+0000","last_undegraded":"2024-04-20T21:19:35.629286+0000","last_fullsized":"2024-04-20T21:19:35.629286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:28.311170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249614+0000","last_change":"2024-04-20T21:19:28.368079+0000","last_active":"2024-04-20T21:19:36.249614+0000","last_peered":"2024-04-20T21:19:36.249614+0000","last_clean":"2024-04-20T21:19:36.249614+0000","last_became_active":"2024-04-20T21:19:28.367750+0000","last_became_peered":"2024-04-20T21:19:28.367750+0000","last_unstale":"2024-04-20T21:19:36.249614+0000","last_undegraded":"2024-04-20T21:19:36.249614+0000","last_fullsized":"2024-04-20T21:19:36.249614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:45.962672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630326+0000","last_change":"2024-04-20T21:19:33.631284+0000","last_active":"2024-04-20T21:19:35.630326+0000","last_peered":"2024-04-20T21:19:35.630326+0000","last_clean":"2024-04-20T21:19:35.630326+0000","last_became_active":"2024-04-20T21:19:33.630971+0000","last_became_peered":"2024-04-20T21:19:33.630971+0000","last_unstale":"2024-04-20T21:19:35.630326+0000","last_undegraded":"2024-04-20T21:19:35.630326+0000","last_fullsized":"2024-04-20T21:19:35.630326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:18:37.532799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249846+0000","last_change":"2024-04-20T21:19:29.391566+0000","last_active":"2024-04-20T21:19:36.249846+0000","last_peered":"2024-04-20T21:19:36.249846+0000","last_clean":"2024-04-20T21:19:36.249846+0000","last_became_active":"2024-04-20T21:19:29.391250+0000","last_became_peered":"2024-04-20T21:19:29.391250+0000","last_unstale":"2024-04-20T21:19:36.249846+0000","last_undegraded":"2024-04-20T21:19:36.249846+0000","last_fullsized":"2024-04-20T21:19:36.249846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628809+0000","last_change":"2024-04-20T21:19:28.364547+0000","last_active":"2024-04-20T21:19:35.628809+0000","last_peered":"2024-04-20T21:19:35.628809+0000","last_clean":"2024-04-20T21:19:35.628809+0000","last_became_active":"2024-04-20T21:19:28.364221+0000","last_became_peered":"2024-04-20T21:19:28.364221+0000","last_unstale":"2024-04-20T21:19:35.628809+0000","last_undegraded":"2024-04-20T21:19:35.628809+0000","last_fullsized":"2024-04-20T21:19:35.628809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628201+0000","last_change":"2024-04-20T21:19:34.113755+0000","last_active":"2024-04-20T21:19:35.628201+0000","last_peered":"2024-04-20T21:19:35.628201+0000","last_clean":"2024-04-20T21:19:35.628201+0000","last_became_active":"2024-04-20T21:19:34.112491+0000","last_became_peered":"2024-04-20T21:19:34.112491+0000","last_unstale":"2024-04-20T21:19:35.628201+0000","last_undegraded":"2024-04-20T21:19:35.628201+0000","last_fullsized":"2024-04-20T21:19:35.628201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:34.563292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623247+0000","last_change":"2024-04-20T21:19:29.398876+0000","last_active":"2024-04-20T21:19:35.623247+0000","last_peered":"2024-04-20T21:19:35.623247+0000","last_clean":"2024-04-20T21:19:35.623247+0000","last_became_active":"2024-04-20T21:19:29.398650+0000","last_became_peered":"2024-04-20T21:19:29.398650+0000","last_unstale":"2024-04-20T21:19:35.623247+0000","last_undegraded":"2024-04-20T21:19:35.623247+0000","last_fullsized":"2024-04-20T21:19:35.623247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249435+0000","last_change":"2024-04-20T21:19:28.360068+0000","last_active":"2024-04-20T21:19:36.249435+0000","last_peered":"2024-04-20T21:19:36.249435+0000","last_clean":"2024-04-20T21:19:36.249435+0000","last_became_active":"2024-04-20T21:19:28.359752+0000","last_became_peered":"2024-04-20T21:19:28.359752+0000","last_unstale":"2024-04-20T21:19:36.249435+0000","last_undegraded":"2024-04-20T21:19:36.249435+0000","last_fullsized":"2024-04-20T21:19:36.249435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:45.962672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622011+0000","last_change":"2024-04-20T21:19:34.104484+0000","last_active":"2024-04-20T21:19:35.622011+0000","last_peered":"2024-04-20T21:19:35.622011+0000","last_clean":"2024-04-20T21:19:35.622011+0000","last_became_active":"2024-04-20T21:19:34.103724+0000","last_became_peered":"2024-04-20T21:19:34.103724+0000","last_unstale":"2024-04-20T21:19:35.622011+0000","last_undegraded":"2024-04-20T21:19:35.622011+0000","last_fullsized":"2024-04-20T21:19:35.622011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:46:20.508257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248977+0000","last_change":"2024-04-20T21:19:29.383418+0000","last_active":"2024-04-20T21:19:36.248977+0000","last_peered":"2024-04-20T21:19:36.248977+0000","last_clean":"2024-04-20T21:19:36.248977+0000","last_became_active":"2024-04-20T21:19:29.383070+0000","last_became_peered":"2024-04-20T21:19:29.383070+0000","last_unstale":"2024-04-20T21:19:36.248977+0000","last_undegraded":"2024-04-20T21:19:36.248977+0000","last_fullsized":"2024-04-20T21:19:36.248977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251419+0000","last_change":"2024-04-20T21:19:28.368850+0000","last_active":"2024-04-20T21:19:36.251419+0000","last_peered":"2024-04-20T21:19:36.251419+0000","last_clean":"2024-04-20T21:19:36.251419+0000","last_became_active":"2024-04-20T21:19:28.368537+0000","last_became_peered":"2024-04-20T21:19:28.368537+0000","last_unstale":"2024-04-20T21:19:36.251419+0000","last_undegraded":"2024-04-20T21:19:36.251419+0000","last_fullsized":"2024-04-20T21:19:36.251419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:39:59.354904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248012+0000","last_change":"2024-04-20T21:19:34.104458+0000","last_active":"2024-04-20T21:19:36.248012+0000","last_peered":"2024-04-20T21:19:36.248012+0000","last_clean":"2024-04-20T21:19:36.248012+0000","last_became_active":"2024-04-20T21:19:34.103757+0000","last_became_peered":"2024-04-20T21:19:34.103757+0000","last_unstale":"2024-04-20T21:19:36.248012+0000","last_undegraded":"2024-04-20T21:19:36.248012+0000","last_fullsized":"2024-04-20T21:19:36.248012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778559+0000","last_change":"2024-04-20T21:19:29.397580+0000","last_active":"2024-04-20T21:19:35.778559+0000","last_peered":"2024-04-20T21:19:35.778559+0000","last_clean":"2024-04-20T21:19:35.778559+0000","last_became_active":"2024-04-20T21:19:29.396682+0000","last_became_peered":"2024-04-20T21:19:29.396682+0000","last_unstale":"2024-04-20T21:19:35.778559+0000","last_undegraded":"2024-04-20T21:19:35.778559+0000","last_fullsized":"2024-04-20T21:19:35.778559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:30.291536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249055+0000","last_change":"2024-04-20T21:19:28.355329+0000","last_active":"2024-04-20T21:19:36.249055+0000","last_peered":"2024-04-20T21:19:36.249055+0000","last_clean":"2024-04-20T21:19:36.249055+0000","last_became_active":"2024-04-20T21:19:28.354650+0000","last_became_peered":"2024-04-20T21:19:28.354650+0000","last_unstale":"2024-04-20T21:19:36.249055+0000","last_undegraded":"2024-04-20T21:19:36.249055+0000","last_fullsized":"2024-04-20T21:19:36.249055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248349+0000","last_change":"2024-04-20T21:19:33.629808+0000","last_active":"2024-04-20T21:19:36.248349+0000","last_peered":"2024-04-20T21:19:36.248349+0000","last_clean":"2024-04-20T21:19:36.248349+0000","last_became_active":"2024-04-20T21:19:33.628655+0000","last_became_peered":"2024-04-20T21:19:33.628655+0000","last_unstale":"2024-04-20T21:19:36.248349+0000","last_undegraded":"2024-04-20T21:19:36.248349+0000","last_fullsized":"2024-04-20T21:19:36.248349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631211+0000","last_change":"2024-04-20T21:19:29.369139+0000","last_active":"2024-04-20T21:19:35.631211+0000","last_peered":"2024-04-20T21:19:35.631211+0000","last_clean":"2024-04-20T21:19:35.631211+0000","last_became_active":"2024-04-20T21:19:29.368508+0000","last_became_peered":"2024-04-20T21:19:29.368508+0000","last_unstale":"2024-04-20T21:19:35.631211+0000","last_undegraded":"2024-04-20T21:19:35.631211+0000","last_fullsized":"2024-04-20T21:19:35.631211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:50.979376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777730+0000","last_change":"2024-04-20T21:19:28.361884+0000","last_active":"2024-04-20T21:19:35.777730+0000","last_peered":"2024-04-20T21:19:35.777730+0000","last_clean":"2024-04-20T21:19:35.777730+0000","last_became_active":"2024-04-20T21:19:28.361455+0000","last_became_peered":"2024-04-20T21:19:28.361455+0000","last_unstale":"2024-04-20T21:19:35.777730+0000","last_undegraded":"2024-04-20T21:19:35.777730+0000","last_fullsized":"2024-04-20T21:19:35.777730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248902+0000","last_change":"2024-04-20T21:19:33.628385+0000","last_active":"2024-04-20T21:19:36.248902+0000","last_peered":"2024-04-20T21:19:36.248902+0000","last_clean":"2024-04-20T21:19:36.248902+0000","last_became_active":"2024-04-20T21:19:33.627925+0000","last_became_peered":"2024-04-20T21:19:33.627925+0000","last_unstale":"2024-04-20T21:19:36.248902+0000","last_undegraded":"2024-04-20T21:19:36.248902+0000","last_fullsized":"2024-04-20T21:19:36.248902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247403+0000","last_change":"2024-04-20T21:19:29.383757+0000","last_active":"2024-04-20T21:19:36.247403+0000","last_peered":"2024-04-20T21:19:36.247403+0000","last_clean":"2024-04-20T21:19:36.247403+0000","last_became_active":"2024-04-20T21:19:29.383265+0000","last_became_peered":"2024-04-20T21:19:29.383265+0000","last_unstale":"2024-04-20T21:19:36.247403+0000","last_undegraded":"2024-04-20T21:19:36.247403+0000","last_fullsized":"2024-04-20T21:19:36.247403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249184+0000","last_change":"2024-04-20T21:19:28.333272+0000","last_active":"2024-04-20T21:19:36.249184+0000","last_peered":"2024-04-20T21:19:36.249184+0000","last_clean":"2024-04-20T21:19:36.249184+0000","last_became_active":"2024-04-20T21:19:28.332869+0000","last_became_peered":"2024-04-20T21:19:28.332869+0000","last_unstale":"2024-04-20T21:19:36.249184+0000","last_undegraded":"2024-04-20T21:19:36.249184+0000","last_fullsized":"2024-04-20T21:19:36.249184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248513+0000","last_change":"2024-04-20T21:19:33.629923+0000","last_active":"2024-04-20T21:19:36.248513+0000","last_peered":"2024-04-20T21:19:36.248513+0000","last_clean":"2024-04-20T21:19:36.248513+0000","last_became_active":"2024-04-20T21:19:33.627690+0000","last_became_peered":"2024-04-20T21:19:33.627690+0000","last_unstale":"2024-04-20T21:19:36.248513+0000","last_undegraded":"2024-04-20T21:19:36.248513+0000","last_fullsized":"2024-04-20T21:19:36.248513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247676+0000","last_change":"2024-04-20T21:19:29.361370+0000","last_active":"2024-04-20T21:19:36.247676+0000","last_peered":"2024-04-20T21:19:36.247676+0000","last_clean":"2024-04-20T21:19:36.247676+0000","last_became_active":"2024-04-20T21:19:29.360654+0000","last_became_peered":"2024-04-20T21:19:29.360654+0000","last_unstale":"2024-04-20T21:19:36.247676+0000","last_undegraded":"2024-04-20T21:19:36.247676+0000","last_fullsized":"2024-04-20T21:19:36.247676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:08:35.086557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249697+0000","last_change":"2024-04-20T21:19:28.367397+0000","last_active":"2024-04-20T21:19:36.249697+0000","last_peered":"2024-04-20T21:19:36.249697+0000","last_clean":"2024-04-20T21:19:36.249697+0000","last_became_active":"2024-04-20T21:19:28.367133+0000","last_became_peered":"2024-04-20T21:19:28.367133+0000","last_unstale":"2024-04-20T21:19:36.249697+0000","last_undegraded":"2024-04-20T21:19:36.249697+0000","last_fullsized":"2024-04-20T21:19:36.249697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:18.220229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249641+0000","last_change":"2024-04-20T21:19:34.117121+0000","last_active":"2024-04-20T21:19:36.249641+0000","last_peered":"2024-04-20T21:19:36.249641+0000","last_clean":"2024-04-20T21:19:36.249641+0000","last_became_active":"2024-04-20T21:19:34.116147+0000","last_became_peered":"2024-04-20T21:19:34.116147+0000","last_unstale":"2024-04-20T21:19:36.249641+0000","last_undegraded":"2024-04-20T21:19:36.249641+0000","last_fullsized":"2024-04-20T21:19:36.249641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621863+0000","last_change":"2024-04-20T21:19:29.396033+0000","last_active":"2024-04-20T21:19:35.621863+0000","last_peered":"2024-04-20T21:19:35.621863+0000","last_clean":"2024-04-20T21:19:35.621863+0000","last_became_active":"2024-04-20T21:19:29.395741+0000","last_became_peered":"2024-04-20T21:19:29.395741+0000","last_unstale":"2024-04-20T21:19:35.621863+0000","last_undegraded":"2024-04-20T21:19:35.621863+0000","last_fullsized":"2024-04-20T21:19:35.621863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777536+0000","last_change":"2024-04-20T21:19:28.352100+0000","last_active":"2024-04-20T21:19:35.777536+0000","last_peered":"2024-04-20T21:19:35.777536+0000","last_clean":"2024-04-20T21:19:35.777536+0000","last_became_active":"2024-04-20T21:19:28.351795+0000","last_became_peered":"2024-04-20T21:19:28.351795+0000","last_unstale":"2024-04-20T21:19:35.777536+0000","last_undegraded":"2024-04-20T21:19:35.777536+0000","last_fullsized":"2024-04-20T21:19:35.777536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249911+0000","last_change":"2024-04-20T21:19:19.292405+0000","last_active":"2024-04-20T21:19:36.249911+0000","last_peered":"2024-04-20T21:19:36.249911+0000","last_clean":"2024-04-20T21:19:36.249911+0000","last_became_active":"2024-04-20T21:19:19.290107+0000","last_became_peered":"2024-04-20T21:19:19.290107+0000","last_unstale":"2024-04-20T21:19:36.249911+0000","last_undegraded":"2024-04-20T21:19:36.249911+0000","last_fullsized":"2024-04-20T21:19:36.249911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_clean_scrub_stamp":"2024-04-20T21:19:18.230829+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:48:44.146278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627341+0000","last_change":"2024-04-20T21:19:34.118317+0000","last_active":"2024-04-20T21:19:35.627341+0000","last_peered":"2024-04-20T21:19:35.627341+0000","last_clean":"2024-04-20T21:19:35.627341+0000","last_became_active":"2024-04-20T21:19:34.114435+0000","last_became_peered":"2024-04-20T21:19:34.114435+0000","last_unstale":"2024-04-20T21:19:35.627341+0000","last_undegraded":"2024-04-20T21:19:35.627341+0000","last_fullsized":"2024-04-20T21:19:35.627341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:11:00.818429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250762+0000","last_change":"2024-04-20T21:19:29.393324+0000","last_active":"2024-04-20T21:19:36.250762+0000","last_peered":"2024-04-20T21:19:36.250762+0000","last_clean":"2024-04-20T21:19:36.250762+0000","last_became_active":"2024-04-20T21:19:29.393007+0000","last_became_peered":"2024-04-20T21:19:29.393007+0000","last_unstale":"2024-04-20T21:19:36.250762+0000","last_undegraded":"2024-04-20T21:19:36.250762+0000","last_fullsized":"2024-04-20T21:19:36.250762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:30.291536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249830+0000","last_change":"2024-04-20T21:19:28.351503+0000","last_active":"2024-04-20T21:19:36.249830+0000","last_peered":"2024-04-20T21:19:36.249830+0000","last_clean":"2024-04-20T21:19:36.249830+0000","last_became_active":"2024-04-20T21:19:28.351160+0000","last_became_peered":"2024-04-20T21:19:28.351160+0000","last_unstale":"2024-04-20T21:19:36.249830+0000","last_undegraded":"2024-04-20T21:19:36.249830+0000","last_fullsized":"2024-04-20T21:19:36.249830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627263+0000","last_change":"2024-04-20T21:19:34.110398+0000","last_active":"2024-04-20T21:19:35.627263+0000","last_peered":"2024-04-20T21:19:35.627263+0000","last_clean":"2024-04-20T21:19:35.627263+0000","last_became_active":"2024-04-20T21:19:34.105383+0000","last_became_peered":"2024-04-20T21:19:34.105383+0000","last_unstale":"2024-04-20T21:19:35.627263+0000","last_undegraded":"2024-04-20T21:19:35.627263+0000","last_fullsized":"2024-04-20T21:19:35.627263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:25.396766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778001+0000","last_change":"2024-04-20T21:19:29.397544+0000","last_active":"2024-04-20T21:19:35.778001+0000","last_peered":"2024-04-20T21:19:35.778001+0000","last_clean":"2024-04-20T21:19:35.778001+0000","last_became_active":"2024-04-20T21:19:29.396795+0000","last_became_peered":"2024-04-20T21:19:29.396795+0000","last_unstale":"2024-04-20T21:19:35.778001+0000","last_undegraded":"2024-04-20T21:19:35.778001+0000","last_fullsized":"2024-04-20T21:19:35.778001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:31.354972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247918+0000","last_change":"2024-04-20T21:19:28.356719+0000","last_active":"2024-04-20T21:19:36.247918+0000","last_peered":"2024-04-20T21:19:36.247918+0000","last_clean":"2024-04-20T21:19:36.247918+0000","last_became_active":"2024-04-20T21:19:28.356151+0000","last_became_peered":"2024-04-20T21:19:28.356151+0000","last_unstale":"2024-04-20T21:19:36.247918+0000","last_undegraded":"2024-04-20T21:19:36.247918+0000","last_fullsized":"2024-04-20T21:19:36.247918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248274+0000","last_change":"2024-04-20T21:19:33.633098+0000","last_active":"2024-04-20T21:19:36.248274+0000","last_peered":"2024-04-20T21:19:36.248274+0000","last_clean":"2024-04-20T21:19:36.248274+0000","last_became_active":"2024-04-20T21:19:33.632668+0000","last_became_peered":"2024-04-20T21:19:33.632668+0000","last_unstale":"2024-04-20T21:19:36.248274+0000","last_undegraded":"2024-04-20T21:19:36.248274+0000","last_fullsized":"2024-04-20T21:19:36.248274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251856+0000","last_change":"2024-04-20T21:19:29.390579+0000","last_active":"2024-04-20T21:19:36.251856+0000","last_peered":"2024-04-20T21:19:36.251856+0000","last_clean":"2024-04-20T21:19:36.251856+0000","last_became_active":"2024-04-20T21:19:29.389845+0000","last_became_peered":"2024-04-20T21:19:29.389845+0000","last_unstale":"2024-04-20T21:19:36.251856+0000","last_undegraded":"2024-04-20T21:19:36.251856+0000","last_fullsized":"2024-04-20T21:19:36.251856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.785469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249746+0000","last_change":"2024-04-20T21:19:28.337225+0000","last_active":"2024-04-20T21:19:36.249746+0000","last_peered":"2024-04-20T21:19:36.249746+0000","last_clean":"2024-04-20T21:19:36.249746+0000","last_became_active":"2024-04-20T21:19:28.336562+0000","last_became_peered":"2024-04-20T21:19:28.336562+0000","last_unstale":"2024-04-20T21:19:36.249746+0000","last_undegraded":"2024-04-20T21:19:36.249746+0000","last_fullsized":"2024-04-20T21:19:36.249746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.776960+0000","last_change":"2024-04-20T21:19:34.106520+0000","last_active":"2024-04-20T21:19:35.776960+0000","last_peered":"2024-04-20T21:19:35.776960+0000","last_clean":"2024-04-20T21:19:35.776960+0000","last_became_active":"2024-04-20T21:19:34.105183+0000","last_became_peered":"2024-04-20T21:19:34.105183+0000","last_unstale":"2024-04-20T21:19:35.776960+0000","last_undegraded":"2024-04-20T21:19:35.776960+0000","last_fullsized":"2024-04-20T21:19:35.776960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251226+0000","last_change":"2024-04-20T21:19:29.388099+0000","last_active":"2024-04-20T21:19:36.251226+0000","last_peered":"2024-04-20T21:19:36.251226+0000","last_clean":"2024-04-20T21:19:36.251226+0000","last_became_active":"2024-04-20T21:19:29.387720+0000","last_became_peered":"2024-04-20T21:19:29.387720+0000","last_unstale":"2024-04-20T21:19:36.251226+0000","last_undegraded":"2024-04-20T21:19:36.251226+0000","last_fullsized":"2024-04-20T21:19:36.251226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:10:56.546673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630817+0000","last_change":"2024-04-20T21:19:28.351346+0000","last_active":"2024-04-20T21:19:35.630817+0000","last_peered":"2024-04-20T21:19:35.630817+0000","last_clean":"2024-04-20T21:19:35.630817+0000","last_became_active":"2024-04-20T21:19:28.350181+0000","last_became_peered":"2024-04-20T21:19:28.350181+0000","last_unstale":"2024-04-20T21:19:35.630817+0000","last_undegraded":"2024-04-20T21:19:35.630817+0000","last_fullsized":"2024-04-20T21:19:35.630817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:28:58.801546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627521+0000","last_change":"2024-04-20T21:19:33.633495+0000","last_active":"2024-04-20T21:19:35.627521+0000","last_peered":"2024-04-20T21:19:35.627521+0000","last_clean":"2024-04-20T21:19:35.627521+0000","last_became_active":"2024-04-20T21:19:33.632961+0000","last_became_peered":"2024-04-20T21:19:33.632961+0000","last_unstale":"2024-04-20T21:19:35.627521+0000","last_undegraded":"2024-04-20T21:19:35.627521+0000","last_fullsized":"2024-04-20T21:19:35.627521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:11:00.818429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249980+0000","last_change":"2024-04-20T21:19:29.386658+0000","last_active":"2024-04-20T21:19:36.249980+0000","last_peered":"2024-04-20T21:19:36.249980+0000","last_clean":"2024-04-20T21:19:36.249980+0000","last_became_active":"2024-04-20T21:19:29.385316+0000","last_became_peered":"2024-04-20T21:19:29.385316+0000","last_unstale":"2024-04-20T21:19:36.249980+0000","last_undegraded":"2024-04-20T21:19:36.249980+0000","last_fullsized":"2024-04-20T21:19:36.249980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248902+0000","last_change":"2024-04-20T21:19:28.346894+0000","last_active":"2024-04-20T21:19:36.248902+0000","last_peered":"2024-04-20T21:19:36.248902+0000","last_clean":"2024-04-20T21:19:36.248902+0000","last_became_active":"2024-04-20T21:19:28.346501+0000","last_became_peered":"2024-04-20T21:19:28.346501+0000","last_unstale":"2024-04-20T21:19:36.248902+0000","last_undegraded":"2024-04-20T21:19:36.248902+0000","last_fullsized":"2024-04-20T21:19:36.248902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249377+0000","last_change":"2024-04-20T21:19:33.624256+0000","last_active":"2024-04-20T21:19:36.249377+0000","last_peered":"2024-04-20T21:19:36.249377+0000","last_clean":"2024-04-20T21:19:36.249377+0000","last_became_active":"2024-04-20T21:19:33.623535+0000","last_became_peered":"2024-04-20T21:19:33.623535+0000","last_unstale":"2024-04-20T21:19:36.249377+0000","last_undegraded":"2024-04-20T21:19:36.249377+0000","last_fullsized":"2024-04-20T21:19:36.249377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626744+0000","last_change":"2024-04-20T21:19:29.365502+0000","last_active":"2024-04-20T21:19:35.626744+0000","last_peered":"2024-04-20T21:19:35.626744+0000","last_clean":"2024-04-20T21:19:35.626744+0000","last_became_active":"2024-04-20T21:19:29.364467+0000","last_became_peered":"2024-04-20T21:19:29.364467+0000","last_unstale":"2024-04-20T21:19:35.626744+0000","last_undegraded":"2024-04-20T21:19:35.626744+0000","last_fullsized":"2024-04-20T21:19:35.626744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626909+0000","last_change":"2024-04-20T21:19:28.344379+0000","last_active":"2024-04-20T21:19:35.626909+0000","last_peered":"2024-04-20T21:19:35.626909+0000","last_clean":"2024-04-20T21:19:35.626909+0000","last_became_active":"2024-04-20T21:19:28.343961+0000","last_became_peered":"2024-04-20T21:19:28.343961+0000","last_unstale":"2024-04-20T21:19:35.626909+0000","last_undegraded":"2024-04-20T21:19:35.626909+0000","last_fullsized":"2024-04-20T21:19:35.626909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623180+0000","last_change":"2024-04-20T21:19:34.117654+0000","last_active":"2024-04-20T21:19:35.623180+0000","last_peered":"2024-04-20T21:19:35.623180+0000","last_clean":"2024-04-20T21:19:35.623180+0000","last_became_active":"2024-04-20T21:19:34.116853+0000","last_became_peered":"2024-04-20T21:19:34.116853+0000","last_unstale":"2024-04-20T21:19:35.623180+0000","last_undegraded":"2024-04-20T21:19:35.623180+0000","last_fullsized":"2024-04-20T21:19:35.623180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:52:51.896627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250332+0000","last_change":"2024-04-20T21:19:29.382869+0000","last_active":"2024-04-20T21:19:36.250332+0000","last_peered":"2024-04-20T21:19:36.250332+0000","last_clean":"2024-04-20T21:19:36.250332+0000","last_became_active":"2024-04-20T21:19:29.382468+0000","last_became_peered":"2024-04-20T21:19:29.382468+0000","last_unstale":"2024-04-20T21:19:36.250332+0000","last_undegraded":"2024-04-20T21:19:36.250332+0000","last_fullsized":"2024-04-20T21:19:36.250332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:21.125011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777629+0000","last_change":"2024-04-20T21:19:28.357934+0000","last_active":"2024-04-20T21:19:35.777629+0000","last_peered":"2024-04-20T21:19:35.777629+0000","last_clean":"2024-04-20T21:19:35.777629+0000","last_became_active":"2024-04-20T21:19:28.357449+0000","last_became_peered":"2024-04-20T21:19:28.357449+0000","last_unstale":"2024-04-20T21:19:35.777629+0000","last_undegraded":"2024-04-20T21:19:35.777629+0000","last_fullsized":"2024-04-20T21:19:35.777629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622808+0000","last_change":"2024-04-20T21:19:34.105481+0000","last_active":"2024-04-20T21:19:35.622808+0000","last_peered":"2024-04-20T21:19:35.622808+0000","last_clean":"2024-04-20T21:19:35.622808+0000","last_became_active":"2024-04-20T21:19:34.104398+0000","last_became_peered":"2024-04-20T21:19:34.104398+0000","last_unstale":"2024-04-20T21:19:35.622808+0000","last_undegraded":"2024-04-20T21:19:35.622808+0000","last_fullsized":"2024-04-20T21:19:35.622808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:00:47.266412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248125+0000","last_change":"2024-04-20T21:19:29.387882+0000","last_active":"2024-04-20T21:19:36.248125+0000","last_peered":"2024-04-20T21:19:36.248125+0000","last_clean":"2024-04-20T21:19:36.248125+0000","last_became_active":"2024-04-20T21:19:29.387548+0000","last_became_peered":"2024-04-20T21:19:29.387548+0000","last_unstale":"2024-04-20T21:19:36.248125+0000","last_undegraded":"2024-04-20T21:19:36.248125+0000","last_fullsized":"2024-04-20T21:19:36.248125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:33:55.067533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248579+0000","last_change":"2024-04-20T21:19:28.350496+0000","last_active":"2024-04-20T21:19:36.248579+0000","last_peered":"2024-04-20T21:19:36.248579+0000","last_clean":"2024-04-20T21:19:36.248579+0000","last_became_active":"2024-04-20T21:19:28.350170+0000","last_became_peered":"2024-04-20T21:19:28.350170+0000","last_unstale":"2024-04-20T21:19:36.248579+0000","last_undegraded":"2024-04-20T21:19:36.248579+0000","last_fullsized":"2024-04-20T21:19:36.248579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:12:37.534140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778364+0000","last_change":"2024-04-20T21:19:34.117079+0000","last_active":"2024-04-20T21:19:35.778364+0000","last_peered":"2024-04-20T21:19:35.778364+0000","last_clean":"2024-04-20T21:19:35.778364+0000","last_became_active":"2024-04-20T21:19:34.116404+0000","last_became_peered":"2024-04-20T21:19:34.116404+0000","last_unstale":"2024-04-20T21:19:35.778364+0000","last_undegraded":"2024-04-20T21:19:35.778364+0000","last_fullsized":"2024-04-20T21:19:35.778364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:26:28.450644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250605+0000","last_change":"2024-04-20T21:19:29.378275+0000","last_active":"2024-04-20T21:19:36.250605+0000","last_peered":"2024-04-20T21:19:36.250605+0000","last_clean":"2024-04-20T21:19:36.250605+0000","last_became_active":"2024-04-20T21:19:29.377896+0000","last_became_peered":"2024-04-20T21:19:29.377896+0000","last_unstale":"2024-04-20T21:19:36.250605+0000","last_undegraded":"2024-04-20T21:19:36.250605+0000","last_fullsized":"2024-04-20T21:19:36.250605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:18:33.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:48.859685+0000","last_change":"2024-04-20T21:19:28.357217+0000","last_active":"2024-04-20T21:19:48.859685+0000","last_peered":"2024-04-20T21:19:48.859685+0000","last_clean":"2024-04-20T21:19:48.859685+0000","last_became_active":"2024-04-20T21:19:28.356914+0000","last_became_peered":"2024-04-20T21:19:28.356914+0000","last_unstale":"2024-04-20T21:19:48.859685+0000","last_undegraded":"2024-04-20T21:19:48.859685+0000","last_fullsized":"2024-04-20T21:19:48.859685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248585+0000","last_change":"2024-04-20T21:19:33.629911+0000","last_active":"2024-04-20T21:19:36.248585+0000","last_peered":"2024-04-20T21:19:36.248585+0000","last_clean":"2024-04-20T21:19:36.248585+0000","last_became_active":"2024-04-20T21:19:33.627809+0000","last_became_peered":"2024-04-20T21:19:33.627809+0000","last_unstale":"2024-04-20T21:19:36.248585+0000","last_undegraded":"2024-04-20T21:19:36.248585+0000","last_fullsized":"2024-04-20T21:19:36.248585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631585+0000","last_change":"2024-04-20T21:19:29.393393+0000","last_active":"2024-04-20T21:19:35.631585+0000","last_peered":"2024-04-20T21:19:35.631585+0000","last_clean":"2024-04-20T21:19:35.631585+0000","last_became_active":"2024-04-20T21:19:29.390071+0000","last_became_peered":"2024-04-20T21:19:29.390071+0000","last_unstale":"2024-04-20T21:19:35.631585+0000","last_undegraded":"2024-04-20T21:19:35.631585+0000","last_fullsized":"2024-04-20T21:19:35.631585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:46.967851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247809+0000","last_change":"2024-04-20T21:19:28.356567+0000","last_active":"2024-04-20T21:19:36.247809+0000","last_peered":"2024-04-20T21:19:36.247809+0000","last_clean":"2024-04-20T21:19:36.247809+0000","last_became_active":"2024-04-20T21:19:28.355822+0000","last_became_peered":"2024-04-20T21:19:28.355822+0000","last_unstale":"2024-04-20T21:19:36.247809+0000","last_undegraded":"2024-04-20T21:19:36.247809+0000","last_fullsized":"2024-04-20T21:19:36.247809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630778+0000","last_change":"2024-04-20T21:19:33.630542+0000","last_active":"2024-04-20T21:19:35.630778+0000","last_peered":"2024-04-20T21:19:35.630778+0000","last_clean":"2024-04-20T21:19:35.630778+0000","last_became_active":"2024-04-20T21:19:33.630162+0000","last_became_peered":"2024-04-20T21:19:33.630162+0000","last_unstale":"2024-04-20T21:19:35.630778+0000","last_undegraded":"2024-04-20T21:19:35.630778+0000","last_fullsized":"2024-04-20T21:19:35.630778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250252+0000","last_change":"2024-04-20T21:19:29.381811+0000","last_active":"2024-04-20T21:19:36.250252+0000","last_peered":"2024-04-20T21:19:36.250252+0000","last_clean":"2024-04-20T21:19:36.250252+0000","last_became_active":"2024-04-20T21:19:29.381476+0000","last_became_peered":"2024-04-20T21:19:29.381476+0000","last_unstale":"2024-04-20T21:19:36.250252+0000","last_undegraded":"2024-04-20T21:19:36.250252+0000","last_fullsized":"2024-04-20T21:19:36.250252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778382+0000","last_change":"2024-04-20T21:19:28.362269+0000","last_active":"2024-04-20T21:19:35.778382+0000","last_peered":"2024-04-20T21:19:35.778382+0000","last_clean":"2024-04-20T21:19:35.778382+0000","last_became_active":"2024-04-20T21:19:28.361977+0000","last_became_peered":"2024-04-20T21:19:28.361977+0000","last_unstale":"2024-04-20T21:19:35.778382+0000","last_undegraded":"2024-04-20T21:19:35.778382+0000","last_fullsized":"2024-04-20T21:19:35.778382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621838+0000","last_change":"2024-04-20T21:19:33.628173+0000","last_active":"2024-04-20T21:19:35.621838+0000","last_peered":"2024-04-20T21:19:35.621838+0000","last_clean":"2024-04-20T21:19:35.621838+0000","last_became_active":"2024-04-20T21:19:33.627775+0000","last_became_peered":"2024-04-20T21:19:33.627775+0000","last_unstale":"2024-04-20T21:19:35.621838+0000","last_undegraded":"2024-04-20T21:19:35.621838+0000","last_fullsized":"2024-04-20T21:19:35.621838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:10:39.630401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778156+0000","last_change":"2024-04-20T21:19:29.395176+0000","last_active":"2024-04-20T21:19:35.778156+0000","last_peered":"2024-04-20T21:19:35.778156+0000","last_clean":"2024-04-20T21:19:35.778156+0000","last_became_active":"2024-04-20T21:19:29.394888+0000","last_became_peered":"2024-04-20T21:19:29.394888+0000","last_unstale":"2024-04-20T21:19:35.778156+0000","last_undegraded":"2024-04-20T21:19:35.778156+0000","last_fullsized":"2024-04-20T21:19:35.778156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:04:32.875201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628548+0000","last_change":"2024-04-20T21:19:28.365114+0000","last_active":"2024-04-20T21:19:35.628548+0000","last_peered":"2024-04-20T21:19:35.628548+0000","last_clean":"2024-04-20T21:19:35.628548+0000","last_became_active":"2024-04-20T21:19:28.364582+0000","last_became_peered":"2024-04-20T21:19:28.364582+0000","last_unstale":"2024-04-20T21:19:35.628548+0000","last_undegraded":"2024-04-20T21:19:35.628548+0000","last_fullsized":"2024-04-20T21:19:35.628548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622261+0000","last_change":"2024-04-20T21:19:34.106093+0000","last_active":"2024-04-20T21:19:35.622261+0000","last_peered":"2024-04-20T21:19:35.622261+0000","last_clean":"2024-04-20T21:19:35.622261+0000","last_became_active":"2024-04-20T21:19:34.104164+0000","last_became_peered":"2024-04-20T21:19:34.104164+0000","last_unstale":"2024-04-20T21:19:35.622261+0000","last_undegraded":"2024-04-20T21:19:35.622261+0000","last_fullsized":"2024-04-20T21:19:35.622261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:59:46.407601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249367+0000","last_change":"2024-04-20T21:19:34.114115+0000","last_active":"2024-04-20T21:19:36.249367+0000","last_peered":"2024-04-20T21:19:36.249367+0000","last_clean":"2024-04-20T21:19:36.249367+0000","last_became_active":"2024-04-20T21:19:34.113101+0000","last_became_peered":"2024-04-20T21:19:34.113101+0000","last_unstale":"2024-04-20T21:19:36.249367+0000","last_undegraded":"2024-04-20T21:19:36.249367+0000","last_fullsized":"2024-04-20T21:19:36.249367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247565+0000","last_change":"2024-04-20T21:19:29.393883+0000","last_active":"2024-04-20T21:19:36.247565+0000","last_peered":"2024-04-20T21:19:36.247565+0000","last_clean":"2024-04-20T21:19:36.247565+0000","last_became_active":"2024-04-20T21:19:29.386937+0000","last_became_peered":"2024-04-20T21:19:29.386937+0000","last_unstale":"2024-04-20T21:19:36.247565+0000","last_undegraded":"2024-04-20T21:19:36.247565+0000","last_fullsized":"2024-04-20T21:19:36.247565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777355+0000","last_change":"2024-04-20T21:19:28.354817+0000","last_active":"2024-04-20T21:19:35.777355+0000","last_peered":"2024-04-20T21:19:35.777355+0000","last_clean":"2024-04-20T21:19:35.777355+0000","last_became_active":"2024-04-20T21:19:28.354434+0000","last_became_peered":"2024-04-20T21:19:28.354434+0000","last_unstale":"2024-04-20T21:19:35.777355+0000","last_undegraded":"2024-04-20T21:19:35.777355+0000","last_fullsized":"2024-04-20T21:19:35.777355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628259+0000","last_change":"2024-04-20T21:19:33.633277+0000","last_active":"2024-04-20T21:19:35.628259+0000","last_peered":"2024-04-20T21:19:35.628259+0000","last_clean":"2024-04-20T21:19:35.628259+0000","last_became_active":"2024-04-20T21:19:33.632836+0000","last_became_peered":"2024-04-20T21:19:33.632836+0000","last_unstale":"2024-04-20T21:19:35.628259+0000","last_undegraded":"2024-04-20T21:19:35.628259+0000","last_fullsized":"2024-04-20T21:19:35.628259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:34.563292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621917+0000","last_change":"2024-04-20T21:19:29.398015+0000","last_active":"2024-04-20T21:19:35.621917+0000","last_peered":"2024-04-20T21:19:35.621917+0000","last_clean":"2024-04-20T21:19:35.621917+0000","last_became_active":"2024-04-20T21:19:29.395864+0000","last_became_peered":"2024-04-20T21:19:29.395864+0000","last_unstale":"2024-04-20T21:19:35.621917+0000","last_undegraded":"2024-04-20T21:19:35.621917+0000","last_fullsized":"2024-04-20T21:19:35.621917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622466+0000","last_change":"2024-04-20T21:19:28.344162+0000","last_active":"2024-04-20T21:19:35.622466+0000","last_peered":"2024-04-20T21:19:35.622466+0000","last_clean":"2024-04-20T21:19:35.622466+0000","last_became_active":"2024-04-20T21:19:28.343750+0000","last_became_peered":"2024-04-20T21:19:28.343750+0000","last_unstale":"2024-04-20T21:19:35.622466+0000","last_undegraded":"2024-04-20T21:19:35.622466+0000","last_fullsized":"2024-04-20T21:19:35.622466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627612+0000","last_change":"2024-04-20T21:19:28.351320+0000","last_active":"2024-04-20T21:19:35.627612+0000","last_peered":"2024-04-20T21:19:35.627612+0000","last_clean":"2024-04-20T21:19:35.627612+0000","last_became_active":"2024-04-20T21:19:28.350995+0000","last_became_peered":"2024-04-20T21:19:28.350995+0000","last_unstale":"2024-04-20T21:19:35.627612+0000","last_undegraded":"2024-04-20T21:19:35.627612+0000","last_fullsized":"2024-04-20T21:19:35.627612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248483+0000","last_change":"2024-04-20T21:19:29.362059+0000","last_active":"2024-04-20T21:19:36.248483+0000","last_peered":"2024-04-20T21:19:36.248483+0000","last_clean":"2024-04-20T21:19:36.248483+0000","last_became_active":"2024-04-20T21:19:29.361382+0000","last_became_peered":"2024-04-20T21:19:29.361382+0000","last_unstale":"2024-04-20T21:19:36.248483+0000","last_undegraded":"2024-04-20T21:19:36.248483+0000","last_fullsized":"2024-04-20T21:19:36.248483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249695+0000","last_change":"2024-04-20T21:19:33.628104+0000","last_active":"2024-04-20T21:19:36.249695+0000","last_peered":"2024-04-20T21:19:36.249695+0000","last_clean":"2024-04-20T21:19:36.249695+0000","last_became_active":"2024-04-20T21:19:33.627676+0000","last_became_peered":"2024-04-20T21:19:33.627676+0000","last_unstale":"2024-04-20T21:19:36.249695+0000","last_undegraded":"2024-04-20T21:19:36.249695+0000","last_fullsized":"2024-04-20T21:19:36.249695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:08:39.358313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622581+0000","last_change":"2024-04-20T21:19:28.365916+0000","last_active":"2024-04-20T21:19:35.622581+0000","last_peered":"2024-04-20T21:19:35.622581+0000","last_clean":"2024-04-20T21:19:35.622581+0000","last_became_active":"2024-04-20T21:19:28.365502+0000","last_became_peered":"2024-04-20T21:19:28.365502+0000","last_unstale":"2024-04-20T21:19:35.622581+0000","last_undegraded":"2024-04-20T21:19:35.622581+0000","last_fullsized":"2024-04-20T21:19:35.622581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629989+0000","last_change":"2024-04-20T21:19:29.387418+0000","last_active":"2024-04-20T21:19:35.629989+0000","last_peered":"2024-04-20T21:19:35.629989+0000","last_clean":"2024-04-20T21:19:35.629989+0000","last_became_active":"2024-04-20T21:19:29.387044+0000","last_became_peered":"2024-04-20T21:19:29.387044+0000","last_unstale":"2024-04-20T21:19:35.629989+0000","last_undegraded":"2024-04-20T21:19:35.629989+0000","last_fullsized":"2024-04-20T21:19:35.629989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:29.867631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622991+0000","last_change":"2024-04-20T21:19:33.633365+0000","last_active":"2024-04-20T21:19:35.622991+0000","last_peered":"2024-04-20T21:19:35.622991+0000","last_clean":"2024-04-20T21:19:35.622991+0000","last_became_active":"2024-04-20T21:19:33.631294+0000","last_became_peered":"2024-04-20T21:19:33.631294+0000","last_unstale":"2024-04-20T21:19:35.622991+0000","last_undegraded":"2024-04-20T21:19:35.622991+0000","last_fullsized":"2024-04-20T21:19:35.622991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:44.969195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626471+0000","last_change":"2024-04-20T21:19:29.374532+0000","last_active":"2024-04-20T21:19:35.626471+0000","last_peered":"2024-04-20T21:19:35.626471+0000","last_clean":"2024-04-20T21:19:35.626471+0000","last_became_active":"2024-04-20T21:19:29.370664+0000","last_became_peered":"2024-04-20T21:19:29.370664+0000","last_unstale":"2024-04-20T21:19:35.626471+0000","last_undegraded":"2024-04-20T21:19:35.626471+0000","last_fullsized":"2024-04-20T21:19:35.626471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249094+0000","last_change":"2024-04-20T21:19:29.391603+0000","last_active":"2024-04-20T21:19:36.249094+0000","last_peered":"2024-04-20T21:19:36.249094+0000","last_clean":"2024-04-20T21:19:36.249094+0000","last_became_active":"2024-04-20T21:19:29.391336+0000","last_became_peered":"2024-04-20T21:19:29.391336+0000","last_unstale":"2024-04-20T21:19:36.249094+0000","last_undegraded":"2024-04-20T21:19:36.249094+0000","last_fullsized":"2024-04-20T21:19:36.249094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:40:00.360083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777450+0000","last_change":"2024-04-20T21:19:29.397118+0000","last_active":"2024-04-20T21:19:35.777450+0000","last_peered":"2024-04-20T21:19:35.777450+0000","last_clean":"2024-04-20T21:19:35.777450+0000","last_became_active":"2024-04-20T21:19:29.396809+0000","last_became_peered":"2024-04-20T21:19:29.396809+0000","last_unstale":"2024-04-20T21:19:35.777450+0000","last_undegraded":"2024-04-20T21:19:35.777450+0000","last_fullsized":"2024-04-20T21:19:35.777450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248383+0000","last_change":"2024-04-20T21:19:29.380740+0000","last_active":"2024-04-20T21:19:36.248383+0000","last_peered":"2024-04-20T21:19:36.248383+0000","last_clean":"2024-04-20T21:19:36.248383+0000","last_became_active":"2024-04-20T21:19:29.378870+0000","last_became_peered":"2024-04-20T21:19:29.378870+0000","last_unstale":"2024-04-20T21:19:36.248383+0000","last_undegraded":"2024-04-20T21:19:36.248383+0000","last_fullsized":"2024-04-20T21:19:36.248383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622922+0000","last_change":"2024-04-20T21:19:29.376821+0000","last_active":"2024-04-20T21:19:35.622922+0000","last_peered":"2024-04-20T21:19:35.622922+0000","last_clean":"2024-04-20T21:19:35.622922+0000","last_became_active":"2024-04-20T21:19:29.372264+0000","last_became_peered":"2024-04-20T21:19:29.372264+0000","last_unstale":"2024-04-20T21:19:35.622922+0000","last_undegraded":"2024-04-20T21:19:35.622922+0000","last_fullsized":"2024-04-20T21:19:35.622922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247633+0000","last_change":"2024-04-20T21:19:29.380388+0000","last_active":"2024-04-20T21:19:36.247633+0000","last_peered":"2024-04-20T21:19:36.247633+0000","last_clean":"2024-04-20T21:19:36.247633+0000","last_became_active":"2024-04-20T21:19:29.380055+0000","last_became_peered":"2024-04-20T21:19:29.380055+0000","last_unstale":"2024-04-20T21:19:36.247633+0000","last_undegraded":"2024-04-20T21:19:36.247633+0000","last_fullsized":"2024-04-20T21:19:36.247633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628752+0000","last_change":"2024-04-20T21:19:29.392961+0000","last_active":"2024-04-20T21:19:35.628752+0000","last_peered":"2024-04-20T21:19:35.628752+0000","last_clean":"2024-04-20T21:19:35.628752+0000","last_became_active":"2024-04-20T21:19:29.392692+0000","last_became_peered":"2024-04-20T21:19:29.392692+0000","last_unstale":"2024-04-20T21:19:35.628752+0000","last_undegraded":"2024-04-20T21:19:35.628752+0000","last_fullsized":"2024-04-20T21:19:35.628752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623208+0000","last_change":"2024-04-20T21:19:29.380591+0000","last_active":"2024-04-20T21:19:35.623208+0000","last_peered":"2024-04-20T21:19:35.623208+0000","last_clean":"2024-04-20T21:19:35.623208+0000","last_became_active":"2024-04-20T21:19:29.380070+0000","last_became_peered":"2024-04-20T21:19:29.380070+0000","last_unstale":"2024-04-20T21:19:35.623208+0000","last_undegraded":"2024-04-20T21:19:35.623208+0000","last_fullsized":"2024-04-20T21:19:35.623208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:04:32.875201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777341+0000","last_change":"2024-04-20T21:19:29.384690+0000","last_active":"2024-04-20T21:19:35.777341+0000","last_peered":"2024-04-20T21:19:35.777341+0000","last_clean":"2024-04-20T21:19:35.777341+0000","last_became_active":"2024-04-20T21:19:29.383536+0000","last_became_peered":"2024-04-20T21:19:29.383536+0000","last_unstale":"2024-04-20T21:19:35.777341+0000","last_undegraded":"2024-04-20T21:19:35.777341+0000","last_fullsized":"2024-04-20T21:19:35.777341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622322+0000","last_change":"2024-04-20T21:19:29.380657+0000","last_active":"2024-04-20T21:19:35.622322+0000","last_peered":"2024-04-20T21:19:35.622322+0000","last_clean":"2024-04-20T21:19:35.622322+0000","last_became_active":"2024-04-20T21:19:29.380107+0000","last_became_peered":"2024-04-20T21:19:29.380107+0000","last_unstale":"2024-04-20T21:19:35.622322+0000","last_undegraded":"2024-04-20T21:19:35.622322+0000","last_fullsized":"2024-04-20T21:19:35.622322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777381+0000","last_change":"2024-04-20T21:19:29.388441+0000","last_active":"2024-04-20T21:19:35.777381+0000","last_peered":"2024-04-20T21:19:35.777381+0000","last_clean":"2024-04-20T21:19:35.777381+0000","last_became_active":"2024-04-20T21:19:29.388153+0000","last_became_peered":"2024-04-20T21:19:29.388153+0000","last_unstale":"2024-04-20T21:19:35.777381+0000","last_undegraded":"2024-04-20T21:19:35.777381+0000","last_fullsized":"2024-04-20T21:19:35.777381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:24:23.709381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248119+0000","last_change":"2024-04-20T21:19:29.381637+0000","last_active":"2024-04-20T21:19:36.248119+0000","last_peered":"2024-04-20T21:19:36.248119+0000","last_clean":"2024-04-20T21:19:36.248119+0000","last_became_active":"2024-04-20T21:19:29.380117+0000","last_became_peered":"2024-04-20T21:19:29.380117+0000","last_unstale":"2024-04-20T21:19:36.248119+0000","last_undegraded":"2024-04-20T21:19:36.248119+0000","last_fullsized":"2024-04-20T21:19:36.248119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628156+0000","last_change":"2024-04-20T21:19:29.371702+0000","last_active":"2024-04-20T21:19:35.628156+0000","last_peered":"2024-04-20T21:19:35.628156+0000","last_clean":"2024-04-20T21:19:35.628156+0000","last_became_active":"2024-04-20T21:19:29.371414+0000","last_became_peered":"2024-04-20T21:19:29.371414+0000","last_unstale":"2024-04-20T21:19:35.628156+0000","last_undegraded":"2024-04-20T21:19:35.628156+0000","last_fullsized":"2024-04-20T21:19:35.628156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251098+0000","last_change":"2024-04-20T21:19:29.389612+0000","last_active":"2024-04-20T21:19:36.251098+0000","last_peered":"2024-04-20T21:19:36.251098+0000","last_clean":"2024-04-20T21:19:36.251098+0000","last_became_active":"2024-04-20T21:19:29.389324+0000","last_became_peered":"2024-04-20T21:19:29.389324+0000","last_unstale":"2024-04-20T21:19:36.251098+0000","last_undegraded":"2024-04-20T21:19:36.251098+0000","last_fullsized":"2024-04-20T21:19:36.251098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:33.262857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249637+0000","last_change":"2024-04-20T21:19:29.382113+0000","last_active":"2024-04-20T21:19:36.249637+0000","last_peered":"2024-04-20T21:19:36.249637+0000","last_clean":"2024-04-20T21:19:36.249637+0000","last_became_active":"2024-04-20T21:19:29.381256+0000","last_became_peered":"2024-04-20T21:19:29.381256+0000","last_unstale":"2024-04-20T21:19:36.249637+0000","last_undegraded":"2024-04-20T21:19:36.249637+0000","last_fullsized":"2024-04-20T21:19:36.249637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:03:39.489134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778694+0000","last_change":"2024-04-20T21:19:29.395827+0000","last_active":"2024-04-20T21:19:35.778694+0000","last_peered":"2024-04-20T21:19:35.778694+0000","last_clean":"2024-04-20T21:19:35.778694+0000","last_became_active":"2024-04-20T21:19:29.395560+0000","last_became_peered":"2024-04-20T21:19:29.395560+0000","last_unstale":"2024-04-20T21:19:35.778694+0000","last_undegraded":"2024-04-20T21:19:35.778694+0000","last_fullsized":"2024-04-20T21:19:35.778694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:27:55.214090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.776970+0000","last_change":"2024-04-20T21:19:29.389510+0000","last_active":"2024-04-20T21:19:35.776970+0000","last_peered":"2024-04-20T21:19:35.776970+0000","last_clean":"2024-04-20T21:19:35.776970+0000","last_became_active":"2024-04-20T21:19:29.389143+0000","last_became_peered":"2024-04-20T21:19:29.389143+0000","last_unstale":"2024-04-20T21:19:35.776970+0000","last_undegraded":"2024-04-20T21:19:35.776970+0000","last_fullsized":"2024-04-20T21:19:35.776970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249525+0000","last_change":"2024-04-20T21:19:29.374703+0000","last_active":"2024-04-20T21:19:36.249525+0000","last_peered":"2024-04-20T21:19:36.249525+0000","last_clean":"2024-04-20T21:19:36.249525+0000","last_became_active":"2024-04-20T21:19:29.374027+0000","last_became_peered":"2024-04-20T21:19:29.374027+0000","last_unstale":"2024-04-20T21:19:36.249525+0000","last_undegraded":"2024-04-20T21:19:36.249525+0000","last_fullsized":"2024-04-20T21:19:36.249525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248059+0000","last_change":"2024-04-20T21:19:29.377330+0000","last_active":"2024-04-20T21:19:36.248059+0000","last_peered":"2024-04-20T21:19:36.248059+0000","last_clean":"2024-04-20T21:19:36.248059+0000","last_became_active":"2024-04-20T21:19:29.377054+0000","last_became_peered":"2024-04-20T21:19:29.377054+0000","last_unstale":"2024-04-20T21:19:36.248059+0000","last_undegraded":"2024-04-20T21:19:36.248059+0000","last_fullsized":"2024-04-20T21:19:36.248059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621838+0000","last_change":"2024-04-20T21:19:29.379509+0000","last_active":"2024-04-20T21:19:35.621838+0000","last_peered":"2024-04-20T21:19:35.621838+0000","last_clean":"2024-04-20T21:19:35.621838+0000","last_became_active":"2024-04-20T21:19:29.379077+0000","last_became_peered":"2024-04-20T21:19:29.379077+0000","last_unstale":"2024-04-20T21:19:35.621838+0000","last_undegraded":"2024-04-20T21:19:35.621838+0000","last_fullsized":"2024-04-20T21:19:35.621838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631470+0000","last_change":"2024-04-20T21:19:29.371610+0000","last_active":"2024-04-20T21:19:35.631470+0000","last_peered":"2024-04-20T21:19:35.631470+0000","last_clean":"2024-04-20T21:19:35.631470+0000","last_became_active":"2024-04-20T21:19:29.371194+0000","last_became_peered":"2024-04-20T21:19:29.371194+0000","last_unstale":"2024-04-20T21:19:35.631470+0000","last_undegraded":"2024-04-20T21:19:35.631470+0000","last_fullsized":"2024-04-20T21:19:35.631470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:19.225408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627705+0000","last_change":"2024-04-20T21:19:29.381261+0000","last_active":"2024-04-20T21:19:35.627705+0000","last_peered":"2024-04-20T21:19:35.627705+0000","last_clean":"2024-04-20T21:19:35.627705+0000","last_became_active":"2024-04-20T21:19:29.380856+0000","last_became_peered":"2024-04-20T21:19:29.380856+0000","last_unstale":"2024-04-20T21:19:35.627705+0000","last_undegraded":"2024-04-20T21:19:35.627705+0000","last_fullsized":"2024-04-20T21:19:35.627705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628482+0000","last_change":"2024-04-20T21:19:29.388748+0000","last_active":"2024-04-20T21:19:35.628482+0000","last_peered":"2024-04-20T21:19:35.628482+0000","last_clean":"2024-04-20T21:19:35.628482+0000","last_became_active":"2024-04-20T21:19:29.388227+0000","last_became_peered":"2024-04-20T21:19:29.388227+0000","last_unstale":"2024-04-20T21:19:35.628482+0000","last_undegraded":"2024-04-20T21:19:35.628482+0000","last_fullsized":"2024-04-20T21:19:35.628482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251764+0000","last_change":"2024-04-20T21:19:29.392148+0000","last_active":"2024-04-20T21:19:36.251764+0000","last_peered":"2024-04-20T21:19:36.251764+0000","last_clean":"2024-04-20T21:19:36.251764+0000","last_became_active":"2024-04-20T21:19:29.391719+0000","last_became_peered":"2024-04-20T21:19:29.391719+0000","last_unstale":"2024-04-20T21:19:36.251764+0000","last_undegraded":"2024-04-20T21:19:36.251764+0000","last_fullsized":"2024-04-20T21:19:36.251764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:31.354972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621658+0000","last_change":"2024-04-20T21:19:29.401358+0000","last_active":"2024-04-20T21:19:35.621658+0000","last_peered":"2024-04-20T21:19:35.621658+0000","last_clean":"2024-04-20T21:19:35.621658+0000","last_became_active":"2024-04-20T21:19:29.401015+0000","last_became_peered":"2024-04-20T21:19:29.401015+0000","last_unstale":"2024-04-20T21:19:35.621658+0000","last_undegraded":"2024-04-20T21:19:35.621658+0000","last_fullsized":"2024-04-20T21:19:35.621658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249862+0000","last_change":"2024-04-20T21:19:29.378374+0000","last_active":"2024-04-20T21:19:36.249862+0000","last_peered":"2024-04-20T21:19:36.249862+0000","last_clean":"2024-04-20T21:19:36.249862+0000","last_became_active":"2024-04-20T21:19:29.377992+0000","last_became_peered":"2024-04-20T21:19:29.377992+0000","last_unstale":"2024-04-20T21:19:36.249862+0000","last_undegraded":"2024-04-20T21:19:36.249862+0000","last_fullsized":"2024-04-20T21:19:36.249862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:01:25.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777114+0000","last_change":"2024-04-20T21:19:29.388283+0000","last_active":"2024-04-20T21:19:35.777114+0000","last_peered":"2024-04-20T21:19:35.777114+0000","last_clean":"2024-04-20T21:19:35.777114+0000","last_became_active":"2024-04-20T21:19:29.386243+0000","last_became_peered":"2024-04-20T21:19:29.386243+0000","last_unstale":"2024-04-20T21:19:35.777114+0000","last_undegraded":"2024-04-20T21:19:35.777114+0000","last_fullsized":"2024-04-20T21:19:35.777114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249862+0000","last_change":"2024-04-20T21:19:29.387887+0000","last_active":"2024-04-20T21:19:36.249862+0000","last_peered":"2024-04-20T21:19:36.249862+0000","last_clean":"2024-04-20T21:19:36.249862+0000","last_became_active":"2024-04-20T21:19:29.387481+0000","last_became_peered":"2024-04-20T21:19:29.387481+0000","last_unstale":"2024-04-20T21:19:36.249862+0000","last_undegraded":"2024-04-20T21:19:36.249862+0000","last_fullsized":"2024-04-20T21:19:36.249862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:27:55.214090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777684+0000","last_change":"2024-04-20T21:19:29.397568+0000","last_active":"2024-04-20T21:19:35.777684+0000","last_peered":"2024-04-20T21:19:35.777684+0000","last_clean":"2024-04-20T21:19:35.777684+0000","last_became_active":"2024-04-20T21:19:29.397258+0000","last_became_peered":"2024-04-20T21:19:29.397258+0000","last_unstale":"2024-04-20T21:19:35.777684+0000","last_undegraded":"2024-04-20T21:19:35.777684+0000","last_fullsized":"2024-04-20T21:19:35.777684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:01:25.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249144+0000","last_change":"2024-04-20T21:19:29.391755+0000","last_active":"2024-04-20T21:19:36.249144+0000","last_peered":"2024-04-20T21:19:36.249144+0000","last_clean":"2024-04-20T21:19:36.249144+0000","last_became_active":"2024-04-20T21:19:29.389939+0000","last_became_peered":"2024-04-20T21:19:29.389939+0000","last_unstale":"2024-04-20T21:19:36.249144+0000","last_undegraded":"2024-04-20T21:19:36.249144+0000","last_fullsized":"2024-04-20T21:19:36.249144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249430+0000","last_change":"2024-04-20T21:19:29.383237+0000","last_active":"2024-04-20T21:19:36.249430+0000","last_peered":"2024-04-20T21:19:36.249430+0000","last_clean":"2024-04-20T21:19:36.249430+0000","last_became_active":"2024-04-20T21:19:29.382910+0000","last_became_peered":"2024-04-20T21:19:29.382910+0000","last_unstale":"2024-04-20T21:19:36.249430+0000","last_undegraded":"2024-04-20T21:19:36.249430+0000","last_fullsized":"2024-04-20T21:19:36.249430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251604+0000","last_change":"2024-04-20T21:19:29.382459+0000","last_active":"2024-04-20T21:19:36.251604+0000","last_peered":"2024-04-20T21:19:36.251604+0000","last_clean":"2024-04-20T21:19:36.251604+0000","last_became_active":"2024-04-20T21:19:29.382142+0000","last_became_peered":"2024-04-20T21:19:29.382142+0000","last_unstale":"2024-04-20T21:19:36.251604+0000","last_undegraded":"2024-04-20T21:19:36.251604+0000","last_fullsized":"2024-04-20T21:19:36.251604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:01.897496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T21:19:58.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T21:19:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.828+0000 7f8b15e00640 1 Processor -- start 2024-04-20T21:19:59.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.828+0000 7f8b15e00640 1 -- start start 2024-04-20T21:19:59.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.830+0000 7f8b15e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8b1015b3b0 0x7f8b1006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.830+0000 7f8b15e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b1006dcb0 0x7f8b10071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.830+0000 7f8b15e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b100ade40 con 0x7f8b10072090 2024-04-20T21:19:59.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.830+0000 7f8b15e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8b100ae0e0 con 0x7f8b1015b3b0 2024-04-20T21:19:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.830+0000 7f8b15e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1015b790 con 0x7f8b1006dcb0 2024-04-20T21:19:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.830+0000 7f8b0f400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8b10072090 0x7f8b100d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46418/0 (socket says 172.21.15.71:46418) 2024-04-20T21:19:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.830+0000 7f8b0f400640 1 -- 172.21.15.71:0/3371634497 learned_addr learned my addr 172.21.15.71:0/3371634497 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.830+0000 7f8b0ea00640 1 --2- 172.21.15.71:0/3371634497 >> v2:172.21.15.137:3300/0 conn(0x7f8b1015b3b0 0x7f8b1006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.830+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651218990 0 0) 0x7f8b100ade40 con 0x7f8b10072090 2024-04-20T21:19:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8af4003520 con 0x7f8b10072090 2024-04-20T21:19:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b06000640 1 --2- 172.21.15.71:0/3371634497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b1006dcb0 0x7f8b10071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 567215329 0 0) 0x7f8af4003520 con 0x7f8b10072090 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b1006dcb0 msgr2=0x7f8b10071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 --2- 172.21.15.71:0/3371634497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b1006dcb0 0x7f8b10071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 >> v2:172.21.15.137:3300/0 conn(0x7f8b1015b3b0 msgr2=0x7f8b1006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 --2- 172.21.15.71:0/3371634497 >> v2:172.21.15.137:3300/0 conn(0x7f8b1015b3b0 0x7f8b1006eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b100ae380 con 0x7f8b10072090 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f8b08001a10 con 0x7f8b10072090 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0ea00640 1 --2- 172.21.15.71:0/3371634497 >> v2:172.21.15.137:3300/0 conn(0x7f8b1015b3b0 0x7f8b1006eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 >> v1:172.21.15.71:6789/0 conn(0x7f8b10072090 legacy=0x7f8b100d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 --2- 172.21.15.71:0/3371634497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40039b0 0x7f8af4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 --2- 172.21.15.71:0/3371634497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8af4004800 0x7f8af4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 --2- 172.21.15.71:0/3371634497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b1006dcb0 0x7f8af40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b100ae0e0 con 0x7f8af40039b0 2024-04-20T21:19:59.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1015b790 con 0x7f8af4004800 2024-04-20T21:19:59.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8af400dc80 con 0x7f8b1006dcb0 2024-04-20T21:19:59.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.831+0000 7f8b0ea00640 1 --2- 172.21.15.71:0/3371634497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40039b0 0x7f8af4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.832+0000 7f8b06000640 1 --2- 172.21.15.71:0/3371634497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8af4004800 0x7f8af4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.832+0000 7f8b0ea00640 1 -- 172.21.15.71:0/3371634497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b1006dcb0 msgr2=0x7f8af40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:59.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.832+0000 7f8b0ea00640 1 --2- 172.21.15.71:0/3371634497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b1006dcb0 0x7f8af40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.832+0000 7f8b0ea00640 1 -- 172.21.15.71:0/3371634497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8af4004800 msgr2=0x7f8af4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:59.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.832+0000 7f8b0ea00640 1 --2- 172.21.15.71:0/3371634497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8af4004800 0x7f8af4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.832+0000 7f8b0ea00640 1 -- 172.21.15.71:0/3371634497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af4003520 con 0x7f8af40039b0 2024-04-20T21:19:59.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.833+0000 7f8b0ea00640 1 --2- 172.21.15.71:0/3371634497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40039b0 0x7f8af4003dd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8b00006fd0 tx=0x7f8af4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5642020e362362c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:59.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.833+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000f040 con 0x7f8af40039b0 2024-04-20T21:19:59.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.833+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b00004230 con 0x7f8af40039b0 2024-04-20T21:19:59.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.833+0000 7f8b0e000640 1 -- 172.21.15.71:0/3371634497 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b00003610 con 0x7f8af40039b0 2024-04-20T21:19:59.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.834+0000 7f8b15e00640 1 -- 172.21.15.71:0/3371634497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40039b0 msgr2=0x7f8af4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.834+0000 7f8b15e00640 1 --2- 172.21.15.71:0/3371634497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40039b0 0x7f8af4003dd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8b00006fd0 tx=0x7f8af4005830 comp rx=0 tx=0).stop 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.834+0000 7f8b0f400640 1 -- 172.21.15.71:0/3371634497 reap_dead start 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.834+0000 7f8b15e00640 1 -- 172.21.15.71:0/3371634497 shutdown_connections 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.834+0000 7f8b15e00640 1 -- 172.21.15.71:0/3371634497 >> 172.21.15.71:0/3371634497 conn(0x7f8b100b3350 msgr2=0x7f8b100b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.834+0000 7f8b15e00640 1 -- 172.21.15.71:0/3371634497 shutdown_connections 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.834+0000 7f8b15e00640 1 -- 172.21.15.71:0/3371634497 wait complete. 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.835+0000 7f8b15e00640 1 Processor -- start 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.836+0000 7f8b15e00640 1 -- start start 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.836+0000 7f8b15e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af40039b0 0x7f8b101e5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.836+0000 7f8b15e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b101f7910 0x7f8b10157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b15e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b100b1160 0x7f8b100b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b15e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b100aec20 con 0x7f8b101f7910 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b15e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b100ae940 con 0x7f8b100b1160 2024-04-20T21:19:59.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b15e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1006efe0 con 0x7f8af40039b0 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b06000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b101f7910 0x7f8b10157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b06000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b101f7910 0x7f8b10157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45140/0 (socket says 172.21.15.71:45140) 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b06000640 1 -- 172.21.15.71:0/3304440883 learned_addr learned my addr 172.21.15.71:0/3304440883 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b0ea00640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af40039b0 0x7f8b101e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b0f400640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b100b1160 0x7f8b100b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b06000640 1 -- 172.21.15.71:0/3304440883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af40039b0 msgr2=0x7f8b101e5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b06000640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af40039b0 0x7f8b101e5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b06000640 1 -- 172.21.15.71:0/3304440883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b100b1160 msgr2=0x7f8b100b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b06000640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b100b1160 0x7f8b100b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b06000640 1 -- 172.21.15.71:0/3304440883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b101f7d90 con 0x7f8b101f7910 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b0ea00640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af40039b0 0x7f8b101e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.837+0000 7f8b06000640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b101f7910 0x7f8b10157030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8af800f5b0 tx=0x7f8af800fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:59.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.838+0000 7f8b07e00640 1 -- 172.21.15.71:0/3304440883 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8019020 con 0x7f8b101f7910 2024-04-20T21:19:59.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.838+0000 7f8b07e00640 1 -- 172.21.15.71:0/3304440883 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af8014870 con 0x7f8b101f7910 2024-04-20T21:19:59.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.838+0000 7f8b07e00640 1 -- 172.21.15.71:0/3304440883 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8014c60 con 0x7f8b101f7910 2024-04-20T21:19:59.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.838+0000 7f8b15e00640 1 -- 172.21.15.71:0/3304440883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b10157570 con 0x7f8b101f7910 2024-04-20T21:19:59.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.838+0000 7f8b15e00640 1 -- 172.21.15.71:0/3304440883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b10157af0 con 0x7f8b101f7910 2024-04-20T21:19:59.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.839+0000 7f8b15e00640 1 -- 172.21.15.71:0/3304440883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b10068980 con 0x7f8b101f7910 2024-04-20T21:19:59.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.840+0000 7f8b07e00640 1 -- 172.21.15.71:0/3304440883 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8af801c020 con 0x7f8b101f7910 2024-04-20T21:19:59.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.842+0000 7f8b07e00640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8aec06c920 0x7f8aec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.842+0000 7f8b07e00640 1 -- 172.21.15.71:0/3304440883 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8af808c6c0 con 0x7f8b101f7910 2024-04-20T21:19:59.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.842+0000 7f8b0ea00640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8aec06c920 0x7f8aec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.842+0000 7f8b0ea00640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8aec06c920 0x7f8aec06ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b00035000 tx=0x7f8b0003a040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:59.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:58.847+0000 7f8b07e00640 1 -- 172.21.15.71:0/3304440883 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8af8023020 con 0x7f8b101f7910 2024-04-20T21:19:59.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.029+0000 7f8b15e00640 1 -- 172.21.15.71:0/3304440883 --> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b10158cd0 con 0x7f8aec06c920 2024-04-20T21:19:59.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.037+0000 7f8b07e00640 1 -- 172.21.15.71:0/3304440883 <== mgr.4110 v2:172.21.15.71:6832/1511456036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332538 (secure 0 0 0) 0x7f8b10158cd0 con 0x7f8aec06c920 2024-04-20T21:19:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:59.052 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-20T21:19:59.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 -- 172.21.15.71:0/3304440883 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8aec06c920 msgr2=0x7f8aec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8aec06c920 0x7f8aec06ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b00035000 tx=0x7f8b0003a040 comp rx=0 tx=0).stop 2024-04-20T21:19:59.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 -- 172.21.15.71:0/3304440883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b101f7910 msgr2=0x7f8b10157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b101f7910 0x7f8b10157030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8af800f5b0 tx=0x7f8af800fa70 comp rx=0 tx=0).stop 2024-04-20T21:19:59.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 -- 172.21.15.71:0/3304440883 shutdown_connections 2024-04-20T21:19:59.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8aec06c920 0x7f8aec06ede0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b100b1160 0x7f8b100b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b101f7910 0x7f8b10157030 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 --2- 172.21.15.71:0/3304440883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af40039b0 0x7f8b101e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 -- 172.21.15.71:0/3304440883 >> 172.21.15.71:0/3304440883 conn(0x7f8b100b3350 msgr2=0x7f8b1015d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:59.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 -- 172.21.15.71:0/3304440883 shutdown_connections 2024-04-20T21:19:59.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.043+0000 7f8b15e00640 1 -- 172.21.15.71:0/3304440883 wait complete. 2024-04-20T21:19:59.062 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-20T21:19:57.803704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2049160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004496"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250445+0000","last_change":"2024-04-20T21:19:28.364884+0000","last_active":"2024-04-20T21:19:36.250445+0000","last_peered":"2024-04-20T21:19:36.250445+0000","last_clean":"2024-04-20T21:19:36.250445+0000","last_became_active":"2024-04-20T21:19:28.364515+0000","last_became_peered":"2024-04-20T21:19:28.364515+0000","last_unstale":"2024-04-20T21:19:36.250445+0000","last_undegraded":"2024-04-20T21:19:36.250445+0000","last_fullsized":"2024-04-20T21:19:36.250445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622903+0000","last_change":"2024-04-20T21:19:29.381382+0000","last_active":"2024-04-20T21:19:35.622903+0000","last_peered":"2024-04-20T21:19:35.622903+0000","last_clean":"2024-04-20T21:19:35.622903+0000","last_became_active":"2024-04-20T21:19:29.381086+0000","last_became_peered":"2024-04-20T21:19:29.381086+0000","last_unstale":"2024-04-20T21:19:35.622903+0000","last_undegraded":"2024-04-20T21:19:35.622903+0000","last_fullsized":"2024-04-20T21:19:35.622903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:24:23.709381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622136+0000","last_change":"2024-04-20T21:19:34.116039+0000","last_active":"2024-04-20T21:19:35.622136+0000","last_peered":"2024-04-20T21:19:35.622136+0000","last_clean":"2024-04-20T21:19:35.622136+0000","last_became_active":"2024-04-20T21:19:34.114870+0000","last_became_peered":"2024-04-20T21:19:34.114870+0000","last_unstale":"2024-04-20T21:19:35.622136+0000","last_undegraded":"2024-04-20T21:19:35.622136+0000","last_fullsized":"2024-04-20T21:19:35.622136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:11:39.317180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623062+0000","last_change":"2024-04-20T21:19:28.356358+0000","last_active":"2024-04-20T21:19:35.623062+0000","last_peered":"2024-04-20T21:19:35.623062+0000","last_clean":"2024-04-20T21:19:35.623062+0000","last_became_active":"2024-04-20T21:19:28.355376+0000","last_became_peered":"2024-04-20T21:19:28.355376+0000","last_unstale":"2024-04-20T21:19:35.623062+0000","last_undegraded":"2024-04-20T21:19:35.623062+0000","last_fullsized":"2024-04-20T21:19:35.623062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:12:37.534140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250065+0000","last_change":"2024-04-20T21:19:29.393098+0000","last_active":"2024-04-20T21:19:36.250065+0000","last_peered":"2024-04-20T21:19:36.250065+0000","last_clean":"2024-04-20T21:19:36.250065+0000","last_became_active":"2024-04-20T21:19:29.392267+0000","last_became_peered":"2024-04-20T21:19:29.392267+0000","last_unstale":"2024-04-20T21:19:36.250065+0000","last_undegraded":"2024-04-20T21:19:36.250065+0000","last_fullsized":"2024-04-20T21:19:36.250065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626812+0000","last_change":"2024-04-20T21:19:33.632986+0000","last_active":"2024-04-20T21:19:35.626812+0000","last_peered":"2024-04-20T21:19:35.626812+0000","last_clean":"2024-04-20T21:19:35.626812+0000","last_became_active":"2024-04-20T21:19:33.632489+0000","last_became_peered":"2024-04-20T21:19:33.632489+0000","last_unstale":"2024-04-20T21:19:35.626812+0000","last_undegraded":"2024-04-20T21:19:35.626812+0000","last_fullsized":"2024-04-20T21:19:35.626812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:25.396766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251112+0000","last_change":"2024-04-20T21:19:28.370372+0000","last_active":"2024-04-20T21:19:36.251112+0000","last_peered":"2024-04-20T21:19:36.251112+0000","last_clean":"2024-04-20T21:19:36.251112+0000","last_became_active":"2024-04-20T21:19:28.369998+0000","last_became_peered":"2024-04-20T21:19:28.369998+0000","last_unstale":"2024-04-20T21:19:36.251112+0000","last_undegraded":"2024-04-20T21:19:36.251112+0000","last_fullsized":"2024-04-20T21:19:36.251112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:49:21.426416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777896+0000","last_change":"2024-04-20T21:19:29.383743+0000","last_active":"2024-04-20T21:19:35.777896+0000","last_peered":"2024-04-20T21:19:35.777896+0000","last_clean":"2024-04-20T21:19:35.777896+0000","last_became_active":"2024-04-20T21:19:29.383451+0000","last_became_peered":"2024-04-20T21:19:29.383451+0000","last_unstale":"2024-04-20T21:19:35.777896+0000","last_undegraded":"2024-04-20T21:19:35.777896+0000","last_fullsized":"2024-04-20T21:19:35.777896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:21.125011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630668+0000","last_change":"2024-04-20T21:19:33.632955+0000","last_active":"2024-04-20T21:19:35.630668+0000","last_peered":"2024-04-20T21:19:35.630668+0000","last_clean":"2024-04-20T21:19:35.630668+0000","last_became_active":"2024-04-20T21:19:33.632418+0000","last_became_peered":"2024-04-20T21:19:33.632418+0000","last_unstale":"2024-04-20T21:19:35.630668+0000","last_undegraded":"2024-04-20T21:19:35.630668+0000","last_fullsized":"2024-04-20T21:19:35.630668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250671+0000","last_change":"2024-04-20T21:19:28.367835+0000","last_active":"2024-04-20T21:19:36.250671+0000","last_peered":"2024-04-20T21:19:36.250671+0000","last_clean":"2024-04-20T21:19:36.250671+0000","last_became_active":"2024-04-20T21:19:28.367516+0000","last_became_peered":"2024-04-20T21:19:28.367516+0000","last_unstale":"2024-04-20T21:19:36.250671+0000","last_undegraded":"2024-04-20T21:19:36.250671+0000","last_fullsized":"2024-04-20T21:19:36.250671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:03:38.483955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778252+0000","last_change":"2024-04-20T21:19:29.382022+0000","last_active":"2024-04-20T21:19:35.778252+0000","last_peered":"2024-04-20T21:19:35.778252+0000","last_clean":"2024-04-20T21:19:35.778252+0000","last_became_active":"2024-04-20T21:19:29.381441+0000","last_became_peered":"2024-04-20T21:19:29.381441+0000","last_unstale":"2024-04-20T21:19:35.778252+0000","last_undegraded":"2024-04-20T21:19:35.778252+0000","last_fullsized":"2024-04-20T21:19:35.778252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:10:56.546673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629810+0000","last_change":"2024-04-20T21:19:33.623830+0000","last_active":"2024-04-20T21:19:35.629810+0000","last_peered":"2024-04-20T21:19:35.629810+0000","last_clean":"2024-04-20T21:19:35.629810+0000","last_became_active":"2024-04-20T21:19:33.623367+0000","last_became_peered":"2024-04-20T21:19:33.623367+0000","last_unstale":"2024-04-20T21:19:35.629810+0000","last_undegraded":"2024-04-20T21:19:35.629810+0000","last_fullsized":"2024-04-20T21:19:35.629810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:35.626728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627137+0000","last_change":"2024-04-20T21:19:29.362406+0000","last_active":"2024-04-20T21:19:35.627137+0000","last_peered":"2024-04-20T21:19:35.627137+0000","last_clean":"2024-04-20T21:19:35.627137+0000","last_became_active":"2024-04-20T21:19:29.361949+0000","last_became_peered":"2024-04-20T21:19:29.361949+0000","last_unstale":"2024-04-20T21:19:35.627137+0000","last_undegraded":"2024-04-20T21:19:35.627137+0000","last_fullsized":"2024-04-20T21:19:35.627137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250473+0000","last_change":"2024-04-20T21:19:28.366445+0000","last_active":"2024-04-20T21:19:36.250473+0000","last_peered":"2024-04-20T21:19:36.250473+0000","last_clean":"2024-04-20T21:19:36.250473+0000","last_became_active":"2024-04-20T21:19:28.365983+0000","last_became_peered":"2024-04-20T21:19:28.365983+0000","last_unstale":"2024-04-20T21:19:36.250473+0000","last_undegraded":"2024-04-20T21:19:36.250473+0000","last_fullsized":"2024-04-20T21:19:36.250473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:19:13.843410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.632337+0000","last_change":"2024-04-20T21:19:33.633939+0000","last_active":"2024-04-20T21:19:35.632337+0000","last_peered":"2024-04-20T21:19:35.632337+0000","last_clean":"2024-04-20T21:19:35.632337+0000","last_became_active":"2024-04-20T21:19:33.633480+0000","last_became_peered":"2024-04-20T21:19:33.633480+0000","last_unstale":"2024-04-20T21:19:35.632337+0000","last_undegraded":"2024-04-20T21:19:35.632337+0000","last_fullsized":"2024-04-20T21:19:35.632337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622549+0000","last_change":"2024-04-20T21:19:29.396467+0000","last_active":"2024-04-20T21:19:35.622549+0000","last_peered":"2024-04-20T21:19:35.622549+0000","last_clean":"2024-04-20T21:19:35.622549+0000","last_became_active":"2024-04-20T21:19:29.396096+0000","last_became_peered":"2024-04-20T21:19:29.396096+0000","last_unstale":"2024-04-20T21:19:35.622549+0000","last_undegraded":"2024-04-20T21:19:35.622549+0000","last_fullsized":"2024-04-20T21:19:35.622549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248714+0000","last_change":"2024-04-20T21:19:28.354943+0000","last_active":"2024-04-20T21:19:36.248714+0000","last_peered":"2024-04-20T21:19:36.248714+0000","last_clean":"2024-04-20T21:19:36.248714+0000","last_became_active":"2024-04-20T21:19:28.354543+0000","last_became_peered":"2024-04-20T21:19:28.354543+0000","last_unstale":"2024-04-20T21:19:36.248714+0000","last_undegraded":"2024-04-20T21:19:36.248714+0000","last_fullsized":"2024-04-20T21:19:36.248714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631184+0000","last_change":"2024-04-20T21:19:33.630390+0000","last_active":"2024-04-20T21:19:35.631184+0000","last_peered":"2024-04-20T21:19:35.631184+0000","last_clean":"2024-04-20T21:19:35.631184+0000","last_became_active":"2024-04-20T21:19:33.629932+0000","last_became_peered":"2024-04-20T21:19:33.629932+0000","last_unstale":"2024-04-20T21:19:35.631184+0000","last_undegraded":"2024-04-20T21:19:35.631184+0000","last_fullsized":"2024-04-20T21:19:35.631184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621975+0000","last_change":"2024-04-20T21:19:29.389415+0000","last_active":"2024-04-20T21:19:35.621975+0000","last_peered":"2024-04-20T21:19:35.621975+0000","last_clean":"2024-04-20T21:19:35.621975+0000","last_became_active":"2024-04-20T21:19:29.381155+0000","last_became_peered":"2024-04-20T21:19:29.381155+0000","last_unstale":"2024-04-20T21:19:35.621975+0000","last_undegraded":"2024-04-20T21:19:35.621975+0000","last_fullsized":"2024-04-20T21:19:35.621975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249623+0000","last_change":"2024-04-20T21:19:28.364622+0000","last_active":"2024-04-20T21:19:36.249623+0000","last_peered":"2024-04-20T21:19:36.249623+0000","last_clean":"2024-04-20T21:19:36.249623+0000","last_became_active":"2024-04-20T21:19:28.364315+0000","last_became_peered":"2024-04-20T21:19:28.364315+0000","last_unstale":"2024-04-20T21:19:36.249623+0000","last_undegraded":"2024-04-20T21:19:36.249623+0000","last_fullsized":"2024-04-20T21:19:36.249623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:18.220229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248334+0000","last_change":"2024-04-20T21:19:34.113879+0000","last_active":"2024-04-20T21:19:36.248334+0000","last_peered":"2024-04-20T21:19:36.248334+0000","last_clean":"2024-04-20T21:19:36.248334+0000","last_became_active":"2024-04-20T21:19:34.112094+0000","last_became_peered":"2024-04-20T21:19:34.112094+0000","last_unstale":"2024-04-20T21:19:36.248334+0000","last_undegraded":"2024-04-20T21:19:36.248334+0000","last_fullsized":"2024-04-20T21:19:36.248334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629286+0000","last_change":"2024-04-20T21:19:29.380675+0000","last_active":"2024-04-20T21:19:35.629286+0000","last_peered":"2024-04-20T21:19:35.629286+0000","last_clean":"2024-04-20T21:19:35.629286+0000","last_became_active":"2024-04-20T21:19:29.380380+0000","last_became_peered":"2024-04-20T21:19:29.380380+0000","last_unstale":"2024-04-20T21:19:35.629286+0000","last_undegraded":"2024-04-20T21:19:35.629286+0000","last_fullsized":"2024-04-20T21:19:35.629286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:28.311170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249614+0000","last_change":"2024-04-20T21:19:28.368079+0000","last_active":"2024-04-20T21:19:36.249614+0000","last_peered":"2024-04-20T21:19:36.249614+0000","last_clean":"2024-04-20T21:19:36.249614+0000","last_became_active":"2024-04-20T21:19:28.367750+0000","last_became_peered":"2024-04-20T21:19:28.367750+0000","last_unstale":"2024-04-20T21:19:36.249614+0000","last_undegraded":"2024-04-20T21:19:36.249614+0000","last_fullsized":"2024-04-20T21:19:36.249614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:45.962672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630326+0000","last_change":"2024-04-20T21:19:33.631284+0000","last_active":"2024-04-20T21:19:35.630326+0000","last_peered":"2024-04-20T21:19:35.630326+0000","last_clean":"2024-04-20T21:19:35.630326+0000","last_became_active":"2024-04-20T21:19:33.630971+0000","last_became_peered":"2024-04-20T21:19:33.630971+0000","last_unstale":"2024-04-20T21:19:35.630326+0000","last_undegraded":"2024-04-20T21:19:35.630326+0000","last_fullsized":"2024-04-20T21:19:35.630326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:18:37.532799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249846+0000","last_change":"2024-04-20T21:19:29.391566+0000","last_active":"2024-04-20T21:19:36.249846+0000","last_peered":"2024-04-20T21:19:36.249846+0000","last_clean":"2024-04-20T21:19:36.249846+0000","last_became_active":"2024-04-20T21:19:29.391250+0000","last_became_peered":"2024-04-20T21:19:29.391250+0000","last_unstale":"2024-04-20T21:19:36.249846+0000","last_undegraded":"2024-04-20T21:19:36.249846+0000","last_fullsized":"2024-04-20T21:19:36.249846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628809+0000","last_change":"2024-04-20T21:19:28.364547+0000","last_active":"2024-04-20T21:19:35.628809+0000","last_peered":"2024-04-20T21:19:35.628809+0000","last_clean":"2024-04-20T21:19:35.628809+0000","last_became_active":"2024-04-20T21:19:28.364221+0000","last_became_peered":"2024-04-20T21:19:28.364221+0000","last_unstale":"2024-04-20T21:19:35.628809+0000","last_undegraded":"2024-04-20T21:19:35.628809+0000","last_fullsized":"2024-04-20T21:19:35.628809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628201+0000","last_change":"2024-04-20T21:19:34.113755+0000","last_active":"2024-04-20T21:19:35.628201+0000","last_peered":"2024-04-20T21:19:35.628201+0000","last_clean":"2024-04-20T21:19:35.628201+0000","last_became_active":"2024-04-20T21:19:34.112491+0000","last_became_peered":"2024-04-20T21:19:34.112491+0000","last_unstale":"2024-04-20T21:19:35.628201+0000","last_undegraded":"2024-04-20T21:19:35.628201+0000","last_fullsized":"2024-04-20T21:19:35.628201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:34.563292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623247+0000","last_change":"2024-04-20T21:19:29.398876+0000","last_active":"2024-04-20T21:19:35.623247+0000","last_peered":"2024-04-20T21:19:35.623247+0000","last_clean":"2024-04-20T21:19:35.623247+0000","last_became_active":"2024-04-20T21:19:29.398650+0000","last_became_peered":"2024-04-20T21:19:29.398650+0000","last_unstale":"2024-04-20T21:19:35.623247+0000","last_undegraded":"2024-04-20T21:19:35.623247+0000","last_fullsized":"2024-04-20T21:19:35.623247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249435+0000","last_change":"2024-04-20T21:19:28.360068+0000","last_active":"2024-04-20T21:19:36.249435+0000","last_peered":"2024-04-20T21:19:36.249435+0000","last_clean":"2024-04-20T21:19:36.249435+0000","last_became_active":"2024-04-20T21:19:28.359752+0000","last_became_peered":"2024-04-20T21:19:28.359752+0000","last_unstale":"2024-04-20T21:19:36.249435+0000","last_undegraded":"2024-04-20T21:19:36.249435+0000","last_fullsized":"2024-04-20T21:19:36.249435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:45.962672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622011+0000","last_change":"2024-04-20T21:19:34.104484+0000","last_active":"2024-04-20T21:19:35.622011+0000","last_peered":"2024-04-20T21:19:35.622011+0000","last_clean":"2024-04-20T21:19:35.622011+0000","last_became_active":"2024-04-20T21:19:34.103724+0000","last_became_peered":"2024-04-20T21:19:34.103724+0000","last_unstale":"2024-04-20T21:19:35.622011+0000","last_undegraded":"2024-04-20T21:19:35.622011+0000","last_fullsized":"2024-04-20T21:19:35.622011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:46:20.508257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248977+0000","last_change":"2024-04-20T21:19:29.383418+0000","last_active":"2024-04-20T21:19:36.248977+0000","last_peered":"2024-04-20T21:19:36.248977+0000","last_clean":"2024-04-20T21:19:36.248977+0000","last_became_active":"2024-04-20T21:19:29.383070+0000","last_became_peered":"2024-04-20T21:19:29.383070+0000","last_unstale":"2024-04-20T21:19:36.248977+0000","last_undegraded":"2024-04-20T21:19:36.248977+0000","last_fullsized":"2024-04-20T21:19:36.248977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251419+0000","last_change":"2024-04-20T21:19:28.368850+0000","last_active":"2024-04-20T21:19:36.251419+0000","last_peered":"2024-04-20T21:19:36.251419+0000","last_clean":"2024-04-20T21:19:36.251419+0000","last_became_active":"2024-04-20T21:19:28.368537+0000","last_became_peered":"2024-04-20T21:19:28.368537+0000","last_unstale":"2024-04-20T21:19:36.251419+0000","last_undegraded":"2024-04-20T21:19:36.251419+0000","last_fullsized":"2024-04-20T21:19:36.251419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:39:59.354904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248012+0000","last_change":"2024-04-20T21:19:34.104458+0000","last_active":"2024-04-20T21:19:36.248012+0000","last_peered":"2024-04-20T21:19:36.248012+0000","last_clean":"2024-04-20T21:19:36.248012+0000","last_became_active":"2024-04-20T21:19:34.103757+0000","last_became_peered":"2024-04-20T21:19:34.103757+0000","last_unstale":"2024-04-20T21:19:36.248012+0000","last_undegraded":"2024-04-20T21:19:36.248012+0000","last_fullsized":"2024-04-20T21:19:36.248012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:06.169251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778559+0000","last_change":"2024-04-20T21:19:29.397580+0000","last_active":"2024-04-20T21:19:35.778559+0000","last_peered":"2024-04-20T21:19:35.778559+0000","last_clean":"2024-04-20T21:19:35.778559+0000","last_became_active":"2024-04-20T21:19:29.396682+0000","last_became_peered":"2024-04-20T21:19:29.396682+0000","last_unstale":"2024-04-20T21:19:35.778559+0000","last_undegraded":"2024-04-20T21:19:35.778559+0000","last_fullsized":"2024-04-20T21:19:35.778559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:30.291536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249055+0000","last_change":"2024-04-20T21:19:28.355329+0000","last_active":"2024-04-20T21:19:36.249055+0000","last_peered":"2024-04-20T21:19:36.249055+0000","last_clean":"2024-04-20T21:19:36.249055+0000","last_became_active":"2024-04-20T21:19:28.354650+0000","last_became_peered":"2024-04-20T21:19:28.354650+0000","last_unstale":"2024-04-20T21:19:36.249055+0000","last_undegraded":"2024-04-20T21:19:36.249055+0000","last_fullsized":"2024-04-20T21:19:36.249055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248349+0000","last_change":"2024-04-20T21:19:33.629808+0000","last_active":"2024-04-20T21:19:36.248349+0000","last_peered":"2024-04-20T21:19:36.248349+0000","last_clean":"2024-04-20T21:19:36.248349+0000","last_became_active":"2024-04-20T21:19:33.628655+0000","last_became_peered":"2024-04-20T21:19:33.628655+0000","last_unstale":"2024-04-20T21:19:36.248349+0000","last_undegraded":"2024-04-20T21:19:36.248349+0000","last_fullsized":"2024-04-20T21:19:36.248349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631211+0000","last_change":"2024-04-20T21:19:29.369139+0000","last_active":"2024-04-20T21:19:35.631211+0000","last_peered":"2024-04-20T21:19:35.631211+0000","last_clean":"2024-04-20T21:19:35.631211+0000","last_became_active":"2024-04-20T21:19:29.368508+0000","last_became_peered":"2024-04-20T21:19:29.368508+0000","last_unstale":"2024-04-20T21:19:35.631211+0000","last_undegraded":"2024-04-20T21:19:35.631211+0000","last_fullsized":"2024-04-20T21:19:35.631211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:50.979376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777730+0000","last_change":"2024-04-20T21:19:28.361884+0000","last_active":"2024-04-20T21:19:35.777730+0000","last_peered":"2024-04-20T21:19:35.777730+0000","last_clean":"2024-04-20T21:19:35.777730+0000","last_became_active":"2024-04-20T21:19:28.361455+0000","last_became_peered":"2024-04-20T21:19:28.361455+0000","last_unstale":"2024-04-20T21:19:35.777730+0000","last_undegraded":"2024-04-20T21:19:35.777730+0000","last_fullsized":"2024-04-20T21:19:35.777730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248902+0000","last_change":"2024-04-20T21:19:33.628385+0000","last_active":"2024-04-20T21:19:36.248902+0000","last_peered":"2024-04-20T21:19:36.248902+0000","last_clean":"2024-04-20T21:19:36.248902+0000","last_became_active":"2024-04-20T21:19:33.627925+0000","last_became_peered":"2024-04-20T21:19:33.627925+0000","last_unstale":"2024-04-20T21:19:36.248902+0000","last_undegraded":"2024-04-20T21:19:36.248902+0000","last_fullsized":"2024-04-20T21:19:36.248902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247403+0000","last_change":"2024-04-20T21:19:29.383757+0000","last_active":"2024-04-20T21:19:36.247403+0000","last_peered":"2024-04-20T21:19:36.247403+0000","last_clean":"2024-04-20T21:19:36.247403+0000","last_became_active":"2024-04-20T21:19:29.383265+0000","last_became_peered":"2024-04-20T21:19:29.383265+0000","last_unstale":"2024-04-20T21:19:36.247403+0000","last_undegraded":"2024-04-20T21:19:36.247403+0000","last_fullsized":"2024-04-20T21:19:36.247403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249184+0000","last_change":"2024-04-20T21:19:28.333272+0000","last_active":"2024-04-20T21:19:36.249184+0000","last_peered":"2024-04-20T21:19:36.249184+0000","last_clean":"2024-04-20T21:19:36.249184+0000","last_became_active":"2024-04-20T21:19:28.332869+0000","last_became_peered":"2024-04-20T21:19:28.332869+0000","last_unstale":"2024-04-20T21:19:36.249184+0000","last_undegraded":"2024-04-20T21:19:36.249184+0000","last_fullsized":"2024-04-20T21:19:36.249184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248513+0000","last_change":"2024-04-20T21:19:33.629923+0000","last_active":"2024-04-20T21:19:36.248513+0000","last_peered":"2024-04-20T21:19:36.248513+0000","last_clean":"2024-04-20T21:19:36.248513+0000","last_became_active":"2024-04-20T21:19:33.627690+0000","last_became_peered":"2024-04-20T21:19:33.627690+0000","last_unstale":"2024-04-20T21:19:36.248513+0000","last_undegraded":"2024-04-20T21:19:36.248513+0000","last_fullsized":"2024-04-20T21:19:36.248513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247676+0000","last_change":"2024-04-20T21:19:29.361370+0000","last_active":"2024-04-20T21:19:36.247676+0000","last_peered":"2024-04-20T21:19:36.247676+0000","last_clean":"2024-04-20T21:19:36.247676+0000","last_became_active":"2024-04-20T21:19:29.360654+0000","last_became_peered":"2024-04-20T21:19:29.360654+0000","last_unstale":"2024-04-20T21:19:36.247676+0000","last_undegraded":"2024-04-20T21:19:36.247676+0000","last_fullsized":"2024-04-20T21:19:36.247676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:08:35.086557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249697+0000","last_change":"2024-04-20T21:19:28.367397+0000","last_active":"2024-04-20T21:19:36.249697+0000","last_peered":"2024-04-20T21:19:36.249697+0000","last_clean":"2024-04-20T21:19:36.249697+0000","last_became_active":"2024-04-20T21:19:28.367133+0000","last_became_peered":"2024-04-20T21:19:28.367133+0000","last_unstale":"2024-04-20T21:19:36.249697+0000","last_undegraded":"2024-04-20T21:19:36.249697+0000","last_fullsized":"2024-04-20T21:19:36.249697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:18.220229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249641+0000","last_change":"2024-04-20T21:19:34.117121+0000","last_active":"2024-04-20T21:19:36.249641+0000","last_peered":"2024-04-20T21:19:36.249641+0000","last_clean":"2024-04-20T21:19:36.249641+0000","last_became_active":"2024-04-20T21:19:34.116147+0000","last_became_peered":"2024-04-20T21:19:34.116147+0000","last_unstale":"2024-04-20T21:19:36.249641+0000","last_undegraded":"2024-04-20T21:19:36.249641+0000","last_fullsized":"2024-04-20T21:19:36.249641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621863+0000","last_change":"2024-04-20T21:19:29.396033+0000","last_active":"2024-04-20T21:19:35.621863+0000","last_peered":"2024-04-20T21:19:35.621863+0000","last_clean":"2024-04-20T21:19:35.621863+0000","last_became_active":"2024-04-20T21:19:29.395741+0000","last_became_peered":"2024-04-20T21:19:29.395741+0000","last_unstale":"2024-04-20T21:19:35.621863+0000","last_undegraded":"2024-04-20T21:19:35.621863+0000","last_fullsized":"2024-04-20T21:19:35.621863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777536+0000","last_change":"2024-04-20T21:19:28.352100+0000","last_active":"2024-04-20T21:19:35.777536+0000","last_peered":"2024-04-20T21:19:35.777536+0000","last_clean":"2024-04-20T21:19:35.777536+0000","last_became_active":"2024-04-20T21:19:28.351795+0000","last_became_peered":"2024-04-20T21:19:28.351795+0000","last_unstale":"2024-04-20T21:19:35.777536+0000","last_undegraded":"2024-04-20T21:19:35.777536+0000","last_fullsized":"2024-04-20T21:19:35.777536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249911+0000","last_change":"2024-04-20T21:19:19.292405+0000","last_active":"2024-04-20T21:19:36.249911+0000","last_peered":"2024-04-20T21:19:36.249911+0000","last_clean":"2024-04-20T21:19:36.249911+0000","last_became_active":"2024-04-20T21:19:19.290107+0000","last_became_peered":"2024-04-20T21:19:19.290107+0000","last_unstale":"2024-04-20T21:19:36.249911+0000","last_undegraded":"2024-04-20T21:19:36.249911+0000","last_fullsized":"2024-04-20T21:19:36.249911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_clean_scrub_stamp":"2024-04-20T21:19:18.230829+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:48:44.146278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627341+0000","last_change":"2024-04-20T21:19:34.118317+0000","last_active":"2024-04-20T21:19:35.627341+0000","last_peered":"2024-04-20T21:19:35.627341+0000","last_clean":"2024-04-20T21:19:35.627341+0000","last_became_active":"2024-04-20T21:19:34.114435+0000","last_became_peered":"2024-04-20T21:19:34.114435+0000","last_unstale":"2024-04-20T21:19:35.627341+0000","last_undegraded":"2024-04-20T21:19:35.627341+0000","last_fullsized":"2024-04-20T21:19:35.627341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:11:00.818429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250762+0000","last_change":"2024-04-20T21:19:29.393324+0000","last_active":"2024-04-20T21:19:36.250762+0000","last_peered":"2024-04-20T21:19:36.250762+0000","last_clean":"2024-04-20T21:19:36.250762+0000","last_became_active":"2024-04-20T21:19:29.393007+0000","last_became_peered":"2024-04-20T21:19:29.393007+0000","last_unstale":"2024-04-20T21:19:36.250762+0000","last_undegraded":"2024-04-20T21:19:36.250762+0000","last_fullsized":"2024-04-20T21:19:36.250762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:30.291536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249830+0000","last_change":"2024-04-20T21:19:28.351503+0000","last_active":"2024-04-20T21:19:36.249830+0000","last_peered":"2024-04-20T21:19:36.249830+0000","last_clean":"2024-04-20T21:19:36.249830+0000","last_became_active":"2024-04-20T21:19:28.351160+0000","last_became_peered":"2024-04-20T21:19:28.351160+0000","last_unstale":"2024-04-20T21:19:36.249830+0000","last_undegraded":"2024-04-20T21:19:36.249830+0000","last_fullsized":"2024-04-20T21:19:36.249830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627263+0000","last_change":"2024-04-20T21:19:34.110398+0000","last_active":"2024-04-20T21:19:35.627263+0000","last_peered":"2024-04-20T21:19:35.627263+0000","last_clean":"2024-04-20T21:19:35.627263+0000","last_became_active":"2024-04-20T21:19:34.105383+0000","last_became_peered":"2024-04-20T21:19:34.105383+0000","last_unstale":"2024-04-20T21:19:35.627263+0000","last_undegraded":"2024-04-20T21:19:35.627263+0000","last_fullsized":"2024-04-20T21:19:35.627263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:25.396766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778001+0000","last_change":"2024-04-20T21:19:29.397544+0000","last_active":"2024-04-20T21:19:35.778001+0000","last_peered":"2024-04-20T21:19:35.778001+0000","last_clean":"2024-04-20T21:19:35.778001+0000","last_became_active":"2024-04-20T21:19:29.396795+0000","last_became_peered":"2024-04-20T21:19:29.396795+0000","last_unstale":"2024-04-20T21:19:35.778001+0000","last_undegraded":"2024-04-20T21:19:35.778001+0000","last_fullsized":"2024-04-20T21:19:35.778001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:31.354972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247918+0000","last_change":"2024-04-20T21:19:28.356719+0000","last_active":"2024-04-20T21:19:36.247918+0000","last_peered":"2024-04-20T21:19:36.247918+0000","last_clean":"2024-04-20T21:19:36.247918+0000","last_became_active":"2024-04-20T21:19:28.356151+0000","last_became_peered":"2024-04-20T21:19:28.356151+0000","last_unstale":"2024-04-20T21:19:36.247918+0000","last_undegraded":"2024-04-20T21:19:36.247918+0000","last_fullsized":"2024-04-20T21:19:36.247918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:28.862452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248274+0000","last_change":"2024-04-20T21:19:33.633098+0000","last_active":"2024-04-20T21:19:36.248274+0000","last_peered":"2024-04-20T21:19:36.248274+0000","last_clean":"2024-04-20T21:19:36.248274+0000","last_became_active":"2024-04-20T21:19:33.632668+0000","last_became_peered":"2024-04-20T21:19:33.632668+0000","last_unstale":"2024-04-20T21:19:36.248274+0000","last_undegraded":"2024-04-20T21:19:36.248274+0000","last_fullsized":"2024-04-20T21:19:36.248274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251856+0000","last_change":"2024-04-20T21:19:29.390579+0000","last_active":"2024-04-20T21:19:36.251856+0000","last_peered":"2024-04-20T21:19:36.251856+0000","last_clean":"2024-04-20T21:19:36.251856+0000","last_became_active":"2024-04-20T21:19:29.389845+0000","last_became_peered":"2024-04-20T21:19:29.389845+0000","last_unstale":"2024-04-20T21:19:36.251856+0000","last_undegraded":"2024-04-20T21:19:36.251856+0000","last_fullsized":"2024-04-20T21:19:36.251856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.785469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249746+0000","last_change":"2024-04-20T21:19:28.337225+0000","last_active":"2024-04-20T21:19:36.249746+0000","last_peered":"2024-04-20T21:19:36.249746+0000","last_clean":"2024-04-20T21:19:36.249746+0000","last_became_active":"2024-04-20T21:19:28.336562+0000","last_became_peered":"2024-04-20T21:19:28.336562+0000","last_unstale":"2024-04-20T21:19:36.249746+0000","last_undegraded":"2024-04-20T21:19:36.249746+0000","last_fullsized":"2024-04-20T21:19:36.249746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.776960+0000","last_change":"2024-04-20T21:19:34.106520+0000","last_active":"2024-04-20T21:19:35.776960+0000","last_peered":"2024-04-20T21:19:35.776960+0000","last_clean":"2024-04-20T21:19:35.776960+0000","last_became_active":"2024-04-20T21:19:34.105183+0000","last_became_peered":"2024-04-20T21:19:34.105183+0000","last_unstale":"2024-04-20T21:19:35.776960+0000","last_undegraded":"2024-04-20T21:19:35.776960+0000","last_fullsized":"2024-04-20T21:19:35.776960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:51:20.727243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251226+0000","last_change":"2024-04-20T21:19:29.388099+0000","last_active":"2024-04-20T21:19:36.251226+0000","last_peered":"2024-04-20T21:19:36.251226+0000","last_clean":"2024-04-20T21:19:36.251226+0000","last_became_active":"2024-04-20T21:19:29.387720+0000","last_became_peered":"2024-04-20T21:19:29.387720+0000","last_unstale":"2024-04-20T21:19:36.251226+0000","last_undegraded":"2024-04-20T21:19:36.251226+0000","last_fullsized":"2024-04-20T21:19:36.251226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:10:56.546673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630817+0000","last_change":"2024-04-20T21:19:28.351346+0000","last_active":"2024-04-20T21:19:35.630817+0000","last_peered":"2024-04-20T21:19:35.630817+0000","last_clean":"2024-04-20T21:19:35.630817+0000","last_became_active":"2024-04-20T21:19:28.350181+0000","last_became_peered":"2024-04-20T21:19:28.350181+0000","last_unstale":"2024-04-20T21:19:35.630817+0000","last_undegraded":"2024-04-20T21:19:35.630817+0000","last_fullsized":"2024-04-20T21:19:35.630817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:28:58.801546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627521+0000","last_change":"2024-04-20T21:19:33.633495+0000","last_active":"2024-04-20T21:19:35.627521+0000","last_peered":"2024-04-20T21:19:35.627521+0000","last_clean":"2024-04-20T21:19:35.627521+0000","last_became_active":"2024-04-20T21:19:33.632961+0000","last_became_peered":"2024-04-20T21:19:33.632961+0000","last_unstale":"2024-04-20T21:19:35.627521+0000","last_undegraded":"2024-04-20T21:19:35.627521+0000","last_fullsized":"2024-04-20T21:19:35.627521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:11:00.818429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249980+0000","last_change":"2024-04-20T21:19:29.386658+0000","last_active":"2024-04-20T21:19:36.249980+0000","last_peered":"2024-04-20T21:19:36.249980+0000","last_clean":"2024-04-20T21:19:36.249980+0000","last_became_active":"2024-04-20T21:19:29.385316+0000","last_became_peered":"2024-04-20T21:19:29.385316+0000","last_unstale":"2024-04-20T21:19:36.249980+0000","last_undegraded":"2024-04-20T21:19:36.249980+0000","last_fullsized":"2024-04-20T21:19:36.249980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248902+0000","last_change":"2024-04-20T21:19:28.346894+0000","last_active":"2024-04-20T21:19:36.248902+0000","last_peered":"2024-04-20T21:19:36.248902+0000","last_clean":"2024-04-20T21:19:36.248902+0000","last_became_active":"2024-04-20T21:19:28.346501+0000","last_became_peered":"2024-04-20T21:19:28.346501+0000","last_unstale":"2024-04-20T21:19:36.248902+0000","last_undegraded":"2024-04-20T21:19:36.248902+0000","last_fullsized":"2024-04-20T21:19:36.248902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249377+0000","last_change":"2024-04-20T21:19:33.624256+0000","last_active":"2024-04-20T21:19:36.249377+0000","last_peered":"2024-04-20T21:19:36.249377+0000","last_clean":"2024-04-20T21:19:36.249377+0000","last_became_active":"2024-04-20T21:19:33.623535+0000","last_became_peered":"2024-04-20T21:19:33.623535+0000","last_unstale":"2024-04-20T21:19:36.249377+0000","last_undegraded":"2024-04-20T21:19:36.249377+0000","last_fullsized":"2024-04-20T21:19:36.249377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626744+0000","last_change":"2024-04-20T21:19:29.365502+0000","last_active":"2024-04-20T21:19:35.626744+0000","last_peered":"2024-04-20T21:19:35.626744+0000","last_clean":"2024-04-20T21:19:35.626744+0000","last_became_active":"2024-04-20T21:19:29.364467+0000","last_became_peered":"2024-04-20T21:19:29.364467+0000","last_unstale":"2024-04-20T21:19:35.626744+0000","last_undegraded":"2024-04-20T21:19:35.626744+0000","last_fullsized":"2024-04-20T21:19:35.626744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626909+0000","last_change":"2024-04-20T21:19:28.344379+0000","last_active":"2024-04-20T21:19:35.626909+0000","last_peered":"2024-04-20T21:19:35.626909+0000","last_clean":"2024-04-20T21:19:35.626909+0000","last_became_active":"2024-04-20T21:19:28.343961+0000","last_became_peered":"2024-04-20T21:19:28.343961+0000","last_unstale":"2024-04-20T21:19:35.626909+0000","last_undegraded":"2024-04-20T21:19:35.626909+0000","last_fullsized":"2024-04-20T21:19:35.626909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623180+0000","last_change":"2024-04-20T21:19:34.117654+0000","last_active":"2024-04-20T21:19:35.623180+0000","last_peered":"2024-04-20T21:19:35.623180+0000","last_clean":"2024-04-20T21:19:35.623180+0000","last_became_active":"2024-04-20T21:19:34.116853+0000","last_became_peered":"2024-04-20T21:19:34.116853+0000","last_unstale":"2024-04-20T21:19:35.623180+0000","last_undegraded":"2024-04-20T21:19:35.623180+0000","last_fullsized":"2024-04-20T21:19:35.623180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:52:51.896627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250332+0000","last_change":"2024-04-20T21:19:29.382869+0000","last_active":"2024-04-20T21:19:36.250332+0000","last_peered":"2024-04-20T21:19:36.250332+0000","last_clean":"2024-04-20T21:19:36.250332+0000","last_became_active":"2024-04-20T21:19:29.382468+0000","last_became_peered":"2024-04-20T21:19:29.382468+0000","last_unstale":"2024-04-20T21:19:36.250332+0000","last_undegraded":"2024-04-20T21:19:36.250332+0000","last_fullsized":"2024-04-20T21:19:36.250332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:33:21.125011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777629+0000","last_change":"2024-04-20T21:19:28.357934+0000","last_active":"2024-04-20T21:19:35.777629+0000","last_peered":"2024-04-20T21:19:35.777629+0000","last_clean":"2024-04-20T21:19:35.777629+0000","last_became_active":"2024-04-20T21:19:28.357449+0000","last_became_peered":"2024-04-20T21:19:28.357449+0000","last_unstale":"2024-04-20T21:19:35.777629+0000","last_undegraded":"2024-04-20T21:19:35.777629+0000","last_fullsized":"2024-04-20T21:19:35.777629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:56:27.305991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622808+0000","last_change":"2024-04-20T21:19:34.105481+0000","last_active":"2024-04-20T21:19:35.622808+0000","last_peered":"2024-04-20T21:19:35.622808+0000","last_clean":"2024-04-20T21:19:35.622808+0000","last_became_active":"2024-04-20T21:19:34.104398+0000","last_became_peered":"2024-04-20T21:19:34.104398+0000","last_unstale":"2024-04-20T21:19:35.622808+0000","last_undegraded":"2024-04-20T21:19:35.622808+0000","last_fullsized":"2024-04-20T21:19:35.622808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:00:47.266412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248125+0000","last_change":"2024-04-20T21:19:29.387882+0000","last_active":"2024-04-20T21:19:36.248125+0000","last_peered":"2024-04-20T21:19:36.248125+0000","last_clean":"2024-04-20T21:19:36.248125+0000","last_became_active":"2024-04-20T21:19:29.387548+0000","last_became_peered":"2024-04-20T21:19:29.387548+0000","last_unstale":"2024-04-20T21:19:36.248125+0000","last_undegraded":"2024-04-20T21:19:36.248125+0000","last_fullsized":"2024-04-20T21:19:36.248125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:33:55.067533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248579+0000","last_change":"2024-04-20T21:19:28.350496+0000","last_active":"2024-04-20T21:19:36.248579+0000","last_peered":"2024-04-20T21:19:36.248579+0000","last_clean":"2024-04-20T21:19:36.248579+0000","last_became_active":"2024-04-20T21:19:28.350170+0000","last_became_peered":"2024-04-20T21:19:28.350170+0000","last_unstale":"2024-04-20T21:19:36.248579+0000","last_undegraded":"2024-04-20T21:19:36.248579+0000","last_fullsized":"2024-04-20T21:19:36.248579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:12:37.534140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778364+0000","last_change":"2024-04-20T21:19:34.117079+0000","last_active":"2024-04-20T21:19:35.778364+0000","last_peered":"2024-04-20T21:19:35.778364+0000","last_clean":"2024-04-20T21:19:35.778364+0000","last_became_active":"2024-04-20T21:19:34.116404+0000","last_became_peered":"2024-04-20T21:19:34.116404+0000","last_unstale":"2024-04-20T21:19:35.778364+0000","last_undegraded":"2024-04-20T21:19:35.778364+0000","last_fullsized":"2024-04-20T21:19:35.778364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:26:28.450644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250605+0000","last_change":"2024-04-20T21:19:29.378275+0000","last_active":"2024-04-20T21:19:36.250605+0000","last_peered":"2024-04-20T21:19:36.250605+0000","last_clean":"2024-04-20T21:19:36.250605+0000","last_became_active":"2024-04-20T21:19:29.377896+0000","last_became_peered":"2024-04-20T21:19:29.377896+0000","last_unstale":"2024-04-20T21:19:36.250605+0000","last_undegraded":"2024-04-20T21:19:36.250605+0000","last_fullsized":"2024-04-20T21:19:36.250605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:18:33.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:48.859685+0000","last_change":"2024-04-20T21:19:28.357217+0000","last_active":"2024-04-20T21:19:48.859685+0000","last_peered":"2024-04-20T21:19:48.859685+0000","last_clean":"2024-04-20T21:19:48.859685+0000","last_became_active":"2024-04-20T21:19:28.356914+0000","last_became_peered":"2024-04-20T21:19:28.356914+0000","last_unstale":"2024-04-20T21:19:48.859685+0000","last_undegraded":"2024-04-20T21:19:48.859685+0000","last_fullsized":"2024-04-20T21:19:48.859685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248585+0000","last_change":"2024-04-20T21:19:33.629911+0000","last_active":"2024-04-20T21:19:36.248585+0000","last_peered":"2024-04-20T21:19:36.248585+0000","last_clean":"2024-04-20T21:19:36.248585+0000","last_became_active":"2024-04-20T21:19:33.627809+0000","last_became_peered":"2024-04-20T21:19:33.627809+0000","last_unstale":"2024-04-20T21:19:36.248585+0000","last_undegraded":"2024-04-20T21:19:36.248585+0000","last_fullsized":"2024-04-20T21:19:36.248585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:15:07.727545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631585+0000","last_change":"2024-04-20T21:19:29.393393+0000","last_active":"2024-04-20T21:19:35.631585+0000","last_peered":"2024-04-20T21:19:35.631585+0000","last_clean":"2024-04-20T21:19:35.631585+0000","last_became_active":"2024-04-20T21:19:29.390071+0000","last_became_peered":"2024-04-20T21:19:29.390071+0000","last_unstale":"2024-04-20T21:19:35.631585+0000","last_undegraded":"2024-04-20T21:19:35.631585+0000","last_fullsized":"2024-04-20T21:19:35.631585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:20:46.967851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247809+0000","last_change":"2024-04-20T21:19:28.356567+0000","last_active":"2024-04-20T21:19:36.247809+0000","last_peered":"2024-04-20T21:19:36.247809+0000","last_clean":"2024-04-20T21:19:36.247809+0000","last_became_active":"2024-04-20T21:19:28.355822+0000","last_became_peered":"2024-04-20T21:19:28.355822+0000","last_unstale":"2024-04-20T21:19:36.247809+0000","last_undegraded":"2024-04-20T21:19:36.247809+0000","last_fullsized":"2024-04-20T21:19:36.247809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.630778+0000","last_change":"2024-04-20T21:19:33.630542+0000","last_active":"2024-04-20T21:19:35.630778+0000","last_peered":"2024-04-20T21:19:35.630778+0000","last_clean":"2024-04-20T21:19:35.630778+0000","last_became_active":"2024-04-20T21:19:33.630162+0000","last_became_peered":"2024-04-20T21:19:33.630162+0000","last_unstale":"2024-04-20T21:19:35.630778+0000","last_undegraded":"2024-04-20T21:19:35.630778+0000","last_fullsized":"2024-04-20T21:19:35.630778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:58.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.250252+0000","last_change":"2024-04-20T21:19:29.381811+0000","last_active":"2024-04-20T21:19:36.250252+0000","last_peered":"2024-04-20T21:19:36.250252+0000","last_clean":"2024-04-20T21:19:36.250252+0000","last_became_active":"2024-04-20T21:19:29.381476+0000","last_became_peered":"2024-04-20T21:19:29.381476+0000","last_unstale":"2024-04-20T21:19:36.250252+0000","last_undegraded":"2024-04-20T21:19:36.250252+0000","last_fullsized":"2024-04-20T21:19:36.250252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778382+0000","last_change":"2024-04-20T21:19:28.362269+0000","last_active":"2024-04-20T21:19:35.778382+0000","last_peered":"2024-04-20T21:19:35.778382+0000","last_clean":"2024-04-20T21:19:35.778382+0000","last_became_active":"2024-04-20T21:19:28.361977+0000","last_became_peered":"2024-04-20T21:19:28.361977+0000","last_unstale":"2024-04-20T21:19:35.778382+0000","last_undegraded":"2024-04-20T21:19:35.778382+0000","last_fullsized":"2024-04-20T21:19:35.778382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:29:49.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621838+0000","last_change":"2024-04-20T21:19:33.628173+0000","last_active":"2024-04-20T21:19:35.621838+0000","last_peered":"2024-04-20T21:19:35.621838+0000","last_clean":"2024-04-20T21:19:35.621838+0000","last_became_active":"2024-04-20T21:19:33.627775+0000","last_became_peered":"2024-04-20T21:19:33.627775+0000","last_unstale":"2024-04-20T21:19:35.621838+0000","last_undegraded":"2024-04-20T21:19:35.621838+0000","last_fullsized":"2024-04-20T21:19:35.621838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:10:39.630401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778156+0000","last_change":"2024-04-20T21:19:29.395176+0000","last_active":"2024-04-20T21:19:35.778156+0000","last_peered":"2024-04-20T21:19:35.778156+0000","last_clean":"2024-04-20T21:19:35.778156+0000","last_became_active":"2024-04-20T21:19:29.394888+0000","last_became_peered":"2024-04-20T21:19:29.394888+0000","last_unstale":"2024-04-20T21:19:35.778156+0000","last_undegraded":"2024-04-20T21:19:35.778156+0000","last_fullsized":"2024-04-20T21:19:35.778156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:04:32.875201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628548+0000","last_change":"2024-04-20T21:19:28.365114+0000","last_active":"2024-04-20T21:19:35.628548+0000","last_peered":"2024-04-20T21:19:35.628548+0000","last_clean":"2024-04-20T21:19:35.628548+0000","last_became_active":"2024-04-20T21:19:28.364582+0000","last_became_peered":"2024-04-20T21:19:28.364582+0000","last_unstale":"2024-04-20T21:19:35.628548+0000","last_undegraded":"2024-04-20T21:19:35.628548+0000","last_fullsized":"2024-04-20T21:19:35.628548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622261+0000","last_change":"2024-04-20T21:19:34.106093+0000","last_active":"2024-04-20T21:19:35.622261+0000","last_peered":"2024-04-20T21:19:35.622261+0000","last_clean":"2024-04-20T21:19:35.622261+0000","last_became_active":"2024-04-20T21:19:34.104164+0000","last_became_peered":"2024-04-20T21:19:34.104164+0000","last_unstale":"2024-04-20T21:19:35.622261+0000","last_undegraded":"2024-04-20T21:19:35.622261+0000","last_fullsized":"2024-04-20T21:19:35.622261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:59:46.407601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249367+0000","last_change":"2024-04-20T21:19:34.114115+0000","last_active":"2024-04-20T21:19:36.249367+0000","last_peered":"2024-04-20T21:19:36.249367+0000","last_clean":"2024-04-20T21:19:36.249367+0000","last_became_active":"2024-04-20T21:19:34.113101+0000","last_became_peered":"2024-04-20T21:19:34.113101+0000","last_unstale":"2024-04-20T21:19:36.249367+0000","last_undegraded":"2024-04-20T21:19:36.249367+0000","last_fullsized":"2024-04-20T21:19:36.249367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:37.534613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247565+0000","last_change":"2024-04-20T21:19:29.393883+0000","last_active":"2024-04-20T21:19:36.247565+0000","last_peered":"2024-04-20T21:19:36.247565+0000","last_clean":"2024-04-20T21:19:36.247565+0000","last_became_active":"2024-04-20T21:19:29.386937+0000","last_became_peered":"2024-04-20T21:19:29.386937+0000","last_unstale":"2024-04-20T21:19:36.247565+0000","last_undegraded":"2024-04-20T21:19:36.247565+0000","last_fullsized":"2024-04-20T21:19:36.247565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777355+0000","last_change":"2024-04-20T21:19:28.354817+0000","last_active":"2024-04-20T21:19:35.777355+0000","last_peered":"2024-04-20T21:19:35.777355+0000","last_clean":"2024-04-20T21:19:35.777355+0000","last_became_active":"2024-04-20T21:19:28.354434+0000","last_became_peered":"2024-04-20T21:19:28.354434+0000","last_unstale":"2024-04-20T21:19:35.777355+0000","last_undegraded":"2024-04-20T21:19:35.777355+0000","last_fullsized":"2024-04-20T21:19:35.777355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:33:49.734695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628259+0000","last_change":"2024-04-20T21:19:33.633277+0000","last_active":"2024-04-20T21:19:35.628259+0000","last_peered":"2024-04-20T21:19:35.628259+0000","last_clean":"2024-04-20T21:19:35.628259+0000","last_became_active":"2024-04-20T21:19:33.632836+0000","last_became_peered":"2024-04-20T21:19:33.632836+0000","last_unstale":"2024-04-20T21:19:35.628259+0000","last_undegraded":"2024-04-20T21:19:35.628259+0000","last_fullsized":"2024-04-20T21:19:35.628259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:04:34.563292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621917+0000","last_change":"2024-04-20T21:19:29.398015+0000","last_active":"2024-04-20T21:19:35.621917+0000","last_peered":"2024-04-20T21:19:35.621917+0000","last_clean":"2024-04-20T21:19:35.621917+0000","last_became_active":"2024-04-20T21:19:29.395864+0000","last_became_peered":"2024-04-20T21:19:29.395864+0000","last_unstale":"2024-04-20T21:19:35.621917+0000","last_undegraded":"2024-04-20T21:19:35.621917+0000","last_fullsized":"2024-04-20T21:19:35.621917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622466+0000","last_change":"2024-04-20T21:19:28.344162+0000","last_active":"2024-04-20T21:19:35.622466+0000","last_peered":"2024-04-20T21:19:35.622466+0000","last_clean":"2024-04-20T21:19:35.622466+0000","last_became_active":"2024-04-20T21:19:28.343750+0000","last_became_peered":"2024-04-20T21:19:28.343750+0000","last_unstale":"2024-04-20T21:19:35.622466+0000","last_undegraded":"2024-04-20T21:19:35.622466+0000","last_fullsized":"2024-04-20T21:19:35.622466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627612+0000","last_change":"2024-04-20T21:19:28.351320+0000","last_active":"2024-04-20T21:19:35.627612+0000","last_peered":"2024-04-20T21:19:35.627612+0000","last_clean":"2024-04-20T21:19:35.627612+0000","last_became_active":"2024-04-20T21:19:28.350995+0000","last_became_peered":"2024-04-20T21:19:28.350995+0000","last_unstale":"2024-04-20T21:19:35.627612+0000","last_undegraded":"2024-04-20T21:19:35.627612+0000","last_fullsized":"2024-04-20T21:19:35.627612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:58.910158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248483+0000","last_change":"2024-04-20T21:19:29.362059+0000","last_active":"2024-04-20T21:19:36.248483+0000","last_peered":"2024-04-20T21:19:36.248483+0000","last_clean":"2024-04-20T21:19:36.248483+0000","last_became_active":"2024-04-20T21:19:29.361382+0000","last_became_peered":"2024-04-20T21:19:29.361382+0000","last_unstale":"2024-04-20T21:19:36.248483+0000","last_undegraded":"2024-04-20T21:19:36.248483+0000","last_fullsized":"2024-04-20T21:19:36.248483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249695+0000","last_change":"2024-04-20T21:19:33.628104+0000","last_active":"2024-04-20T21:19:36.249695+0000","last_peered":"2024-04-20T21:19:36.249695+0000","last_clean":"2024-04-20T21:19:36.249695+0000","last_became_active":"2024-04-20T21:19:33.627676+0000","last_became_peered":"2024-04-20T21:19:33.627676+0000","last_unstale":"2024-04-20T21:19:36.249695+0000","last_undegraded":"2024-04-20T21:19:36.249695+0000","last_fullsized":"2024-04-20T21:19:36.249695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:08:39.358313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622581+0000","last_change":"2024-04-20T21:19:28.365916+0000","last_active":"2024-04-20T21:19:35.622581+0000","last_peered":"2024-04-20T21:19:35.622581+0000","last_clean":"2024-04-20T21:19:35.622581+0000","last_became_active":"2024-04-20T21:19:28.365502+0000","last_became_peered":"2024-04-20T21:19:28.365502+0000","last_unstale":"2024-04-20T21:19:35.622581+0000","last_undegraded":"2024-04-20T21:19:35.622581+0000","last_fullsized":"2024-04-20T21:19:35.622581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:27.304178+0000","last_clean_scrub_stamp":"2024-04-20T21:19:27.304178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:27:04.018569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.629989+0000","last_change":"2024-04-20T21:19:29.387418+0000","last_active":"2024-04-20T21:19:35.629989+0000","last_peered":"2024-04-20T21:19:35.629989+0000","last_clean":"2024-04-20T21:19:35.629989+0000","last_became_active":"2024-04-20T21:19:29.387044+0000","last_became_peered":"2024-04-20T21:19:29.387044+0000","last_unstale":"2024-04-20T21:19:35.629989+0000","last_undegraded":"2024-04-20T21:19:35.629989+0000","last_fullsized":"2024-04-20T21:19:35.629989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:14:29.867631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622991+0000","last_change":"2024-04-20T21:19:33.633365+0000","last_active":"2024-04-20T21:19:35.622991+0000","last_peered":"2024-04-20T21:19:35.622991+0000","last_clean":"2024-04-20T21:19:35.622991+0000","last_became_active":"2024-04-20T21:19:33.631294+0000","last_became_peered":"2024-04-20T21:19:33.631294+0000","last_unstale":"2024-04-20T21:19:35.622991+0000","last_undegraded":"2024-04-20T21:19:35.622991+0000","last_fullsized":"2024-04-20T21:19:35.622991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:32.581113+0000","last_clean_scrub_stamp":"2024-04-20T21:19:32.581113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:44.969195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.626471+0000","last_change":"2024-04-20T21:19:29.374532+0000","last_active":"2024-04-20T21:19:35.626471+0000","last_peered":"2024-04-20T21:19:35.626471+0000","last_clean":"2024-04-20T21:19:35.626471+0000","last_became_active":"2024-04-20T21:19:29.370664+0000","last_became_peered":"2024-04-20T21:19:29.370664+0000","last_unstale":"2024-04-20T21:19:35.626471+0000","last_undegraded":"2024-04-20T21:19:35.626471+0000","last_fullsized":"2024-04-20T21:19:35.626471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249094+0000","last_change":"2024-04-20T21:19:29.391603+0000","last_active":"2024-04-20T21:19:36.249094+0000","last_peered":"2024-04-20T21:19:36.249094+0000","last_clean":"2024-04-20T21:19:36.249094+0000","last_became_active":"2024-04-20T21:19:29.391336+0000","last_became_peered":"2024-04-20T21:19:29.391336+0000","last_unstale":"2024-04-20T21:19:36.249094+0000","last_undegraded":"2024-04-20T21:19:36.249094+0000","last_fullsized":"2024-04-20T21:19:36.249094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:40:00.360083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777450+0000","last_change":"2024-04-20T21:19:29.397118+0000","last_active":"2024-04-20T21:19:35.777450+0000","last_peered":"2024-04-20T21:19:35.777450+0000","last_clean":"2024-04-20T21:19:35.777450+0000","last_became_active":"2024-04-20T21:19:29.396809+0000","last_became_peered":"2024-04-20T21:19:29.396809+0000","last_unstale":"2024-04-20T21:19:35.777450+0000","last_undegraded":"2024-04-20T21:19:35.777450+0000","last_fullsized":"2024-04-20T21:19:35.777450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:03:55.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248383+0000","last_change":"2024-04-20T21:19:29.380740+0000","last_active":"2024-04-20T21:19:36.248383+0000","last_peered":"2024-04-20T21:19:36.248383+0000","last_clean":"2024-04-20T21:19:36.248383+0000","last_became_active":"2024-04-20T21:19:29.378870+0000","last_became_peered":"2024-04-20T21:19:29.378870+0000","last_unstale":"2024-04-20T21:19:36.248383+0000","last_undegraded":"2024-04-20T21:19:36.248383+0000","last_fullsized":"2024-04-20T21:19:36.248383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:12:33.798404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622922+0000","last_change":"2024-04-20T21:19:29.376821+0000","last_active":"2024-04-20T21:19:35.622922+0000","last_peered":"2024-04-20T21:19:35.622922+0000","last_clean":"2024-04-20T21:19:35.622922+0000","last_became_active":"2024-04-20T21:19:29.372264+0000","last_became_peered":"2024-04-20T21:19:29.372264+0000","last_unstale":"2024-04-20T21:19:35.622922+0000","last_undegraded":"2024-04-20T21:19:35.622922+0000","last_fullsized":"2024-04-20T21:19:35.622922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.247633+0000","last_change":"2024-04-20T21:19:29.380388+0000","last_active":"2024-04-20T21:19:36.247633+0000","last_peered":"2024-04-20T21:19:36.247633+0000","last_clean":"2024-04-20T21:19:36.247633+0000","last_became_active":"2024-04-20T21:19:29.380055+0000","last_became_peered":"2024-04-20T21:19:29.380055+0000","last_unstale":"2024-04-20T21:19:36.247633+0000","last_undegraded":"2024-04-20T21:19:36.247633+0000","last_fullsized":"2024-04-20T21:19:36.247633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628752+0000","last_change":"2024-04-20T21:19:29.392961+0000","last_active":"2024-04-20T21:19:35.628752+0000","last_peered":"2024-04-20T21:19:35.628752+0000","last_clean":"2024-04-20T21:19:35.628752+0000","last_became_active":"2024-04-20T21:19:29.392692+0000","last_became_peered":"2024-04-20T21:19:29.392692+0000","last_unstale":"2024-04-20T21:19:35.628752+0000","last_undegraded":"2024-04-20T21:19:35.628752+0000","last_fullsized":"2024-04-20T21:19:35.628752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.623208+0000","last_change":"2024-04-20T21:19:29.380591+0000","last_active":"2024-04-20T21:19:35.623208+0000","last_peered":"2024-04-20T21:19:35.623208+0000","last_clean":"2024-04-20T21:19:35.623208+0000","last_became_active":"2024-04-20T21:19:29.380070+0000","last_became_peered":"2024-04-20T21:19:29.380070+0000","last_unstale":"2024-04-20T21:19:35.623208+0000","last_undegraded":"2024-04-20T21:19:35.623208+0000","last_fullsized":"2024-04-20T21:19:35.623208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:04:32.875201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777341+0000","last_change":"2024-04-20T21:19:29.384690+0000","last_active":"2024-04-20T21:19:35.777341+0000","last_peered":"2024-04-20T21:19:35.777341+0000","last_clean":"2024-04-20T21:19:35.777341+0000","last_became_active":"2024-04-20T21:19:29.383536+0000","last_became_peered":"2024-04-20T21:19:29.383536+0000","last_unstale":"2024-04-20T21:19:35.777341+0000","last_undegraded":"2024-04-20T21:19:35.777341+0000","last_fullsized":"2024-04-20T21:19:35.777341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:02:07.474019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.622322+0000","last_change":"2024-04-20T21:19:29.380657+0000","last_active":"2024-04-20T21:19:35.622322+0000","last_peered":"2024-04-20T21:19:35.622322+0000","last_clean":"2024-04-20T21:19:35.622322+0000","last_became_active":"2024-04-20T21:19:29.380107+0000","last_became_peered":"2024-04-20T21:19:29.380107+0000","last_unstale":"2024-04-20T21:19:35.622322+0000","last_undegraded":"2024-04-20T21:19:35.622322+0000","last_fullsized":"2024-04-20T21:19:35.622322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777381+0000","last_change":"2024-04-20T21:19:29.388441+0000","last_active":"2024-04-20T21:19:35.777381+0000","last_peered":"2024-04-20T21:19:35.777381+0000","last_clean":"2024-04-20T21:19:35.777381+0000","last_became_active":"2024-04-20T21:19:29.388153+0000","last_became_peered":"2024-04-20T21:19:29.388153+0000","last_unstale":"2024-04-20T21:19:35.777381+0000","last_undegraded":"2024-04-20T21:19:35.777381+0000","last_fullsized":"2024-04-20T21:19:35.777381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:24:23.709381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248119+0000","last_change":"2024-04-20T21:19:29.381637+0000","last_active":"2024-04-20T21:19:36.248119+0000","last_peered":"2024-04-20T21:19:36.248119+0000","last_clean":"2024-04-20T21:19:36.248119+0000","last_became_active":"2024-04-20T21:19:29.380117+0000","last_became_peered":"2024-04-20T21:19:29.380117+0000","last_unstale":"2024-04-20T21:19:36.248119+0000","last_undegraded":"2024-04-20T21:19:36.248119+0000","last_fullsized":"2024-04-20T21:19:36.248119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628156+0000","last_change":"2024-04-20T21:19:29.371702+0000","last_active":"2024-04-20T21:19:35.628156+0000","last_peered":"2024-04-20T21:19:35.628156+0000","last_clean":"2024-04-20T21:19:35.628156+0000","last_became_active":"2024-04-20T21:19:29.371414+0000","last_became_peered":"2024-04-20T21:19:29.371414+0000","last_unstale":"2024-04-20T21:19:35.628156+0000","last_undegraded":"2024-04-20T21:19:35.628156+0000","last_fullsized":"2024-04-20T21:19:35.628156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251098+0000","last_change":"2024-04-20T21:19:29.389612+0000","last_active":"2024-04-20T21:19:36.251098+0000","last_peered":"2024-04-20T21:19:36.251098+0000","last_clean":"2024-04-20T21:19:36.251098+0000","last_became_active":"2024-04-20T21:19:29.389324+0000","last_became_peered":"2024-04-20T21:19:29.389324+0000","last_unstale":"2024-04-20T21:19:36.251098+0000","last_undegraded":"2024-04-20T21:19:36.251098+0000","last_fullsized":"2024-04-20T21:19:36.251098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:55:33.262857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249637+0000","last_change":"2024-04-20T21:19:29.382113+0000","last_active":"2024-04-20T21:19:36.249637+0000","last_peered":"2024-04-20T21:19:36.249637+0000","last_clean":"2024-04-20T21:19:36.249637+0000","last_became_active":"2024-04-20T21:19:29.381256+0000","last_became_peered":"2024-04-20T21:19:29.381256+0000","last_unstale":"2024-04-20T21:19:36.249637+0000","last_undegraded":"2024-04-20T21:19:36.249637+0000","last_fullsized":"2024-04-20T21:19:36.249637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:03:39.489134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.778694+0000","last_change":"2024-04-20T21:19:29.395827+0000","last_active":"2024-04-20T21:19:35.778694+0000","last_peered":"2024-04-20T21:19:35.778694+0000","last_clean":"2024-04-20T21:19:35.778694+0000","last_became_active":"2024-04-20T21:19:29.395560+0000","last_became_peered":"2024-04-20T21:19:29.395560+0000","last_unstale":"2024-04-20T21:19:35.778694+0000","last_undegraded":"2024-04-20T21:19:35.778694+0000","last_fullsized":"2024-04-20T21:19:35.778694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:27:55.214090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.776970+0000","last_change":"2024-04-20T21:19:29.389510+0000","last_active":"2024-04-20T21:19:35.776970+0000","last_peered":"2024-04-20T21:19:35.776970+0000","last_clean":"2024-04-20T21:19:35.776970+0000","last_became_active":"2024-04-20T21:19:29.389143+0000","last_became_peered":"2024-04-20T21:19:29.389143+0000","last_unstale":"2024-04-20T21:19:35.776970+0000","last_undegraded":"2024-04-20T21:19:35.776970+0000","last_fullsized":"2024-04-20T21:19:35.776970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249525+0000","last_change":"2024-04-20T21:19:29.374703+0000","last_active":"2024-04-20T21:19:36.249525+0000","last_peered":"2024-04-20T21:19:36.249525+0000","last_clean":"2024-04-20T21:19:36.249525+0000","last_became_active":"2024-04-20T21:19:29.374027+0000","last_became_peered":"2024-04-20T21:19:29.374027+0000","last_unstale":"2024-04-20T21:19:36.249525+0000","last_undegraded":"2024-04-20T21:19:36.249525+0000","last_fullsized":"2024-04-20T21:19:36.249525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.248059+0000","last_change":"2024-04-20T21:19:29.377330+0000","last_active":"2024-04-20T21:19:36.248059+0000","last_peered":"2024-04-20T21:19:36.248059+0000","last_clean":"2024-04-20T21:19:36.248059+0000","last_became_active":"2024-04-20T21:19:29.377054+0000","last_became_peered":"2024-04-20T21:19:29.377054+0000","last_unstale":"2024-04-20T21:19:36.248059+0000","last_undegraded":"2024-04-20T21:19:36.248059+0000","last_fullsized":"2024-04-20T21:19:36.248059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621838+0000","last_change":"2024-04-20T21:19:29.379509+0000","last_active":"2024-04-20T21:19:35.621838+0000","last_peered":"2024-04-20T21:19:35.621838+0000","last_clean":"2024-04-20T21:19:35.621838+0000","last_became_active":"2024-04-20T21:19:29.379077+0000","last_became_peered":"2024-04-20T21:19:29.379077+0000","last_unstale":"2024-04-20T21:19:35.621838+0000","last_undegraded":"2024-04-20T21:19:35.621838+0000","last_fullsized":"2024-04-20T21:19:35.621838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:28:37.358983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.631470+0000","last_change":"2024-04-20T21:19:29.371610+0000","last_active":"2024-04-20T21:19:35.631470+0000","last_peered":"2024-04-20T21:19:35.631470+0000","last_clean":"2024-04-20T21:19:35.631470+0000","last_became_active":"2024-04-20T21:19:29.371194+0000","last_became_peered":"2024-04-20T21:19:29.371194+0000","last_unstale":"2024-04-20T21:19:35.631470+0000","last_undegraded":"2024-04-20T21:19:35.631470+0000","last_fullsized":"2024-04-20T21:19:35.631470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:50:19.225408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.627705+0000","last_change":"2024-04-20T21:19:29.381261+0000","last_active":"2024-04-20T21:19:35.627705+0000","last_peered":"2024-04-20T21:19:35.627705+0000","last_clean":"2024-04-20T21:19:35.627705+0000","last_became_active":"2024-04-20T21:19:29.380856+0000","last_became_peered":"2024-04-20T21:19:29.380856+0000","last_unstale":"2024-04-20T21:19:35.627705+0000","last_undegraded":"2024-04-20T21:19:35.627705+0000","last_fullsized":"2024-04-20T21:19:35.627705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.628482+0000","last_change":"2024-04-20T21:19:29.388748+0000","last_active":"2024-04-20T21:19:35.628482+0000","last_peered":"2024-04-20T21:19:35.628482+0000","last_clean":"2024-04-20T21:19:35.628482+0000","last_became_active":"2024-04-20T21:19:29.388227+0000","last_became_peered":"2024-04-20T21:19:29.388227+0000","last_unstale":"2024-04-20T21:19:35.628482+0000","last_undegraded":"2024-04-20T21:19:35.628482+0000","last_fullsized":"2024-04-20T21:19:35.628482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:22:32.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251764+0000","last_change":"2024-04-20T21:19:29.392148+0000","last_active":"2024-04-20T21:19:36.251764+0000","last_peered":"2024-04-20T21:19:36.251764+0000","last_clean":"2024-04-20T21:19:36.251764+0000","last_became_active":"2024-04-20T21:19:29.391719+0000","last_became_peered":"2024-04-20T21:19:29.391719+0000","last_unstale":"2024-04-20T21:19:36.251764+0000","last_undegraded":"2024-04-20T21:19:36.251764+0000","last_fullsized":"2024-04-20T21:19:36.251764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:31.354972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.621658+0000","last_change":"2024-04-20T21:19:29.401358+0000","last_active":"2024-04-20T21:19:35.621658+0000","last_peered":"2024-04-20T21:19:35.621658+0000","last_clean":"2024-04-20T21:19:35.621658+0000","last_became_active":"2024-04-20T21:19:29.401015+0000","last_became_peered":"2024-04-20T21:19:29.401015+0000","last_unstale":"2024-04-20T21:19:35.621658+0000","last_undegraded":"2024-04-20T21:19:35.621658+0000","last_fullsized":"2024-04-20T21:19:35.621658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:20:33.961371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249862+0000","last_change":"2024-04-20T21:19:29.378374+0000","last_active":"2024-04-20T21:19:36.249862+0000","last_peered":"2024-04-20T21:19:36.249862+0000","last_clean":"2024-04-20T21:19:36.249862+0000","last_became_active":"2024-04-20T21:19:29.377992+0000","last_became_peered":"2024-04-20T21:19:29.377992+0000","last_unstale":"2024-04-20T21:19:36.249862+0000","last_undegraded":"2024-04-20T21:19:36.249862+0000","last_fullsized":"2024-04-20T21:19:36.249862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:01:25.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777114+0000","last_change":"2024-04-20T21:19:29.388283+0000","last_active":"2024-04-20T21:19:35.777114+0000","last_peered":"2024-04-20T21:19:35.777114+0000","last_clean":"2024-04-20T21:19:35.777114+0000","last_became_active":"2024-04-20T21:19:29.386243+0000","last_became_peered":"2024-04-20T21:19:29.386243+0000","last_unstale":"2024-04-20T21:19:35.777114+0000","last_undegraded":"2024-04-20T21:19:35.777114+0000","last_fullsized":"2024-04-20T21:19:35.777114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:47:44.627306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249862+0000","last_change":"2024-04-20T21:19:29.387887+0000","last_active":"2024-04-20T21:19:36.249862+0000","last_peered":"2024-04-20T21:19:36.249862+0000","last_clean":"2024-04-20T21:19:36.249862+0000","last_became_active":"2024-04-20T21:19:29.387481+0000","last_became_peered":"2024-04-20T21:19:29.387481+0000","last_unstale":"2024-04-20T21:19:36.249862+0000","last_undegraded":"2024-04-20T21:19:36.249862+0000","last_fullsized":"2024-04-20T21:19:36.249862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:27:55.214090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:35.777684+0000","last_change":"2024-04-20T21:19:29.397568+0000","last_active":"2024-04-20T21:19:35.777684+0000","last_peered":"2024-04-20T21:19:35.777684+0000","last_clean":"2024-04-20T21:19:35.777684+0000","last_became_active":"2024-04-20T21:19:29.397258+0000","last_became_peered":"2024-04-20T21:19:29.397258+0000","last_unstale":"2024-04-20T21:19:35.777684+0000","last_undegraded":"2024-04-20T21:19:35.777684+0000","last_fullsized":"2024-04-20T21:19:35.777684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:01:25.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249144+0000","last_change":"2024-04-20T21:19:29.391755+0000","last_active":"2024-04-20T21:19:36.249144+0000","last_peered":"2024-04-20T21:19:36.249144+0000","last_clean":"2024-04-20T21:19:36.249144+0000","last_became_active":"2024-04-20T21:19:29.389939+0000","last_became_peered":"2024-04-20T21:19:29.389939+0000","last_unstale":"2024-04-20T21:19:36.249144+0000","last_undegraded":"2024-04-20T21:19:36.249144+0000","last_fullsized":"2024-04-20T21:19:36.249144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:12:52.680818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.249430+0000","last_change":"2024-04-20T21:19:29.383237+0000","last_active":"2024-04-20T21:19:36.249430+0000","last_peered":"2024-04-20T21:19:36.249430+0000","last_clean":"2024-04-20T21:19:36.249430+0000","last_became_active":"2024-04-20T21:19:29.382910+0000","last_became_peered":"2024-04-20T21:19:29.382910+0000","last_unstale":"2024-04-20T21:19:36.249430+0000","last_undegraded":"2024-04-20T21:19:36.249430+0000","last_fullsized":"2024-04-20T21:19:36.249430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:14:59.129688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T21:19:36.251604+0000","last_change":"2024-04-20T21:19:29.382459+0000","last_active":"2024-04-20T21:19:36.251604+0000","last_peered":"2024-04-20T21:19:36.251604+0000","last_clean":"2024-04-20T21:19:36.251604+0000","last_became_active":"2024-04-20T21:19:29.382142+0000","last_became_peered":"2024-04-20T21:19:29.382142+0000","last_unstale":"2024-04-20T21:19:36.251604+0000","last_undegraded":"2024-04-20T21:19:36.251604+0000","last_fullsized":"2024-04-20T21:19:36.251604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:28.309357+0000","last_clean_scrub_stamp":"2024-04-20T21:19:28.309357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:20:01.897496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T21:19:59.067 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-20T21:19:59.067 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-20T21:19:59.067 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-20T21:19:59.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-20T21:19:59.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.290+0000 7ffb87200640 1 Processor -- start 2024-04-20T21:19:59.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.290+0000 7ffb87200640 1 -- start start 2024-04-20T21:19:59.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.291+0000 7ffb87200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb80161d50 0x7ffb800d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.292+0000 7ffb87200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8006c190 con 0x7ffb800b3330 2024-04-20T21:19:59.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.292+0000 7ffb87200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8006c470 con 0x7ffb8006cde0 2024-04-20T21:19:59.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.292+0000 7ffb87200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ffb80162130 con 0x7ffb80161d50 2024-04-20T21:19:59.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.292+0000 7ffb85400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ffb800b3330 0x7ffb8006c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46428/0 (socket says 172.21.15.71:46428) 2024-04-20T21:19:59.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.292+0000 7ffb85400640 1 -- 172.21.15.71:0/1107829046 learned_addr learned my addr 172.21.15.71:0/1107829046 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:19:59.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.292+0000 7ffb85e00640 1 --2- 172.21.15.71:0/1107829046 >> v2:172.21.15.137:3300/0 conn(0x7ffb80161d50 0x7ffb800d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.292+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116116615 0 0) 0x7ffb8006c190 con 0x7ffb800b3330 2024-04-20T21:19:59.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.292+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb68003520 con 0x7ffb800b3330 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2152525677 0 0) 0x7ffb68003520 con 0x7ffb800b3330 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 >> v2:172.21.15.137:3300/0 conn(0x7ffb80161d50 msgr2=0x7ffb800d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 --2- 172.21.15.71:0/1107829046 >> v2:172.21.15.137:3300/0 conn(0x7ffb80161d50 0x7ffb800d38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 >> v1:172.21.15.137:6789/0 conn(0x7ffb8006cde0 legacy=0x7ffb800b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb800d2e00 con 0x7ffb800b3330 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7ffb70001670 con 0x7ffb800b3330 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 >> v1:172.21.15.71:6789/0 conn(0x7ffb800b3330 legacy=0x7ffb8006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb68003a00 0x7ffb68003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb68004800 0x7ffb68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb680051c0 0x7ffb6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6800c090 con 0x7ffb68003a00 2024-04-20T21:19:59.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6800c240 con 0x7ffb68004800 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6800c440 con 0x7ffb680051c0 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb85e00640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb68003a00 0x7ffb68003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.293+0000 7ffb85400640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb68004800 0x7ffb68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.294+0000 7ffb85e00640 1 -- 172.21.15.71:0/1107829046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb680051c0 msgr2=0x7ffb6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.294+0000 7ffb86800640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb680051c0 0x7ffb6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.294+0000 7ffb85e00640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb680051c0 0x7ffb6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.294+0000 7ffb85e00640 1 -- 172.21.15.71:0/1107829046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb68004800 msgr2=0x7ffb68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.294+0000 7ffb85e00640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb68004800 0x7ffb68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.294+0000 7ffb85e00640 1 -- 172.21.15.71:0/1107829046 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb68003520 con 0x7ffb68003a00 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.294+0000 7ffb85400640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb68004800 0x7ffb68004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.294+0000 7ffb86800640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb680051c0 0x7ffb6800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:59.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.294+0000 7ffb86800640 1 -- 172.21.15.71:0/1107829046 reap_dead start 2024-04-20T21:19:59.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.295+0000 7ffb85e00640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb68003a00 0x7ffb68003e20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009ac0 tx=0x7ffb68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665c59d9d8adf69c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:59.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.295+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74039070 con 0x7ffb68003a00 2024-04-20T21:19:59.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.295+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7402c6b0 con 0x7ffb68003a00 2024-04-20T21:19:59.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.295+0000 7ffb84a00640 1 -- 172.21.15.71:0/1107829046 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74009690 con 0x7ffb68003a00 2024-04-20T21:19:59.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.296+0000 7ffb87200640 1 -- 172.21.15.71:0/1107829046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb68003a00 msgr2=0x7ffb68003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.296+0000 7ffb87200640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb68003a00 0x7ffb68003e20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009ac0 tx=0x7ffb68005830 comp rx=0 tx=0).stop 2024-04-20T21:19:59.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.296+0000 7ffb87200640 1 -- 172.21.15.71:0/1107829046 shutdown_connections 2024-04-20T21:19:59.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.296+0000 7ffb87200640 1 --2- 172.21.15.71:0/1107829046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb68003a00 0x7ffb68003e20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.296+0000 7ffb87200640 1 -- 172.21.15.71:0/1107829046 >> 172.21.15.71:0/1107829046 conn(0x7ffb800d4450 msgr2=0x7ffb800d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:59.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.296+0000 7ffb87200640 1 -- 172.21.15.71:0/1107829046 shutdown_connections 2024-04-20T21:19:59.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.296+0000 7ffb87200640 1 -- 172.21.15.71:0/1107829046 wait complete. 2024-04-20T21:19:59.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.297+0000 7ffb87200640 1 Processor -- start 2024-04-20T21:19:59.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.298+0000 7ffb87200640 1 -- start start 2024-04-20T21:19:59.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.298+0000 7ffb87200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb68003a00 0x7ffb801f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.298+0000 7ffb87200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb800b86b0 0x7ffb8015b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.298+0000 7ffb87200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8014d3e0 0x7ffb8014d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb87200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb800d38e0 con 0x7ffb8014d3e0 2024-04-20T21:19:59.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb87200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffb800d33c0 con 0x7ffb68003a00 2024-04-20T21:19:59.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb87200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ffb800d3a60 con 0x7ffb800b86b0 2024-04-20T21:19:59.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb86800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8014d3e0 0x7ffb8014d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb86800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8014d3e0 0x7ffb8014d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45162/0 (socket says 172.21.15.71:45162) 2024-04-20T21:19:59.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb86800640 1 -- 172.21.15.71:0/1039899565 learned_addr learned my addr 172.21.15.71:0/1039899565 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:59.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb85e00640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb68003a00 0x7ffb801f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb85400640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb800b86b0 0x7ffb8015b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb86800640 1 -- 172.21.15.71:0/1039899565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb800b86b0 msgr2=0x7ffb8015b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb86800640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb800b86b0 0x7ffb8015b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb86800640 1 -- 172.21.15.71:0/1039899565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb68003a00 msgr2=0x7ffb801f4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb86800640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb68003a00 0x7ffb801f4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.299+0000 7ffb86800640 1 -- 172.21.15.71:0/1039899565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8014ddd0 con 0x7ffb8014d3e0 2024-04-20T21:19:59.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.300+0000 7ffb86800640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8014d3e0 0x7ffb8014d890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffb800cb1e0 tx=0x7ffb7c00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:59.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.300+0000 7ffb7a000640 1 -- 172.21.15.71:0/1039899565 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c018070 con 0x7ffb8014d3e0 2024-04-20T21:19:59.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.300+0000 7ffb7a000640 1 -- 172.21.15.71:0/1039899565 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7c003b90 con 0x7ffb8014d3e0 2024-04-20T21:19:59.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.300+0000 7ffb7a000640 1 -- 172.21.15.71:0/1039899565 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c005070 con 0x7ffb8014d3e0 2024-04-20T21:19:59.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.300+0000 7ffb87200640 1 -- 172.21.15.71:0/1039899565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb801f5090 con 0x7ffb8014d3e0 2024-04-20T21:19:59.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.300+0000 7ffb87200640 1 -- 172.21.15.71:0/1039899565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb800b8e90 con 0x7ffb8014d3e0 2024-04-20T21:19:59.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.301+0000 7ffb87200640 1 -- 172.21.15.71:0/1039899565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb80075b60 con 0x7ffb8014d3e0 2024-04-20T21:19:59.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.303+0000 7ffb7a000640 1 -- 172.21.15.71:0/1039899565 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb7c01b070 con 0x7ffb8014d3e0 2024-04-20T21:19:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.304+0000 7ffb7a000640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffb6406c920 0x7ffb6406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.304+0000 7ffb7a000640 1 -- 172.21.15.71:0/1039899565 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffb7c08b460 con 0x7ffb8014d3e0 2024-04-20T21:19:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.305+0000 7ffb85e00640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffb6406c920 0x7ffb6406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.305+0000 7ffb85e00640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffb6406c920 0x7ffb6406ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffb74036000 tx=0x7ffb74030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.309+0000 7ffb7a000640 1 -- 172.21.15.71:0/1039899565 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ffb801f5090 con 0x7ffb8014d3e0 2024-04-20T21:19:59.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.540+0000 7ffb87200640 1 -- 172.21.15.71:0/1039899565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffb800cb2e0 con 0x7ffb8014d3e0 2024-04-20T21:19:59.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.541+0000 7ffb7a000640 1 -- 172.21.15.71:0/1039899565 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ffb7c0015b0 con 0x7ffb8014d3e0 2024-04-20T21:19:59.540 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:59.541 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-20T21:19:59.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.543+0000 7ffb87200640 1 -- 172.21.15.71:0/1039899565 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffb6406c920 msgr2=0x7ffb6406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.543+0000 7ffb87200640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffb6406c920 0x7ffb6406ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffb74036000 tx=0x7ffb74030000 comp rx=0 tx=0).stop 2024-04-20T21:19:59.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.543+0000 7ffb87200640 1 -- 172.21.15.71:0/1039899565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8014d3e0 msgr2=0x7ffb8014d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.543+0000 7ffb87200640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8014d3e0 0x7ffb8014d890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffb800cb1e0 tx=0x7ffb7c00db80 comp rx=0 tx=0).stop 2024-04-20T21:19:59.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.544+0000 7ffb87200640 1 -- 172.21.15.71:0/1039899565 shutdown_connections 2024-04-20T21:19:59.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.544+0000 7ffb87200640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffb6406c920 0x7ffb6406ede0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.544+0000 7ffb87200640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8014d3e0 0x7ffb8014d890 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.544+0000 7ffb87200640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb800b86b0 0x7ffb8015b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.544+0000 7ffb87200640 1 --2- 172.21.15.71:0/1039899565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb68003a00 0x7ffb801f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.544+0000 7ffb87200640 1 -- 172.21.15.71:0/1039899565 >> 172.21.15.71:0/1039899565 conn(0x7ffb800d4450 msgr2=0x7ffb8015f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:59.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.544+0000 7ffb87200640 1 -- 172.21.15.71:0/1039899565 shutdown_connections 2024-04-20T21:19:59.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.544+0000 7ffb87200640 1 -- 172.21.15.71:0/1039899565 wait complete. 2024-04-20T21:19:59.562 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-20T21:19:59.563 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:19:59.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.740+0000 7f0c02a00640 1 Processor -- start 2024-04-20T21:19:59.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.740+0000 7f0c02a00640 1 -- start start 2024-04-20T21:19:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.741+0000 7f0c02a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0bfc15f120 0x7f0bfc15f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.741+0000 7f0c02a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0bfc1662e0 0x7f0bfc1686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.741+0000 7f0c02a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bfc0cd550 con 0x7f0bfc15ed40 2024-04-20T21:19:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.741+0000 7f0c02a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f0bfc0d0b30 con 0x7f0bfc1662e0 2024-04-20T21:19:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.741+0000 7f0c02a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0bfc0ccf90 con 0x7f0bfc15f120 2024-04-20T21:19:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.742+0000 7f0c00a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0bfc1662e0 0x7f0bfc1686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.742+0000 7f0c00a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0bfc1662e0 0x7f0bfc1686d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45164/0 (socket says 172.21.15.71:45164) 2024-04-20T21:19:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.742+0000 7f0c00a00640 1 -- 172.21.15.71:0/3068657831 learned_addr learned my addr 172.21.15.71:0/3068657831 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:59.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.742+0000 7f0bf3400640 1 --2- 172.21.15.71:0/3068657831 >> v2:172.21.15.137:3300/0 conn(0x7f0bfc15f120 0x7f0bfc15f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.742+0000 7f0c00a00640 1 -- 172.21.15.71:0/3068657831 >> v2:172.21.15.137:3300/0 conn(0x7f0bfc15f120 msgr2=0x7f0bfc15f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:59.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.742+0000 7f0c00a00640 1 --2- 172.21.15.71:0/3068657831 >> v2:172.21.15.137:3300/0 conn(0x7f0bfc15f120 0x7f0bfc15f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.742+0000 7f0c00a00640 1 -- 172.21.15.71:0/3068657831 >> v1:172.21.15.137:6789/0 conn(0x7f0bfc15ed40 legacy=0x7f0bfc0b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:19:59.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.742+0000 7f0c00a00640 1 -- 172.21.15.71:0/3068657831 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc0cd270 con 0x7f0bfc1662e0 2024-04-20T21:19:59.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.742+0000 7f0bf3400640 1 --2- 172.21.15.71:0/3068657831 >> v2:172.21.15.137:3300/0 conn(0x7f0bfc15f120 0x7f0bfc15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:59.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.743+0000 7f0c00a00640 1 --2- 172.21.15.71:0/3068657831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bfc1662e0 0x7f0bfc1686d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0b49c0 tx=0x7f0bf402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71def69182a1779b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:59.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.743+0000 7f0bfb400640 1 -- 172.21.15.71:0/3068657831 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4035020 con 0x7f0bfc1662e0 2024-04-20T21:19:59.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.744+0000 7f0bfb400640 1 -- 172.21.15.71:0/3068657831 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf4031640 con 0x7f0bfc1662e0 2024-04-20T21:19:59.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.744+0000 7f0bfb400640 1 -- 172.21.15.71:0/3068657831 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf402d040 con 0x7f0bfc1662e0 2024-04-20T21:19:59.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.744+0000 7f0c02a00640 1 -- 172.21.15.71:0/3068657831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bfc1662e0 msgr2=0x7f0bfc1686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.744+0000 7f0c02a00640 1 --2- 172.21.15.71:0/3068657831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bfc1662e0 0x7f0bfc1686d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0b49c0 tx=0x7f0bf402b8f0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.744+0000 7f0c02a00640 1 -- 172.21.15.71:0/3068657831 shutdown_connections 2024-04-20T21:19:59.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.744+0000 7f0c02a00640 1 --2- 172.21.15.71:0/3068657831 >> v2:172.21.15.137:3300/0 conn(0x7f0bfc15f120 0x7f0bfc15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.744+0000 7f0c02a00640 1 --2- 172.21.15.71:0/3068657831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bfc1662e0 0x7f0bfc1686d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.744+0000 7f0c02a00640 1 -- 172.21.15.71:0/3068657831 >> 172.21.15.71:0/3068657831 conn(0x7f0bfc0704e0 msgr2=0x7f0bfc0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:59.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.744+0000 7f0c02a00640 1 -- 172.21.15.71:0/3068657831 shutdown_connections 2024-04-20T21:19:59.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.744+0000 7f0c02a00640 1 -- 172.21.15.71:0/3068657831 wait complete. 2024-04-20T21:19:59.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.746+0000 7f0c02a00640 1 Processor -- start 2024-04-20T21:19:59.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.746+0000 7f0c02a00640 1 -- start start 2024-04-20T21:19:59.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.747+0000 7f0c02a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bfc15ed40 0x7f0bfc15c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.747+0000 7f0c02a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bfc15f120 0x7f0bfc1f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.747+0000 7f0c02a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bfc1662e0 0x7f0bfc145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.747+0000 7f0c02a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc15faf0 con 0x7f0bfc1662e0 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.747+0000 7f0c02a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc0cf600 con 0x7f0bfc15ed40 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.747+0000 7f0c02a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0bfc0ccc60 con 0x7f0bfc15f120 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0c00a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bfc1662e0 0x7f0bfc145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0c00a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bfc1662e0 0x7f0bfc145eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45170/0 (socket says 172.21.15.71:45170) 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0c00a00640 1 -- 172.21.15.71:0/1642797052 learned_addr learned my addr 172.21.15.71:0/1642797052 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0bfbe00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bfc15ed40 0x7f0bfc15c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0bf3400640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bfc15f120 0x7f0bfc1f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0c00a00640 1 -- 172.21.15.71:0/1642797052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bfc15f120 msgr2=0x7f0bfc1f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0c00a00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bfc15f120 0x7f0bfc1f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0c00a00640 1 -- 172.21.15.71:0/1642797052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bfc15ed40 msgr2=0x7f0bfc15c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0c00a00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bfc15ed40 0x7f0bfc15c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0c00a00640 1 -- 172.21.15.71:0/1642797052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc13bda0 con 0x7f0bfc1662e0 2024-04-20T21:19:59.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0bf3400640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bfc15f120 0x7f0bfc1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:19:59.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.748+0000 7f0c00a00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bfc1662e0 0x7f0bfc145eb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0bf402b930 tx=0x7f0bf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:59.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.749+0000 7f0bf8c00640 1 -- 172.21.15.71:0/1642797052 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4040070 con 0x7f0bfc1662e0 2024-04-20T21:19:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.749+0000 7f0bf8c00640 1 -- 172.21.15.71:0/1642797052 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf4039cd0 con 0x7f0bfc1662e0 2024-04-20T21:19:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.749+0000 7f0bf8c00640 1 -- 172.21.15.71:0/1642797052 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4035040 con 0x7f0bfc1662e0 2024-04-20T21:19:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.749+0000 7f0c02a00640 1 -- 172.21.15.71:0/1642797052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bfc1413d0 con 0x7f0bfc1662e0 2024-04-20T21:19:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.749+0000 7f0c02a00640 1 -- 172.21.15.71:0/1642797052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bfc141990 con 0x7f0bfc1662e0 2024-04-20T21:19:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.750+0000 7f0c02a00640 1 -- 172.21.15.71:0/1642797052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bfc069090 con 0x7f0bfc1662e0 2024-04-20T21:19:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.751+0000 7f0bf8c00640 1 -- 172.21.15.71:0/1642797052 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0bf4038020 con 0x7f0bfc1662e0 2024-04-20T21:19:59.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.752+0000 7f0bf8c00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0bd806c8f0 0x7f0bd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:19:59.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.752+0000 7f0bf8c00640 1 -- 172.21.15.71:0/1642797052 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0bf40ada50 con 0x7f0bfc1662e0 2024-04-20T21:19:59.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.752+0000 7f0bfbe00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0bd806c8f0 0x7f0bd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:19:59.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.753+0000 7f0bfbe00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0bd806c8f0 0x7f0bd806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009f20 tx=0x7f0bec0094d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:19:59.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.761+0000 7f0bf8c00640 1 -- 172.21.15.71:0/1642797052 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f0bfc13bda0 con 0x7f0bfc1662e0 2024-04-20T21:19:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.963+0000 7f0c02a00640 1 -- 172.21.15.71:0/1642797052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0bfc146c30 con 0x7f0bfc1662e0 2024-04-20T21:19:59.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.965+0000 7f0bf8c00640 1 -- 172.21.15.71:0/1642797052 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f0bf407baa0 con 0x7f0bfc1662e0 2024-04-20T21:19:59.965 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:19:59.965 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:19:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 -- 172.21.15.71:0/1642797052 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0bd806c8f0 msgr2=0x7f0bd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0bd806c8f0 0x7f0bd806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009f20 tx=0x7f0bec0094d0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 -- 172.21.15.71:0/1642797052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bfc1662e0 msgr2=0x7f0bfc145eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:19:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bfc1662e0 0x7f0bfc145eb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0bf402b930 tx=0x7f0bf40046c0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 -- 172.21.15.71:0/1642797052 shutdown_connections 2024-04-20T21:19:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0bd806c8f0 0x7f0bd806edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bfc1662e0 0x7f0bfc145eb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bfc15f120 0x7f0bfc1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 --2- 172.21.15.71:0/1642797052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bfc15ed40 0x7f0bfc15c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:19:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 -- 172.21.15.71:0/1642797052 >> 172.21.15.71:0/1642797052 conn(0x7f0bfc0704e0 msgr2=0x7f0bfc13d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:19:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 -- 172.21.15.71:0/1642797052 shutdown_connections 2024-04-20T21:19:59.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:19:59.968+0000 7f0c02a00640 1 -- 172.21.15.71:0/1642797052 wait complete. 2024-04-20T21:19:59.984 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:19:59.985 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:00.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.170+0000 7f213c600640 1 Processor -- start 2024-04-20T21:20:00.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.171+0000 7f213c600640 1 -- start start 2024-04-20T21:20:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.172+0000 7f213c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21340d1a00 0x7f21340b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.172+0000 7f213c600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f21340b17d0 0x7f21340d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.172+0000 7f213c600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21340d1e60 con 0x7f21340d4270 2024-04-20T21:20:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.172+0000 7f213c600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f21340d40c0 con 0x7f21340b17d0 2024-04-20T21:20:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.172+0000 7f213c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f21340d3820 con 0x7f21340d1a00 2024-04-20T21:20:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.173+0000 7f213a600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f21340b17d0 0x7f21340d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:00.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.173+0000 7f2139200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21340d1a00 0x7f21340b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:00.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.173+0000 7f2139c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f21340d4270 0x7f21340d4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:40334/0 (socket says 172.21.15.71:40334) 2024-04-20T21:20:00.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.173+0000 7f2139c00640 1 -- 172.21.15.71:0/2369106945 learned_addr learned my addr 172.21.15.71:0/2369106945 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:00.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.174+0000 7f2133e00640 1 -- 172.21.15.71:0/2369106945 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952202763 0 0) 0x7f21340d1e60 con 0x7f21340d4270 2024-04-20T21:20:00.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.174+0000 7f2133e00640 1 -- 172.21.15.71:0/2369106945 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f211c003520 con 0x7f21340d4270 2024-04-20T21:20:00.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.174+0000 7f2139200640 1 -- 172.21.15.71:0/2369106945 >> v2:172.21.15.137:3300/0 conn(0x7f21340b17d0 msgr2=0x7f21340d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:00.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.174+0000 7f2139200640 1 --2- 172.21.15.71:0/2369106945 >> v2:172.21.15.137:3300/0 conn(0x7f21340b17d0 0x7f21340d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.174+0000 7f2139200640 1 -- 172.21.15.71:0/2369106945 >> v1:172.21.15.137:6789/0 conn(0x7f21340d4270 legacy=0x7f21340d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.174+0000 7f2139200640 1 -- 172.21.15.71:0/2369106945 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21340d3b00 con 0x7f21340d1a00 2024-04-20T21:20:00.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.176+0000 7f2139200640 1 --2- 172.21.15.71:0/2369106945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21340d1a00 0x7f21340b1290 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f21200097a0 tx=0x7f212002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be3418dba3ca93f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:00.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.176+0000 7f2133e00640 1 -- 172.21.15.71:0/2369106945 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120035020 con 0x7f21340d1a00 2024-04-20T21:20:00.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.176+0000 7f2133e00640 1 -- 172.21.15.71:0/2369106945 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2120031830 con 0x7f21340d1a00 2024-04-20T21:20:00.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.176+0000 7f2133e00640 1 -- 172.21.15.71:0/2369106945 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120031be0 con 0x7f21340d1a00 2024-04-20T21:20:00.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.177+0000 7f213c600640 1 -- 172.21.15.71:0/2369106945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21340d1a00 msgr2=0x7f21340b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.177+0000 7f213c600640 1 --2- 172.21.15.71:0/2369106945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21340d1a00 0x7f21340b1290 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f21200097a0 tx=0x7f212002b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.177+0000 7f213c600640 1 -- 172.21.15.71:0/2369106945 shutdown_connections 2024-04-20T21:20:00.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.177+0000 7f213c600640 1 --2- 172.21.15.71:0/2369106945 >> v2:172.21.15.137:3300/0 conn(0x7f21340b17d0 0x7f21340d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.177+0000 7f213c600640 1 --2- 172.21.15.71:0/2369106945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21340d1a00 0x7f21340b1290 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.177+0000 7f213c600640 1 -- 172.21.15.71:0/2369106945 >> 172.21.15.71:0/2369106945 conn(0x7f21340b99c0 msgr2=0x7f21340b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:00.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.177+0000 7f213c600640 1 -- 172.21.15.71:0/2369106945 shutdown_connections 2024-04-20T21:20:00.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.177+0000 7f213c600640 1 -- 172.21.15.71:0/2369106945 wait complete. 2024-04-20T21:20:00.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.179+0000 7f213c600640 1 Processor -- start 2024-04-20T21:20:00.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.180+0000 7f213c600640 1 -- start start 2024-04-20T21:20:00.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.181+0000 7f213c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21340b17d0 0x7f213406d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:00.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.181+0000 7f213c600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21340d1a00 0x7f21340ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:00.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.181+0000 7f213c600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21340d4270 0x7f213406b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:00.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.181+0000 7f213c600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21340d53b0 con 0x7f21340d4270 2024-04-20T21:20:00.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.181+0000 7f213c600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f21340cfe60 con 0x7f21340d1a00 2024-04-20T21:20:00.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.181+0000 7f213c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2134161f70 con 0x7f21340b17d0 2024-04-20T21:20:00.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.181+0000 7f213a600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21340d4270 0x7f213406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:00.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.181+0000 7f213a600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21340d4270 0x7f213406b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45182/0 (socket says 172.21.15.71:45182) 2024-04-20T21:20:00.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.181+0000 7f213a600640 1 -- 172.21.15.71:0/958579345 learned_addr learned my addr 172.21.15.71:0/958579345 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:00.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f2139200640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21340d1a00 0x7f21340ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:00.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f2139c00640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21340b17d0 0x7f213406d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:00.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f213a600640 1 -- 172.21.15.71:0/958579345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21340b17d0 msgr2=0x7f213406d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f213a600640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21340b17d0 0x7f213406d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f213a600640 1 -- 172.21.15.71:0/958579345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21340d1a00 msgr2=0x7f21340ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f213a600640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21340d1a00 0x7f21340ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f213a600640 1 -- 172.21.15.71:0/958579345 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213406dcc0 con 0x7f21340d4270 2024-04-20T21:20:00.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f213a600640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21340d4270 0x7f213406b900 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f212c00efc0 tx=0x7f212c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:00.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f2131600640 1 -- 172.21.15.71:0/958579345 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c018020 con 0x7f21340d4270 2024-04-20T21:20:00.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f2131600640 1 -- 172.21.15.71:0/958579345 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212c014480 con 0x7f21340d4270 2024-04-20T21:20:00.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f2131600640 1 -- 172.21.15.71:0/958579345 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c014870 con 0x7f21340d4270 2024-04-20T21:20:00.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.182+0000 7f213c600640 1 -- 172.21.15.71:0/958579345 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21340cb900 con 0x7f21340d4270 2024-04-20T21:20:00.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.183+0000 7f213c600640 1 -- 172.21.15.71:0/958579345 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21340cbec0 con 0x7f21340d4270 2024-04-20T21:20:00.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.184+0000 7f213c600640 1 -- 172.21.15.71:0/958579345 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2134068980 con 0x7f21340d4270 2024-04-20T21:20:00.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.185+0000 7f2131600640 1 -- 172.21.15.71:0/958579345 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f212c005d10 con 0x7f21340d4270 2024-04-20T21:20:00.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.185+0000 7f2131600640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f211406c8f0 0x7f211406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:00.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.186+0000 7f2131600640 1 -- 172.21.15.71:0/958579345 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f212c08cde0 con 0x7f21340d4270 2024-04-20T21:20:00.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.186+0000 7f2139c00640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f211406c8f0 0x7f211406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:00.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.186+0000 7f2139c00640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f211406c8f0 0x7f211406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2128005880 tx=0x7f2128009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:00.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.190+0000 7f2131600640 1 -- 172.21.15.71:0/958579345 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f212c022030 con 0x7f21340d4270 2024-04-20T21:20:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.390+0000 7f213c600640 1 -- 172.21.15.71:0/958579345 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f21340d33c0 con 0x7f21340d4270 2024-04-20T21:20:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.391+0000 7f2131600640 1 -- 172.21.15.71:0/958579345 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f212c010040 con 0x7f21340d4270 2024-04-20T21:20:00.391 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:00.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 -- 172.21.15.71:0/958579345 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f211406c8f0 msgr2=0x7f211406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f211406c8f0 0x7f211406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2128005880 tx=0x7f2128009040 comp rx=0 tx=0).stop 2024-04-20T21:20:00.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 -- 172.21.15.71:0/958579345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21340d4270 msgr2=0x7f213406b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21340d4270 0x7f213406b900 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f212c00efc0 tx=0x7f212c00c490 comp rx=0 tx=0).stop 2024-04-20T21:20:00.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 -- 172.21.15.71:0/958579345 shutdown_connections 2024-04-20T21:20:00.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f211406c8f0 0x7f211406edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21340d4270 0x7f213406b900 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21340d1a00 0x7f21340ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 --2- 172.21.15.71:0/958579345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21340b17d0 0x7f213406d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 -- 172.21.15.71:0/958579345 >> 172.21.15.71:0/958579345 conn(0x7f21340b99c0 msgr2=0x7f21340b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:00.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 -- 172.21.15.71:0/958579345 shutdown_connections 2024-04-20T21:20:00.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.394+0000 7f213c600640 1 -- 172.21.15.71:0/958579345 wait complete. 2024-04-20T21:20:00.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:00.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.598+0000 7fb952800640 1 Processor -- start 2024-04-20T21:20:00.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.598+0000 7fb952800640 1 -- start start 2024-04-20T21:20:00.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.600+0000 7fb952800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb94c0d1a00 0x7fb94c0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:00.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.600+0000 7fb952800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb94c0d1e90 con 0x7fb94c0d4270 2024-04-20T21:20:00.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.600+0000 7fb952800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb94c0d3820 con 0x7fb94c0b17d0 2024-04-20T21:20:00.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.600+0000 7fb952800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb94c0d40c0 con 0x7fb94c0d1a00 2024-04-20T21:20:00.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.600+0000 7fb94b400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb94c0d4270 0x7fb94c0d4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46436/0 (socket says 172.21.15.71:46436) 2024-04-20T21:20:00.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.600+0000 7fb94b400640 1 -- 172.21.15.71:0/3830211631 learned_addr learned my addr 172.21.15.71:0/3830211631 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:00.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.600+0000 7fb943e00640 1 --2- 172.21.15.71:0/3830211631 >> v2:172.21.15.71:3300/0 conn(0x7fb94c0d1a00 0x7fb94c0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.601+0000 7fb94aa00640 1 -- 172.21.15.71:0/3830211631 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403224688 0 0) 0x7fb93c001110 con 0x7fb94c0d4270 2024-04-20T21:20:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.601+0000 7fb94aa00640 1 -- 172.21.15.71:0/3830211631 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb930003520 con 0x7fb94c0d4270 2024-04-20T21:20:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.601+0000 7fb943e00640 1 -- 172.21.15.71:0/3830211631 >> v1:172.21.15.137:6789/0 conn(0x7fb94c0b17d0 legacy=0x7fb94c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.601+0000 7fb943e00640 1 -- 172.21.15.71:0/3830211631 >> v1:172.21.15.71:6789/0 conn(0x7fb94c0d4270 legacy=0x7fb94c0d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.601+0000 7fb943e00640 1 -- 172.21.15.71:0/3830211631 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94c0d3b00 con 0x7fb94c0d1a00 2024-04-20T21:20:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.602+0000 7fb943e00640 1 --2- 172.21.15.71:0/3830211631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb94c0d1a00 0x7fb94c0b1290 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb9340097a0 tx=0x7fb93402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73eeaf3aa6ab5592 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:00.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.602+0000 7fb94aa00640 1 -- 172.21.15.71:0/3830211631 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb934034070 con 0x7fb94c0d1a00 2024-04-20T21:20:00.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.602+0000 7fb94aa00640 1 -- 172.21.15.71:0/3830211631 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb934030610 con 0x7fb94c0d1a00 2024-04-20T21:20:00.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.602+0000 7fb94aa00640 1 -- 172.21.15.71:0/3830211631 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9340309c0 con 0x7fb94c0d1a00 2024-04-20T21:20:00.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.603+0000 7fb952800640 1 -- 172.21.15.71:0/3830211631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb94c0d1a00 msgr2=0x7fb94c0b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.603+0000 7fb952800640 1 --2- 172.21.15.71:0/3830211631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb94c0d1a00 0x7fb94c0b1290 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb9340097a0 tx=0x7fb93402b960 comp rx=0 tx=0).stop 2024-04-20T21:20:00.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.603+0000 7fb952800640 1 -- 172.21.15.71:0/3830211631 shutdown_connections 2024-04-20T21:20:00.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.603+0000 7fb952800640 1 --2- 172.21.15.71:0/3830211631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb94c0d1a00 0x7fb94c0b1290 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.603+0000 7fb952800640 1 -- 172.21.15.71:0/3830211631 >> 172.21.15.71:0/3830211631 conn(0x7fb94c0b99c0 msgr2=0x7fb94c0b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:00.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.603+0000 7fb952800640 1 -- 172.21.15.71:0/3830211631 shutdown_connections 2024-04-20T21:20:00.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.603+0000 7fb952800640 1 -- 172.21.15.71:0/3830211631 wait complete. 2024-04-20T21:20:00.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.605+0000 7fb952800640 1 Processor -- start 2024-04-20T21:20:00.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.605+0000 7fb952800640 1 -- start start 2024-04-20T21:20:00.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.606+0000 7fb952800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb94c0b17d0 0x7fb94c1f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:00.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.606+0000 7fb952800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb94c0d1a00 0x7fb94c155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:00.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.606+0000 7fb952800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb94c0d4270 0x7fb94c0c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.606+0000 7fb952800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c0d53b0 con 0x7fb94c0d4270 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.606+0000 7fb952800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c0cfe60 con 0x7fb94c0b17d0 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.606+0000 7fb952800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb94c161f70 con 0x7fb94c0d1a00 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.606+0000 7fb94be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb94c0d4270 0x7fb94c0c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.607+0000 7fb94be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb94c0d4270 0x7fb94c0c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45204/0 (socket says 172.21.15.71:45204) 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.607+0000 7fb94be00640 1 -- 172.21.15.71:0/537091580 learned_addr learned my addr 172.21.15.71:0/537091580 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.607+0000 7fb94b400640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb94c0b17d0 0x7fb94c1f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.607+0000 7fb94be00640 1 -- 172.21.15.71:0/537091580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb94c0d1a00 msgr2=0x7fb94c155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.607+0000 7fb94be00640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb94c0d1a00 0x7fb94c155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.607+0000 7fb94be00640 1 -- 172.21.15.71:0/537091580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb94c0b17d0 msgr2=0x7fb94c1f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.607+0000 7fb94be00640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb94c0b17d0 0x7fb94c1f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.607+0000 7fb94be00640 1 -- 172.21.15.71:0/537091580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94c06cfe0 con 0x7fb94c0d4270 2024-04-20T21:20:00.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.607+0000 7fb94be00640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb94c0d4270 0x7fb94c0c8930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c730 tx=0x7fb94400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:00.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.607+0000 7fb943400640 1 -- 172.21.15.71:0/537091580 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944003b70 con 0x7fb94c0d4270 2024-04-20T21:20:00.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.608+0000 7fb943400640 1 -- 172.21.15.71:0/537091580 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb944003d10 con 0x7fb94c0d4270 2024-04-20T21:20:00.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.608+0000 7fb943400640 1 -- 172.21.15.71:0/537091580 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94400aa90 con 0x7fb94c0d4270 2024-04-20T21:20:00.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.608+0000 7fb952800640 1 -- 172.21.15.71:0/537091580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94c0c94a0 con 0x7fb94c0d4270 2024-04-20T21:20:00.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.608+0000 7fb952800640 1 -- 172.21.15.71:0/537091580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb94c06d860 con 0x7fb94c0d4270 2024-04-20T21:20:00.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.609+0000 7fb952800640 1 -- 172.21.15.71:0/537091580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb94c06d3b0 con 0x7fb94c0d4270 2024-04-20T21:20:00.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.610+0000 7fb943400640 1 -- 172.21.15.71:0/537091580 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb94400ac30 con 0x7fb94c0d4270 2024-04-20T21:20:00.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.611+0000 7fb943400640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb92806c8f0 0x7fb92806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:00.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.611+0000 7fb943400640 1 -- 172.21.15.71:0/537091580 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb94408bd90 con 0x7fb94c0d4270 2024-04-20T21:20:00.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.611+0000 7fb94b400640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb92806c8f0 0x7fb92806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:00.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.612+0000 7fb94b400640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb92806c8f0 0x7fb92806edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb93c007fd0 tx=0x7fb93c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:00.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.615+0000 7fb943400640 1 -- 172.21.15.71:0/537091580 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb944059e70 con 0x7fb94c0d4270 2024-04-20T21:20:00.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.803+0000 7fb952800640 1 -- 172.21.15.71:0/537091580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb94c068980 con 0x7fb94c0d4270 2024-04-20T21:20:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.804+0000 7fb943400640 1 -- 172.21.15.71:0/537091580 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fb944059770 con 0x7fb94c0d4270 2024-04-20T21:20:00.804 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.806+0000 7fb952800640 1 -- 172.21.15.71:0/537091580 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb92806c8f0 msgr2=0x7fb92806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.806+0000 7fb952800640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb92806c8f0 0x7fb92806edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb93c007fd0 tx=0x7fb93c009040 comp rx=0 tx=0).stop 2024-04-20T21:20:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.806+0000 7fb952800640 1 -- 172.21.15.71:0/537091580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb94c0d4270 msgr2=0x7fb94c0c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.806+0000 7fb952800640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb94c0d4270 0x7fb94c0c8930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c730 tx=0x7fb94400cbf0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.807+0000 7fb952800640 1 -- 172.21.15.71:0/537091580 shutdown_connections 2024-04-20T21:20:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.807+0000 7fb952800640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb92806c8f0 0x7fb92806edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.807+0000 7fb952800640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb94c0d4270 0x7fb94c0c8930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.807+0000 7fb952800640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb94c0d1a00 0x7fb94c155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.807+0000 7fb952800640 1 --2- 172.21.15.71:0/537091580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb94c0b17d0 0x7fb94c1f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.807+0000 7fb952800640 1 -- 172.21.15.71:0/537091580 >> 172.21.15.71:0/537091580 conn(0x7fb94c0b99c0 msgr2=0x7fb94c0b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:00.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.807+0000 7fb952800640 1 -- 172.21.15.71:0/537091580 shutdown_connections 2024-04-20T21:20:00.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:00.807+0000 7fb952800640 1 -- 172.21.15.71:0/537091580 wait complete. 2024-04-20T21:20:00.825 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:01.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.027+0000 7f6190200640 1 Processor -- start 2024-04-20T21:20:01.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.028+0000 7f6190200640 1 -- start start 2024-04-20T21:20:01.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.029+0000 7f6190200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f61880d1a00 0x7f61880b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.029+0000 7f6190200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61880b17d0 0x7f61880d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.029+0000 7f6190200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61880d1e90 con 0x7f61880d4270 2024-04-20T21:20:01.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.029+0000 7f6190200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f61880d40c0 con 0x7f61880d1a00 2024-04-20T21:20:01.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.029+0000 7f6190200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f61880d3820 con 0x7f61880b17d0 2024-04-20T21:20:01.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.029+0000 7f618d800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f61880d4270 0x7f61880d4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46446/0 (socket says 172.21.15.71:46446) 2024-04-20T21:20:01.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.029+0000 7f618d800640 1 -- 172.21.15.71:0/1738889102 learned_addr learned my addr 172.21.15.71:0/1738889102 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:01.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319287994 0 0) 0x7f6178001110 con 0x7f61880d4270 2024-04-20T21:20:01.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f616c003520 con 0x7f61880d4270 2024-04-20T21:20:01.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f618e200640 1 --2- 172.21.15.71:0/1738889102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61880b17d0 0x7f61880d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f618ce00640 1 --2- 172.21.15.71:0/1738889102 >> v2:172.21.15.137:3300/0 conn(0x7f61880d1a00 0x7f61880b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4237806722 0 0) 0x7f616c003520 con 0x7f61880d4270 2024-04-20T21:20:01.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61880b17d0 msgr2=0x7f61880d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:01.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 --2- 172.21.15.71:0/1738889102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61880b17d0 0x7f61880d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 >> v2:172.21.15.137:3300/0 conn(0x7f61880d1a00 msgr2=0x7f61880b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:01.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 --2- 172.21.15.71:0/1738889102 >> v2:172.21.15.137:3300/0 conn(0x7f61880d1a00 0x7f61880b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61880d3b00 con 0x7f61880d4270 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f6178001840 con 0x7f61880d4270 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 >> v1:172.21.15.71:6789/0 conn(0x7f61880d4270 legacy=0x7f61880d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 --2- 172.21.15.71:0/1738889102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61880b17d0 0x7f616c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 --2- 172.21.15.71:0/1738889102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f616c003fe0 0x7f616c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 --2- 172.21.15.71:0/1738889102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f616c004d40 0x7f616c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61880d40c0 con 0x7f616c003fe0 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61880d3820 con 0x7f616c004d40 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.030+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f616c00bac0 con 0x7f61880b17d0 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.031+0000 7f618ce00640 1 --2- 172.21.15.71:0/1738889102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f616c003fe0 0x7f616c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.031+0000 7f618ce00640 1 -- 172.21.15.71:0/1738889102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61880b17d0 msgr2=0x7f616c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.031+0000 7f618ce00640 1 --2- 172.21.15.71:0/1738889102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61880b17d0 0x7f616c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.031+0000 7f618ce00640 1 -- 172.21.15.71:0/1738889102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f616c004d40 msgr2=0x7f616c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:01.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.031+0000 7f618ce00640 1 --2- 172.21.15.71:0/1738889102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f616c004d40 0x7f616c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.031+0000 7f618ce00640 1 -- 172.21.15.71:0/1738889102 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c003520 con 0x7f616c003fe0 2024-04-20T21:20:01.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.032+0000 7f618ce00640 1 --2- 172.21.15.71:0/1738889102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f616c003fe0 0x7f616c004800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f617400ba30 tx=0x7f616c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34449fc639997bcb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:01.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.032+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174036020 con 0x7f616c003fe0 2024-04-20T21:20:01.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.032+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6174032680 con 0x7f616c003fe0 2024-04-20T21:20:01.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.032+0000 7f6187e00640 1 -- 172.21.15.71:0/1738889102 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617400b600 con 0x7f616c003fe0 2024-04-20T21:20:01.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.033+0000 7f6190200640 1 -- 172.21.15.71:0/1738889102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f616c003fe0 msgr2=0x7f616c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.033+0000 7f6190200640 1 --2- 172.21.15.71:0/1738889102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f616c003fe0 0x7f616c004800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f617400ba30 tx=0x7f616c005830 comp rx=0 tx=0).stop 2024-04-20T21:20:01.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.033+0000 7f618e200640 1 -- 172.21.15.71:0/1738889102 reap_dead start 2024-04-20T21:20:01.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.033+0000 7f6190200640 1 -- 172.21.15.71:0/1738889102 shutdown_connections 2024-04-20T21:20:01.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.033+0000 7f6190200640 1 -- 172.21.15.71:0/1738889102 >> 172.21.15.71:0/1738889102 conn(0x7f61880b99c0 msgr2=0x7f61880b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:01.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.033+0000 7f6190200640 1 -- 172.21.15.71:0/1738889102 shutdown_connections 2024-04-20T21:20:01.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.033+0000 7f6190200640 1 -- 172.21.15.71:0/1738889102 wait complete. 2024-04-20T21:20:01.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.035+0000 7f6190200640 1 Processor -- start 2024-04-20T21:20:01.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.035+0000 7f6190200640 1 -- start start 2024-04-20T21:20:01.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f6190200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f616c003fe0 0x7f61880c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f6190200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f618814b200 0x7f618806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f6190200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f618806e620 0x7f618814d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f6190200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61880d53b0 con 0x7f618806e620 2024-04-20T21:20:01.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f6190200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61880cfe60 con 0x7f616c003fe0 2024-04-20T21:20:01.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f6190200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6188161f70 con 0x7f618814b200 2024-04-20T21:20:01.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f618e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f618806e620 0x7f618814d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f618e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f618806e620 0x7f618814d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45216/0 (socket says 172.21.15.71:45216) 2024-04-20T21:20:01.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f618e200640 1 -- 172.21.15.71:0/1526850927 learned_addr learned my addr 172.21.15.71:0/1526850927 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:01.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f618d800640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f616c003fe0 0x7f61880c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f618ce00640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f618814b200 0x7f618806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f618e200640 1 -- 172.21.15.71:0/1526850927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f618814b200 msgr2=0x7f618806e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f618e200640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f618814b200 0x7f618806e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f618e200640 1 -- 172.21.15.71:0/1526850927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f616c003fe0 msgr2=0x7f61880c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f618e200640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f616c003fe0 0x7f61880c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.036+0000 7f618e200640 1 -- 172.21.15.71:0/1526850927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61880cce80 con 0x7f618806e620 2024-04-20T21:20:01.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.037+0000 7f618d800640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f616c003fe0 0x7f61880c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:01.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.037+0000 7f618e200640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f618806e620 0x7f618814d290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6188068570 tx=0x7f618000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:01.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.037+0000 7f6185600640 1 -- 172.21.15.71:0/1526850927 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618000ed90 con 0x7f618806e620 2024-04-20T21:20:01.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.037+0000 7f6185600640 1 -- 172.21.15.71:0/1526850927 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6180019070 con 0x7f618806e620 2024-04-20T21:20:01.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.037+0000 7f6185600640 1 -- 172.21.15.71:0/1526850927 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180014660 con 0x7f618806e620 2024-04-20T21:20:01.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.037+0000 7f6190200640 1 -- 172.21.15.71:0/1526850927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61880cd160 con 0x7f618806e620 2024-04-20T21:20:01.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.037+0000 7f6190200640 1 -- 172.21.15.71:0/1526850927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61880cd720 con 0x7f618806e620 2024-04-20T21:20:01.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.038+0000 7f6190200640 1 -- 172.21.15.71:0/1526850927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61880b1290 con 0x7f618806e620 2024-04-20T21:20:01.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.039+0000 7f6185600640 1 -- 172.21.15.71:0/1526850927 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6180014800 con 0x7f618806e620 2024-04-20T21:20:01.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.040+0000 7f6185600640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f616806c8f0 0x7f616806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.040+0000 7f6185600640 1 -- 172.21.15.71:0/1526850927 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f618008c310 con 0x7f618806e620 2024-04-20T21:20:01.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.040+0000 7f618d800640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f616806c8f0 0x7f616806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.041+0000 7f618d800640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f616806c8f0 0x7f616806edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f61780013b0 tx=0x7f6178009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:01.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.045+0000 7f6185600640 1 -- 172.21.15.71:0/1526850927 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f61880b1290 con 0x7f618806e620 2024-04-20T21:20:01.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.246+0000 7f6190200640 1 -- 172.21.15.71:0/1526850927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f61880c9ab0 con 0x7f618806e620 2024-04-20T21:20:01.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.247+0000 7f6185600640 1 -- 172.21.15.71:0/1526850927 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f618005a360 con 0x7f618806e620 2024-04-20T21:20:01.247 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:01.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 -- 172.21.15.71:0/1526850927 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f616806c8f0 msgr2=0x7f616806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f616806c8f0 0x7f616806edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f61780013b0 tx=0x7f6178009040 comp rx=0 tx=0).stop 2024-04-20T21:20:01.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 -- 172.21.15.71:0/1526850927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f618806e620 msgr2=0x7f618814d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f618806e620 0x7f618814d290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6188068570 tx=0x7f618000e4b0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 -- 172.21.15.71:0/1526850927 shutdown_connections 2024-04-20T21:20:01.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f616806c8f0 0x7f616806edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f618806e620 0x7f618814d290 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f618814b200 0x7f618806e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 --2- 172.21.15.71:0/1526850927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f616c003fe0 0x7f61880c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 -- 172.21.15.71:0/1526850927 >> 172.21.15.71:0/1526850927 conn(0x7f61880b99c0 msgr2=0x7f61880d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:01.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 -- 172.21.15.71:0/1526850927 shutdown_connections 2024-04-20T21:20:01.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.250+0000 7f6190200640 1 -- 172.21.15.71:0/1526850927 wait complete. 2024-04-20T21:20:01.267 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:01.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.470+0000 7f9ad7200640 1 Processor -- start 2024-04-20T21:20:01.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.471+0000 7f9ad7200640 1 -- start start 2024-04-20T21:20:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.472+0000 7f9ad7200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9ad8158ca0 0x7f9ad806db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.472+0000 7f9ad7200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ad806e0d0 0x7f9ad815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.472+0000 7f9ad7200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad815f960 con 0x7f9ad815f0e0 2024-04-20T21:20:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.472+0000 7f9ad7200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad8147100 con 0x7f9ad806e0d0 2024-04-20T21:20:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.472+0000 7f9ad7200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad806b9a0 con 0x7f9ad8158ca0 2024-04-20T21:20:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.472+0000 7f9acfe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ad806e0d0 0x7f9ad815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.472+0000 7f9ad6800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9ad815f0e0 0x7f9ad8145070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46448/0 (socket says 172.21.15.71:46448) 2024-04-20T21:20:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.472+0000 7f9ad6800640 1 -- 172.21.15.71:0/3623167732 learned_addr learned my addr 172.21.15.71:0/3623167732 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.473+0000 7f9ad5e00640 1 --2- 172.21.15.71:0/3623167732 >> v2:172.21.15.137:3300/0 conn(0x7f9ad8158ca0 0x7f9ad806db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.473+0000 7f9acfe00640 1 -- 172.21.15.71:0/3623167732 >> v2:172.21.15.137:3300/0 conn(0x7f9ad8158ca0 msgr2=0x7f9ad806db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.473+0000 7f9acfe00640 1 --2- 172.21.15.71:0/3623167732 >> v2:172.21.15.137:3300/0 conn(0x7f9ad8158ca0 0x7f9ad806db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.473+0000 7f9acfe00640 1 -- 172.21.15.71:0/3623167732 >> v1:172.21.15.71:6789/0 conn(0x7f9ad815f0e0 legacy=0x7f9ad8145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.473+0000 7f9acfe00640 1 -- 172.21.15.71:0/3623167732 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad806bc80 con 0x7f9ad806e0d0 2024-04-20T21:20:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.473+0000 7f9ad5e00640 1 --2- 172.21.15.71:0/3623167732 >> v2:172.21.15.137:3300/0 conn(0x7f9ad8158ca0 0x7f9ad806db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.473+0000 7f9ad5400640 1 -- 172.21.15.71:0/3623167732 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755604679 0 0) 0x7f9ad815f960 con 0x7f9ad815f0e0 2024-04-20T21:20:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.474+0000 7f9acfe00640 1 --2- 172.21.15.71:0/3623167732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ad806e0d0 0x7f9ad815eba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ad806eb10 tx=0x7f9ac002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcbbc824a5ca9fb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.474+0000 7f9ad5400640 1 -- 172.21.15.71:0/3623167732 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0035020 con 0x7f9ad806e0d0 2024-04-20T21:20:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.474+0000 7f9ad5400640 1 -- 172.21.15.71:0/3623167732 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac0031830 con 0x7f9ad806e0d0 2024-04-20T21:20:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.474+0000 7f9ad5400640 1 -- 172.21.15.71:0/3623167732 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0031c00 con 0x7f9ad806e0d0 2024-04-20T21:20:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.475+0000 7f9ad7200640 1 -- 172.21.15.71:0/3623167732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ad806e0d0 msgr2=0x7f9ad815eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.475+0000 7f9ad7200640 1 --2- 172.21.15.71:0/3623167732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ad806e0d0 0x7f9ad815eba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ad806eb10 tx=0x7f9ac002b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.475+0000 7f9ad7200640 1 -- 172.21.15.71:0/3623167732 shutdown_connections 2024-04-20T21:20:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.475+0000 7f9ad7200640 1 --2- 172.21.15.71:0/3623167732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ad806e0d0 0x7f9ad815eba0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.475+0000 7f9ad7200640 1 --2- 172.21.15.71:0/3623167732 >> v2:172.21.15.137:3300/0 conn(0x7f9ad8158ca0 0x7f9ad806db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.475+0000 7f9ad7200640 1 -- 172.21.15.71:0/3623167732 >> 172.21.15.71:0/3623167732 conn(0x7f9ad80b5270 msgr2=0x7f9ad80b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.475+0000 7f9ad7200640 1 -- 172.21.15.71:0/3623167732 shutdown_connections 2024-04-20T21:20:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.475+0000 7f9ad7200640 1 -- 172.21.15.71:0/3623167732 wait complete. 2024-04-20T21:20:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.477+0000 7f9ad7200640 1 Processor -- start 2024-04-20T21:20:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.477+0000 7f9ad7200640 1 -- start start 2024-04-20T21:20:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.477+0000 7f9ad7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ad806e0d0 0x7f9ad809db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ad8158ca0 0x7f9ad809ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ad815f0e0 0x7f9ad809b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad7200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad806c760 con 0x7f9ad806e0d0 2024-04-20T21:20:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad806c240 con 0x7f9ad815f0e0 2024-04-20T21:20:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad81f7340 con 0x7f9ad8158ca0 2024-04-20T21:20:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ad806e0d0 0x7f9ad809db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ad806e0d0 0x7f9ad809db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45234/0 (socket says 172.21.15.71:45234) 2024-04-20T21:20:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad5e00640 1 -- 172.21.15.71:0/3557131545 learned_addr learned my addr 172.21.15.71:0/3557131545 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:01.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad5e00640 1 -- 172.21.15.71:0/3557131545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ad8158ca0 msgr2=0x7f9ad809ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad5e00640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ad8158ca0 0x7f9ad809ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad5e00640 1 -- 172.21.15.71:0/3557131545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ad815f0e0 msgr2=0x7f9ad809b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad5e00640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ad815f0e0 0x7f9ad809b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad5e00640 1 -- 172.21.15.71:0/3557131545 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad809e190 con 0x7f9ad806e0d0 2024-04-20T21:20:01.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.478+0000 7f9ad5e00640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ad806e0d0 0x7f9ad809db80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800c7f0 tx=0x7f9ac800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:01.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.479+0000 7f9ace000640 1 -- 172.21.15.71:0/3557131545 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8015070 con 0x7f9ad806e0d0 2024-04-20T21:20:01.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.479+0000 7f9ace000640 1 -- 172.21.15.71:0/3557131545 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac8007a30 con 0x7f9ad806e0d0 2024-04-20T21:20:01.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.479+0000 7f9ace000640 1 -- 172.21.15.71:0/3557131545 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8007e00 con 0x7f9ad806e0d0 2024-04-20T21:20:01.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.479+0000 7f9ad7200640 1 -- 172.21.15.71:0/3557131545 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad80afc80 con 0x7f9ad806e0d0 2024-04-20T21:20:01.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.479+0000 7f9ad7200640 1 -- 172.21.15.71:0/3557131545 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad80b0240 con 0x7f9ad806e0d0 2024-04-20T21:20:01.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.480+0000 7f9ad7200640 1 -- 172.21.15.71:0/3557131545 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad8075b30 con 0x7f9ad806e0d0 2024-04-20T21:20:01.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.481+0000 7f9ace000640 1 -- 172.21.15.71:0/3557131545 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ac8018070 con 0x7f9ad806e0d0 2024-04-20T21:20:01.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.482+0000 7f9ace000640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9ab406c920 0x7f9ab406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.482+0000 7f9ace000640 1 -- 172.21.15.71:0/3557131545 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9ac808bf10 con 0x7f9ad806e0d0 2024-04-20T21:20:01.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.482+0000 7f9acfe00640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9ab406c920 0x7f9ab406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.483+0000 7f9acfe00640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9ab406c920 0x7f9ab406ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0036000 tx=0x7f9ac0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:01.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.487+0000 7f9ace000640 1 -- 172.21.15.71:0/3557131545 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9ac8059f60 con 0x7f9ad806e0d0 2024-04-20T21:20:01.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.687+0000 7f9ad7200640 1 -- 172.21.15.71:0/3557131545 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9ad815f960 con 0x7f9ad806e0d0 2024-04-20T21:20:01.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.687+0000 7f9ace000640 1 -- 172.21.15.71:0/3557131545 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f9ac8059860 con 0x7f9ad806e0d0 2024-04-20T21:20:01.687 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:01.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 -- 172.21.15.71:0/3557131545 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9ab406c920 msgr2=0x7f9ab406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9ab406c920 0x7f9ab406ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0036000 tx=0x7f9ac0030000 comp rx=0 tx=0).stop 2024-04-20T21:20:01.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 -- 172.21.15.71:0/3557131545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ad806e0d0 msgr2=0x7f9ad809db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ad806e0d0 0x7f9ad809db80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800c7f0 tx=0x7f9ac800cbf0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 -- 172.21.15.71:0/3557131545 shutdown_connections 2024-04-20T21:20:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9ab406c920 0x7f9ab406ede0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ad815f0e0 0x7f9ad809b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ad8158ca0 0x7f9ad809ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 --2- 172.21.15.71:0/3557131545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ad806e0d0 0x7f9ad809db80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 -- 172.21.15.71:0/3557131545 >> 172.21.15.71:0/3557131545 conn(0x7f9ad80b5270 msgr2=0x7f9ad8071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 -- 172.21.15.71:0/3557131545 shutdown_connections 2024-04-20T21:20:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.690+0000 7f9ad7200640 1 -- 172.21.15.71:0/3557131545 wait complete. 2024-04-20T21:20:01.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:20:01.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.912+0000 7f514be00640 1 Processor -- start 2024-04-20T21:20:01.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.912+0000 7f514be00640 1 -- start start 2024-04-20T21:20:01.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.914+0000 7f514be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f514c0aff60 0x7f514c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.914+0000 7f514be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f514c15eca0 0x7f514c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.914+0000 7f514be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f514c0cf110 con 0x7f514c06be40 2024-04-20T21:20:01.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.914+0000 7f514be00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f514c06c2b0 con 0x7f514c15eca0 2024-04-20T21:20:01.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.914+0000 7f514be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f514c06e000 con 0x7f514c0aff60 2024-04-20T21:20:01.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.914+0000 7f5142000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f514c15eca0 0x7f514c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.914+0000 7f5142000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f514c15eca0 0x7f514c06b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45248/0 (socket says 172.21.15.71:45248) 2024-04-20T21:20:01.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.914+0000 7f5142000640 1 -- 172.21.15.71:0/167506950 learned_addr learned my addr 172.21.15.71:0/167506950 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:01.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.914+0000 7f514aa00640 1 --2- 172.21.15.71:0/167506950 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f514c0aff60 0x7f514c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.915+0000 7f5142000640 1 -- 172.21.15.71:0/167506950 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f514c0aff60 msgr2=0x7f514c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:01.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.915+0000 7f5142000640 1 --2- 172.21.15.71:0/167506950 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f514c0aff60 0x7f514c0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.915+0000 7f5142000640 1 -- 172.21.15.71:0/167506950 >> v1:172.21.15.137:6789/0 conn(0x7f514c06be40 legacy=0x7f514c162140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:01.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.915+0000 7f5142000640 1 -- 172.21.15.71:0/167506950 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514c0cf3f0 con 0x7f514c15eca0 2024-04-20T21:20:01.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.916+0000 7f5142000640 1 --2- 172.21.15.71:0/167506950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f514c15eca0 0x7f514c06b900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f514c073ad0 tx=0x7f513402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e2bb7fe57d1976 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:01.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.916+0000 7f514a000640 1 -- 172.21.15.71:0/167506950 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134035020 con 0x7f514c15eca0 2024-04-20T21:20:01.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.916+0000 7f514a000640 1 -- 172.21.15.71:0/167506950 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5134031830 con 0x7f514c15eca0 2024-04-20T21:20:01.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.916+0000 7f514a000640 1 -- 172.21.15.71:0/167506950 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134031c00 con 0x7f514c15eca0 2024-04-20T21:20:01.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.917+0000 7f514be00640 1 -- 172.21.15.71:0/167506950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f514c15eca0 msgr2=0x7f514c06b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.917+0000 7f514be00640 1 --2- 172.21.15.71:0/167506950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f514c15eca0 0x7f514c06b900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f514c073ad0 tx=0x7f513402b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.917+0000 7f514be00640 1 -- 172.21.15.71:0/167506950 shutdown_connections 2024-04-20T21:20:01.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.917+0000 7f514be00640 1 --2- 172.21.15.71:0/167506950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f514c15eca0 0x7f514c06b900 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.917+0000 7f514be00640 1 --2- 172.21.15.71:0/167506950 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f514c0aff60 0x7f514c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.917+0000 7f514be00640 1 -- 172.21.15.71:0/167506950 >> 172.21.15.71:0/167506950 conn(0x7f514c0cd3b0 msgr2=0x7f514c0cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:01.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.917+0000 7f514be00640 1 -- 172.21.15.71:0/167506950 shutdown_connections 2024-04-20T21:20:01.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.917+0000 7f514be00640 1 -- 172.21.15.71:0/167506950 wait complete. 2024-04-20T21:20:01.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.919+0000 7f514be00640 1 Processor -- start 2024-04-20T21:20:01.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.919+0000 7f514be00640 1 -- start start 2024-04-20T21:20:01.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f514c06be40 0x7f514c145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f514c0aff60 0x7f514c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f514c15eca0 0x7f514c156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f514c0b0340 con 0x7f514c06be40 2024-04-20T21:20:01.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f514c0cf9b0 con 0x7f514c15eca0 2024-04-20T21:20:01.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f514c0cece0 con 0x7f514c0aff60 2024-04-20T21:20:01.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f514c06be40 0x7f514c145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f514c06be40 0x7f514c145470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45264/0 (socket says 172.21.15.71:45264) 2024-04-20T21:20:01.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514aa00640 1 -- 172.21.15.71:0/2939054937 learned_addr learned my addr 172.21.15.71:0/2939054937 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:01.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514aa00640 1 -- 172.21.15.71:0/2939054937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f514c0aff60 msgr2=0x7f514c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514aa00640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f514c0aff60 0x7f514c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514aa00640 1 -- 172.21.15.71:0/2939054937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f514c15eca0 msgr2=0x7f514c156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:01.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.920+0000 7f514aa00640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f514c15eca0 0x7f514c156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:01.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.921+0000 7f514aa00640 1 -- 172.21.15.71:0/2939054937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514c159e10 con 0x7f514c06be40 2024-04-20T21:20:01.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.921+0000 7f514aa00640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f514c06be40 0x7f514c145470 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f513c00d5f0 tx=0x7f513c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:01.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.921+0000 7f5143e00640 1 -- 172.21.15.71:0/2939054937 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c0125f0 con 0x7f514c06be40 2024-04-20T21:20:01.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.921+0000 7f5143e00640 1 -- 172.21.15.71:0/2939054937 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513c019070 con 0x7f514c06be40 2024-04-20T21:20:01.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.921+0000 7f5143e00640 1 -- 172.21.15.71:0/2939054937 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c0129d0 con 0x7f514c06be40 2024-04-20T21:20:01.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.921+0000 7f514be00640 1 -- 172.21.15.71:0/2939054937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514c145bf0 con 0x7f514c06be40 2024-04-20T21:20:01.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.921+0000 7f514be00640 1 -- 172.21.15.71:0/2939054937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f514c1461b0 con 0x7f514c06be40 2024-04-20T21:20:01.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.922+0000 7f514be00640 1 -- 172.21.15.71:0/2939054937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f514c146870 con 0x7f514c06be40 2024-04-20T21:20:01.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.923+0000 7f5143e00640 1 -- 172.21.15.71:0/2939054937 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f513c012b70 con 0x7f514c06be40 2024-04-20T21:20:01.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.924+0000 7f5143e00640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f512806c8f0 0x7f512806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:01.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.924+0000 7f5143e00640 1 -- 172.21.15.71:0/2939054937 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f513c08c2c0 con 0x7f514c06be40 2024-04-20T21:20:01.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.924+0000 7f5142000640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f512806c8f0 0x7f512806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:01.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.925+0000 7f5142000640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f512806c8f0 0x7f512806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5134036000 tx=0x7f5134030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:01.929+0000 7f5143e00640 1 -- 172.21.15.71:0/2939054937 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f514c146870 con 0x7f514c06be40 2024-04-20T21:20:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.171+0000 7f514be00640 1 -- 172.21.15.71:0/2939054937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f514c06fe50 con 0x7f514c06be40 2024-04-20T21:20:02.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.173+0000 7f5143e00640 1 -- 172.21.15.71:0/2939054937 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5201 (secure 0 0 0) 0x7f513c05a390 con 0x7f514c06be40 2024-04-20T21:20:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:02.173 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3502151495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3502151495},{"type":"v1","addr":"172.21.15.137:6833","nonce":3502151495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2603023903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2603023903},{"type":"v1","addr":"172.21.15.137:6835","nonce":2603023903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3246613850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3246613850},{"type":"v1","addr":"172.21.15.71:6835","nonce":3246613850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:19:28.763862+0000","modified":"2024-04-20T21:19:51.195122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/4085222328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":4085222328},{"type":"v1","addr":"172.21.15.71:6837","nonce":4085222328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-20T21:20:02.173 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.175+0000 7f514be00640 1 -- 172.21.15.71:0/2939054937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f512806c8f0 msgr2=0x7f512806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.175+0000 7f514be00640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f512806c8f0 0x7f512806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5134036000 tx=0x7f5134030000 comp rx=0 tx=0).stop 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.175+0000 7f514be00640 1 -- 172.21.15.71:0/2939054937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f514c06be40 msgr2=0x7f514c145470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.175+0000 7f514be00640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f514c06be40 0x7f514c145470 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f513c00d5f0 tx=0x7f513c00dab0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.175+0000 7f514be00640 1 -- 172.21.15.71:0/2939054937 shutdown_connections 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.175+0000 7f514be00640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f512806c8f0 0x7f512806edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.176+0000 7f514be00640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f514c15eca0 0x7f514c156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.176+0000 7f514be00640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f514c0aff60 0x7f514c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.176+0000 7f514be00640 1 --2- 172.21.15.71:0/2939054937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f514c06be40 0x7f514c145470 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.176+0000 7f514be00640 1 -- 172.21.15.71:0/2939054937 >> 172.21.15.71:0/2939054937 conn(0x7f514c0cd3b0 msgr2=0x7f514c0adb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.176+0000 7f514be00640 1 -- 172.21.15.71:0/2939054937 shutdown_connections 2024-04-20T21:20:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.176+0000 7f514be00640 1 -- 172.21.15.71:0/2939054937 wait complete. 2024-04-20T21:20:02.193 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.391+0000 7fcd8e800640 1 Processor -- start 2024-04-20T21:20:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.391+0000 7fcd8e800640 1 -- start start 2024-04-20T21:20:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.393+0000 7fcd8e800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd8815e740 0x7fcd880cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.393+0000 7fcd8e800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8806dd00 con 0x7fcd880709c0 2024-04-20T21:20:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.393+0000 7fcd8e800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd880cfac0 con 0x7fcd8806c010 2024-04-20T21:20:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.393+0000 7fcd8e800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcd880b4240 con 0x7fcd8815e740 2024-04-20T21:20:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.393+0000 7fcd87400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd8815e740 0x7fcd880cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.393+0000 7fcd7ea00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fcd880709c0 0x7fcd8806b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46450/0 (socket says 172.21.15.71:46450) 2024-04-20T21:20:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.393+0000 7fcd7ea00640 1 -- 172.21.15.71:0/3073178915 learned_addr learned my addr 172.21.15.71:0/3073178915 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.394+0000 7fcd86a00640 1 -- 172.21.15.71:0/3073178915 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1274138996 0 0) 0x7fcd8806dd00 con 0x7fcd880709c0 2024-04-20T21:20:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.394+0000 7fcd86a00640 1 -- 172.21.15.71:0/3073178915 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd6c003520 con 0x7fcd880709c0 2024-04-20T21:20:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.394+0000 7fcd87400640 1 -- 172.21.15.71:0/3073178915 >> v1:172.21.15.137:6789/0 conn(0x7fcd8806c010 legacy=0x7fcd880b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.394+0000 7fcd87400640 1 -- 172.21.15.71:0/3073178915 >> v1:172.21.15.71:6789/0 conn(0x7fcd880709c0 legacy=0x7fcd8806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.394+0000 7fcd87400640 1 -- 172.21.15.71:0/3073178915 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd880cfda0 con 0x7fcd8815e740 2024-04-20T21:20:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.395+0000 7fcd87400640 1 --2- 172.21.15.71:0/3073178915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd8815e740 0x7fcd880cf3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcd780097a0 tx=0x7fcd7802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a9455441695455 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.395+0000 7fcd86a00640 1 -- 172.21.15.71:0/3073178915 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78035020 con 0x7fcd8815e740 2024-04-20T21:20:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.396+0000 7fcd86a00640 1 -- 172.21.15.71:0/3073178915 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd78031830 con 0x7fcd8815e740 2024-04-20T21:20:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.396+0000 7fcd86a00640 1 -- 172.21.15.71:0/3073178915 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78031c00 con 0x7fcd8815e740 2024-04-20T21:20:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.396+0000 7fcd8e800640 1 -- 172.21.15.71:0/3073178915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd8815e740 msgr2=0x7fcd880cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.396+0000 7fcd8e800640 1 --2- 172.21.15.71:0/3073178915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd8815e740 0x7fcd880cf3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcd780097a0 tx=0x7fcd7802b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.396+0000 7fcd8e800640 1 -- 172.21.15.71:0/3073178915 shutdown_connections 2024-04-20T21:20:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.396+0000 7fcd8e800640 1 --2- 172.21.15.71:0/3073178915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd8815e740 0x7fcd880cf3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.396+0000 7fcd8e800640 1 -- 172.21.15.71:0/3073178915 >> 172.21.15.71:0/3073178915 conn(0x7fcd880cd530 msgr2=0x7fcd880cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.396+0000 7fcd8e800640 1 -- 172.21.15.71:0/3073178915 shutdown_connections 2024-04-20T21:20:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.396+0000 7fcd8e800640 1 -- 172.21.15.71:0/3073178915 wait complete. 2024-04-20T21:20:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.398+0000 7fcd8e800640 1 Processor -- start 2024-04-20T21:20:02.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.398+0000 7fcd8e800640 1 -- start start 2024-04-20T21:20:02.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.399+0000 7fcd8e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd8806c010 0x7fcd88141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.399+0000 7fcd8e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd880709c0 0x7fcd8815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.399+0000 7fcd8e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd8815e740 0x7fcd8815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.399+0000 7fcd8e800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880b4de0 con 0x7fcd880709c0 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.399+0000 7fcd8e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8815eb20 con 0x7fcd8815e740 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.399+0000 7fcd8e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcd880b4f60 con 0x7fcd8806c010 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.399+0000 7fcd7ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd880709c0 0x7fcd8815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.399+0000 7fcd7ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd880709c0 0x7fcd8815aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45268/0 (socket says 172.21.15.71:45268) 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.399+0000 7fcd7ea00640 1 -- 172.21.15.71:0/449116886 learned_addr learned my addr 172.21.15.71:0/449116886 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.400+0000 7fcd7ea00640 1 -- 172.21.15.71:0/449116886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd8806c010 msgr2=0x7fcd88141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.400+0000 7fcd87400640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd8806c010 0x7fcd88141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.400+0000 7fcd7ea00640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd8806c010 0x7fcd88141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.400+0000 7fcd7ea00640 1 -- 172.21.15.71:0/449116886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd8815e740 msgr2=0x7fcd8815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.400+0000 7fcd7ea00640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd8815e740 0x7fcd8815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.400+0000 7fcd7ea00640 1 -- 172.21.15.71:0/449116886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd88159a40 con 0x7fcd880709c0 2024-04-20T21:20:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.400+0000 7fcd7ea00640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd880709c0 0x7fcd8815aa70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000c430 tx=0x7fcd7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.400+0000 7fcd7fe00640 1 -- 172.21.15.71:0/449116886 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70017070 con 0x7fcd880709c0 2024-04-20T21:20:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.400+0000 7fcd7fe00640 1 -- 172.21.15.71:0/449116886 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd70005ce0 con 0x7fcd880709c0 2024-04-20T21:20:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.400+0000 7fcd7fe00640 1 -- 172.21.15.71:0/449116886 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd700072f0 con 0x7fcd880709c0 2024-04-20T21:20:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.400+0000 7fcd8e800640 1 -- 172.21.15.71:0/449116886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd88159cb0 con 0x7fcd880709c0 2024-04-20T21:20:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.401+0000 7fcd8e800640 1 -- 172.21.15.71:0/449116886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8815a270 con 0x7fcd880709c0 2024-04-20T21:20:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.402+0000 7fcd8e800640 1 -- 172.21.15.71:0/449116886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd88068980 con 0x7fcd880709c0 2024-04-20T21:20:02.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.403+0000 7fcd7fe00640 1 -- 172.21.15.71:0/449116886 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd7001a070 con 0x7fcd880709c0 2024-04-20T21:20:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.403+0000 7fcd7fe00640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fcd6406c8f0 0x7fcd6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.404+0000 7fcd7fe00640 1 -- 172.21.15.71:0/449116886 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcd7008b410 con 0x7fcd880709c0 2024-04-20T21:20:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.404+0000 7fcd87400640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fcd6406c8f0 0x7fcd6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:02.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.404+0000 7fcd87400640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fcd6406c8f0 0x7fcd6406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd78036000 tx=0x7fcd78008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:02.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.408+0000 7fcd7fe00640 1 -- 172.21.15.71:0/449116886 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fcd70059460 con 0x7fcd880709c0 2024-04-20T21:20:02.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.609+0000 7fcd8e800640 1 -- 172.21.15.71:0/449116886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd880ce4a0 con 0x7fcd880709c0 2024-04-20T21:20:02.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.611+0000 7fcd7fe00640 1 -- 172.21.15.71:0/449116886 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fcd70058d60 con 0x7fcd880709c0 2024-04-20T21:20:02.611 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:02.611 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:02.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 -- 172.21.15.71:0/449116886 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fcd6406c8f0 msgr2=0x7fcd6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:02.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fcd6406c8f0 0x7fcd6406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd78036000 tx=0x7fcd78008030 comp rx=0 tx=0).stop 2024-04-20T21:20:02.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 -- 172.21.15.71:0/449116886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd880709c0 msgr2=0x7fcd8815aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:02.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd880709c0 0x7fcd8815aa70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000c430 tx=0x7fcd7000c8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 -- 172.21.15.71:0/449116886 shutdown_connections 2024-04-20T21:20:02.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fcd6406c8f0 0x7fcd6406edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd8815e740 0x7fcd8815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd880709c0 0x7fcd8815aa70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 --2- 172.21.15.71:0/449116886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd8806c010 0x7fcd88141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 -- 172.21.15.71:0/449116886 >> 172.21.15.71:0/449116886 conn(0x7fcd880cd530 msgr2=0x7fcd8806eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:02.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 -- 172.21.15.71:0/449116886 shutdown_connections 2024-04-20T21:20:02.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.614+0000 7fcd8e800640 1 -- 172.21.15.71:0/449116886 wait complete. 2024-04-20T21:20:02.633 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:02.633 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:02.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.834+0000 7f8deb400640 1 Processor -- start 2024-04-20T21:20:02.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.835+0000 7f8deb400640 1 -- start start 2024-04-20T21:20:02.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.836+0000 7f8deb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de415e960 0x7f8de40d4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.836+0000 7f8deb400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8de40d1c10 0x7f8de40d4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.836+0000 7f8deb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8de40b6120 0x7f8de40b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.836+0000 7f8deb400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8de415ed40 con 0x7f8de40d1c10 2024-04-20T21:20:02.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.836+0000 7f8deb400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8de40b6e90 con 0x7f8de40b6120 2024-04-20T21:20:02.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.836+0000 7f8deb400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8de40d0e50 con 0x7f8de415e960 2024-04-20T21:20:02.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.836+0000 7f8de3e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8de40d1c10 0x7f8de40d4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:02.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.836+0000 7f8de3e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8de40d1c10 0x7f8de40d4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45272/0 (socket says 172.21.15.71:45272) 2024-04-20T21:20:02.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.836+0000 7f8de3e00640 1 -- 172.21.15.71:0/2169709601 learned_addr learned my addr 172.21.15.71:0/2169709601 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:02.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.837+0000 7f8de9400640 1 --2- 172.21.15.71:0/2169709601 >> v2:172.21.15.137:3300/0 conn(0x7f8de40b6120 0x7f8de40b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:02.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.837+0000 7f8de8a00640 1 --2- 172.21.15.71:0/2169709601 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de415e960 0x7f8de40d4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:02.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.837+0000 7f8de3e00640 1 -- 172.21.15.71:0/2169709601 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de415e960 msgr2=0x7f8de40d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:02.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.837+0000 7f8de3e00640 1 --2- 172.21.15.71:0/2169709601 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de415e960 0x7f8de40d4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.837+0000 7f8de3e00640 1 -- 172.21.15.71:0/2169709601 >> v2:172.21.15.137:3300/0 conn(0x7f8de40b6120 msgr2=0x7f8de40b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:02.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.837+0000 7f8de3e00640 1 --2- 172.21.15.71:0/2169709601 >> v2:172.21.15.137:3300/0 conn(0x7f8de40b6120 0x7f8de40b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.837+0000 7f8de3e00640 1 -- 172.21.15.71:0/2169709601 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de40d1130 con 0x7f8de40d1c10 2024-04-20T21:20:02.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.837+0000 7f8de9400640 1 --2- 172.21.15.71:0/2169709601 >> v2:172.21.15.137:3300/0 conn(0x7f8de40b6120 0x7f8de40b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:02.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.837+0000 7f8de8a00640 1 --2- 172.21.15.71:0/2169709601 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de415e960 0x7f8de40d4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:02.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.838+0000 7f8de3e00640 1 --2- 172.21.15.71:0/2169709601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de40d1c10 0x7f8de40d4fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8de40b3610 tx=0x7f8dcc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72dc00ae47f33c01 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:02.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.838+0000 7f8de3400640 1 -- 172.21.15.71:0/2169709601 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc035020 con 0x7f8de40d1c10 2024-04-20T21:20:02.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.838+0000 7f8de3400640 1 -- 172.21.15.71:0/2169709601 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dcc02d040 con 0x7f8de40d1c10 2024-04-20T21:20:02.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.838+0000 7f8de3400640 1 -- 172.21.15.71:0/2169709601 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc031a80 con 0x7f8de40d1c10 2024-04-20T21:20:02.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.839+0000 7f8deb400640 1 -- 172.21.15.71:0/2169709601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de40d1c10 msgr2=0x7f8de40d4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:02.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.839+0000 7f8deb400640 1 --2- 172.21.15.71:0/2169709601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de40d1c10 0x7f8de40d4fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8de40b3610 tx=0x7f8dcc02b900 comp rx=0 tx=0).stop 2024-04-20T21:20:02.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.839+0000 7f8deb400640 1 -- 172.21.15.71:0/2169709601 shutdown_connections 2024-04-20T21:20:02.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.839+0000 7f8deb400640 1 --2- 172.21.15.71:0/2169709601 >> v2:172.21.15.137:3300/0 conn(0x7f8de40b6120 0x7f8de40b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.839+0000 7f8deb400640 1 --2- 172.21.15.71:0/2169709601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de40d1c10 0x7f8de40d4fe0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.839+0000 7f8deb400640 1 --2- 172.21.15.71:0/2169709601 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de415e960 0x7f8de40d4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.839+0000 7f8deb400640 1 -- 172.21.15.71:0/2169709601 >> 172.21.15.71:0/2169709601 conn(0x7f8de40b96f0 msgr2=0x7f8de40b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:02.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.839+0000 7f8deb400640 1 -- 172.21.15.71:0/2169709601 shutdown_connections 2024-04-20T21:20:02.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.839+0000 7f8deb400640 1 -- 172.21.15.71:0/2169709601 wait complete. 2024-04-20T21:20:02.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.841+0000 7f8deb400640 1 Processor -- start 2024-04-20T21:20:02.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.841+0000 7f8deb400640 1 -- start start 2024-04-20T21:20:02.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.842+0000 7f8deb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de40b6120 0x7f8de40cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.842+0000 7f8deb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de40d1c10 0x7f8de415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.842+0000 7f8deb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8de415e960 0x7f8de4158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.842+0000 7f8deb400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8de40b6af0 con 0x7f8de40b6120 2024-04-20T21:20:02.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.842+0000 7f8deb400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8de40d16f0 con 0x7f8de415e960 2024-04-20T21:20:02.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.842+0000 7f8deb400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8de40b6c70 con 0x7f8de40d1c10 2024-04-20T21:20:02.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.842+0000 7f8de8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de40b6120 0x7f8de40cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:02.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.842+0000 7f8de8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de40b6120 0x7f8de40cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45280/0 (socket says 172.21.15.71:45280) 2024-04-20T21:20:02.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.842+0000 7f8de8a00640 1 -- 172.21.15.71:0/3911863617 learned_addr learned my addr 172.21.15.71:0/3911863617 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:02.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.843+0000 7f8de8a00640 1 -- 172.21.15.71:0/3911863617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de40d1c10 msgr2=0x7f8de415b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:02.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.843+0000 7f8de8a00640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de40d1c10 0x7f8de415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.843+0000 7f8de8a00640 1 -- 172.21.15.71:0/3911863617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8de415e960 msgr2=0x7f8de4158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:02.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.843+0000 7f8de8a00640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8de415e960 0x7f8de4158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:02.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.843+0000 7f8de8a00640 1 -- 172.21.15.71:0/3911863617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de40cbd70 con 0x7f8de40b6120 2024-04-20T21:20:02.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.843+0000 7f8de8a00640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de40b6120 0x7f8de40cb620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400c820 tx=0x7f8dd400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:02.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.843+0000 7f8de0c00640 1 -- 172.21.15.71:0/3911863617 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4015070 con 0x7f8de40b6120 2024-04-20T21:20:02.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.843+0000 7f8de0c00640 1 -- 172.21.15.71:0/3911863617 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd4007a30 con 0x7f8de40b6120 2024-04-20T21:20:02.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.843+0000 7f8de0c00640 1 -- 172.21.15.71:0/3911863617 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4007de0 con 0x7f8de40b6120 2024-04-20T21:20:02.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.843+0000 7f8deb400640 1 -- 172.21.15.71:0/3911863617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de40cc050 con 0x7f8de40b6120 2024-04-20T21:20:02.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.843+0000 7f8deb400640 1 -- 172.21.15.71:0/3911863617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de40cc610 con 0x7f8de40b6120 2024-04-20T21:20:02.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.845+0000 7f8deb400640 1 -- 172.21.15.71:0/3911863617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de4068980 con 0x7f8de40b6120 2024-04-20T21:20:02.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.846+0000 7f8de0c00640 1 -- 172.21.15.71:0/3911863617 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8dd4018070 con 0x7f8de40b6120 2024-04-20T21:20:02.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.847+0000 7f8de0c00640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dc006c8f0 0x7f8dc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:02.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.847+0000 7f8de0c00640 1 -- 172.21.15.71:0/3911863617 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8dd408bd80 con 0x7f8de40b6120 2024-04-20T21:20:02.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.847+0000 7f8de3e00640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dc006c8f0 0x7f8dc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:02.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.848+0000 7f8de3e00640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dc006c8f0 0x7f8dc006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc036000 tx=0x7f8dcc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:02.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:02.852+0000 7f8de0c00640 1 -- 172.21.15.71:0/3911863617 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8dd4059e70 con 0x7f8de40b6120 2024-04-20T21:20:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.049+0000 7f8deb400640 1 -- 172.21.15.71:0/3911863617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8de40b39b0 con 0x7f8de40b6120 2024-04-20T21:20:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.050+0000 7f8de0c00640 1 -- 172.21.15.71:0/3911863617 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f8dd4059770 con 0x7f8de40b6120 2024-04-20T21:20:03.050 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.053+0000 7f8deb400640 1 -- 172.21.15.71:0/3911863617 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dc006c8f0 msgr2=0x7f8dc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.053+0000 7f8deb400640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dc006c8f0 0x7f8dc006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc036000 tx=0x7f8dcc030000 comp rx=0 tx=0).stop 2024-04-20T21:20:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.053+0000 7f8deb400640 1 -- 172.21.15.71:0/3911863617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de40b6120 msgr2=0x7f8de40cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.053+0000 7f8deb400640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de40b6120 0x7f8de40cb620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400c820 tx=0x7f8dd400cce0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.053+0000 7f8deb400640 1 -- 172.21.15.71:0/3911863617 shutdown_connections 2024-04-20T21:20:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.053+0000 7f8deb400640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dc006c8f0 0x7f8dc006edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.053+0000 7f8deb400640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8de415e960 0x7f8de4158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.053+0000 7f8deb400640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de40d1c10 0x7f8de415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.053+0000 7f8deb400640 1 --2- 172.21.15.71:0/3911863617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de40b6120 0x7f8de40cb620 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.053+0000 7f8deb400640 1 -- 172.21.15.71:0/3911863617 >> 172.21.15.71:0/3911863617 conn(0x7f8de40b96f0 msgr2=0x7f8de40b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.054+0000 7f8deb400640 1 -- 172.21.15.71:0/3911863617 shutdown_connections 2024-04-20T21:20:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.054+0000 7f8deb400640 1 -- 172.21.15.71:0/3911863617 wait complete. 2024-04-20T21:20:03.073 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:03.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.274+0000 7f5b21c00640 1 Processor -- start 2024-04-20T21:20:03.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.275+0000 7f5b21c00640 1 -- start start 2024-04-20T21:20:03.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.276+0000 7f5b21c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b1c0aee60 0x7f5b1c0af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:03.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.276+0000 7f5b21c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b1c06e060 0x7f5b1c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.276+0000 7f5b21c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b1c0af780 con 0x7f5b1c15d4f0 2024-04-20T21:20:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.276+0000 7f5b21c00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5b1c06c510 con 0x7f5b1c0aee60 2024-04-20T21:20:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.276+0000 7f5b21c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1c06b900 con 0x7f5b1c06e060 2024-04-20T21:20:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.276+0000 7f5b1be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b1c0aee60 0x7f5b1c0af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.276+0000 7f5b1be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b1c0aee60 0x7f5b1c0af240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42230/0 (socket says 172.21.15.71:42230) 2024-04-20T21:20:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.276+0000 7f5b1be00640 1 -- 172.21.15.71:0/4226928652 learned_addr learned my addr 172.21.15.71:0/4226928652 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.276+0000 7f5b21200640 1 --2- 172.21.15.71:0/4226928652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b1c06e060 0x7f5b1c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.277+0000 7f5b1be00640 1 -- 172.21.15.71:0/4226928652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b1c06e060 msgr2=0x7f5b1c06e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.277+0000 7f5b1be00640 1 --2- 172.21.15.71:0/4226928652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b1c06e060 0x7f5b1c06e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.277+0000 7f5b1be00640 1 -- 172.21.15.71:0/4226928652 >> v1:172.21.15.137:6789/0 conn(0x7f5b1c15d4f0 legacy=0x7f5b1c0ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.277+0000 7f5b1be00640 1 -- 172.21.15.71:0/4226928652 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c06bbe0 con 0x7f5b1c0aee60 2024-04-20T21:20:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.278+0000 7f5b1be00640 1 --2- 172.21.15.71:0/4226928652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b1c0aee60 0x7f5b1c0af240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009870 tx=0x7f5b0c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2f20f3797ecd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.278+0000 7f5b1b400640 1 -- 172.21.15.71:0/4226928652 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c035020 con 0x7f5b1c0aee60 2024-04-20T21:20:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.278+0000 7f5b1b400640 1 -- 172.21.15.71:0/4226928652 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c031640 con 0x7f5b1c0aee60 2024-04-20T21:20:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.278+0000 7f5b1b400640 1 -- 172.21.15.71:0/4226928652 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c02d040 con 0x7f5b1c0aee60 2024-04-20T21:20:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.279+0000 7f5b21c00640 1 -- 172.21.15.71:0/4226928652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b1c0aee60 msgr2=0x7f5b1c0af240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.279+0000 7f5b21c00640 1 --2- 172.21.15.71:0/4226928652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b1c0aee60 0x7f5b1c0af240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009870 tx=0x7f5b0c02b8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.279+0000 7f5b21c00640 1 -- 172.21.15.71:0/4226928652 shutdown_connections 2024-04-20T21:20:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.279+0000 7f5b21c00640 1 --2- 172.21.15.71:0/4226928652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b1c06e060 0x7f5b1c06e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.279+0000 7f5b21c00640 1 --2- 172.21.15.71:0/4226928652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b1c0aee60 0x7f5b1c0af240 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.279+0000 7f5b21c00640 1 -- 172.21.15.71:0/4226928652 >> 172.21.15.71:0/4226928652 conn(0x7f5b1c0b5270 msgr2=0x7f5b1c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.279+0000 7f5b21c00640 1 -- 172.21.15.71:0/4226928652 shutdown_connections 2024-04-20T21:20:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.279+0000 7f5b21c00640 1 -- 172.21.15.71:0/4226928652 wait complete. 2024-04-20T21:20:03.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.281+0000 7f5b21c00640 1 Processor -- start 2024-04-20T21:20:03.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.281+0000 7f5b21c00640 1 -- start start 2024-04-20T21:20:03.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.282+0000 7f5b21c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b1c06e060 0x7f5b1c1e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:03.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.282+0000 7f5b21c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b1c0aee60 0x7f5b1c153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:03.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.282+0000 7f5b21c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b1c15d4f0 0x7f5b1c1f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:03.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.282+0000 7f5b21c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c06c9a0 con 0x7f5b1c06e060 2024-04-20T21:20:03.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.282+0000 7f5b21c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c06c1a0 con 0x7f5b1c0aee60 2024-04-20T21:20:03.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.282+0000 7f5b21c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1c06ea30 con 0x7f5b1c15d4f0 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.282+0000 7f5b1be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b1c06e060 0x7f5b1c1e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.282+0000 7f5b1be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b1c06e060 0x7f5b1c1e7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42236/0 (socket says 172.21.15.71:42236) 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.282+0000 7f5b1be00640 1 -- 172.21.15.71:0/4128781310 learned_addr learned my addr 172.21.15.71:0/4128781310 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.283+0000 7f5b1be00640 1 -- 172.21.15.71:0/4128781310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b1c15d4f0 msgr2=0x7f5b1c1f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.283+0000 7f5b1be00640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b1c15d4f0 0x7f5b1c1f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.283+0000 7f5b1be00640 1 -- 172.21.15.71:0/4128781310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b1c0aee60 msgr2=0x7f5b1c153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.283+0000 7f5b13400640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b1c0aee60 0x7f5b1c153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.283+0000 7f5b1be00640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b1c0aee60 0x7f5b1c153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.283+0000 7f5b1be00640 1 -- 172.21.15.71:0/4128781310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c1544b0 con 0x7f5b1c06e060 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.283+0000 7f5b1be00640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b1c06e060 0x7f5b1c1e7ef0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c000c00 tx=0x7f5b0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.283+0000 7f5b18c00640 1 -- 172.21.15.71:0/4128781310 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c040070 con 0x7f5b1c06e060 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.283+0000 7f5b18c00640 1 -- 172.21.15.71:0/4128781310 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0399f0 con 0x7f5b1c06e060 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.283+0000 7f5b21c00640 1 -- 172.21.15.71:0/4128781310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1c154780 con 0x7f5b1c06e060 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.283+0000 7f5b18c00640 1 -- 172.21.15.71:0/4128781310 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c035040 con 0x7f5b1c06e060 2024-04-20T21:20:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.284+0000 7f5b21c00640 1 -- 172.21.15.71:0/4128781310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1c154d40 con 0x7f5b1c06e060 2024-04-20T21:20:03.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.285+0000 7f5b21c00640 1 -- 172.21.15.71:0/4128781310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b1c13c2d0 con 0x7f5b1c06e060 2024-04-20T21:20:03.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.286+0000 7f5b18c00640 1 -- 172.21.15.71:0/4128781310 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b0c038020 con 0x7f5b1c06e060 2024-04-20T21:20:03.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.286+0000 7f5b18c00640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5af806c8f0 0x7f5af806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:03.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.287+0000 7f5b18c00640 1 -- 172.21.15.71:0/4128781310 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5b0c0ad8b0 con 0x7f5b1c06e060 2024-04-20T21:20:03.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.287+0000 7f5b13400640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5af806c8f0 0x7f5af806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:03.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.287+0000 7f5b13400640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5af806c8f0 0x7f5af806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0b1be0 tx=0x7f5b04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:03.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.291+0000 7f5b18c00640 1 -- 172.21.15.71:0/4128781310 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5b0c07b990 con 0x7f5b1c06e060 2024-04-20T21:20:03.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.491+0000 7f5b21c00640 1 -- 172.21.15.71:0/4128781310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5b1c06e4f0 con 0x7f5b1c06e060 2024-04-20T21:20:03.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.492+0000 7f5b18c00640 1 -- 172.21.15.71:0/4128781310 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f5b0c0abe20 con 0x7f5b1c06e060 2024-04-20T21:20:03.492 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 -- 172.21.15.71:0/4128781310 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5af806c8f0 msgr2=0x7f5af806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5af806c8f0 0x7f5af806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0b1be0 tx=0x7f5b04009040 comp rx=0 tx=0).stop 2024-04-20T21:20:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 -- 172.21.15.71:0/4128781310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b1c06e060 msgr2=0x7f5b1c1e7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b1c06e060 0x7f5b1c1e7ef0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c000c00 tx=0x7f5b0c0046c0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 -- 172.21.15.71:0/4128781310 shutdown_connections 2024-04-20T21:20:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5af806c8f0 0x7f5af806edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b1c15d4f0 0x7f5b1c1f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b1c0aee60 0x7f5b1c153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 --2- 172.21.15.71:0/4128781310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b1c06e060 0x7f5b1c1e7ef0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 -- 172.21.15.71:0/4128781310 >> 172.21.15.71:0/4128781310 conn(0x7f5b1c0b5270 msgr2=0x7f5b1c0d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:03.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 -- 172.21.15.71:0/4128781310 shutdown_connections 2024-04-20T21:20:03.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.495+0000 7f5b21c00640 1 -- 172.21.15.71:0/4128781310 wait complete. 2024-04-20T21:20:03.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:03.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.719+0000 7f6ff6200640 1 Processor -- start 2024-04-20T21:20:03.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.719+0000 7f6ff6200640 1 -- start start 2024-04-20T21:20:03.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.721+0000 7f6ff6200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ff0162c00 0x7f6ff00d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:03.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.721+0000 7f6ff6200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff006df70 con 0x7f6ff006fc30 2024-04-20T21:20:03.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.721+0000 7f6ff6200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff006c720 con 0x7f6ff006f090 2024-04-20T21:20:03.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.721+0000 7f6ff6200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff0162fe0 con 0x7f6ff0162c00 2024-04-20T21:20:03.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.721+0000 7f6fefe00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6ff006fc30 0x7f6ff006c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53632/0 (socket says 172.21.15.71:53632) 2024-04-20T21:20:03.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.721+0000 7f6fefe00640 1 -- 172.21.15.71:0/3628494216 learned_addr learned my addr 172.21.15.71:0/3628494216 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:03.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.721+0000 7f6fef400640 1 --2- 172.21.15.71:0/3628494216 >> v2:172.21.15.71:3300/0 conn(0x7f6ff0162c00 0x7f6ff00d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:03.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.722+0000 7f6fef400640 1 -- 172.21.15.71:0/3628494216 >> v1:172.21.15.137:6789/0 conn(0x7f6ff006f090 legacy=0x7f6ff006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:03.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.722+0000 7f6fef400640 1 -- 172.21.15.71:0/3628494216 >> v1:172.21.15.71:6789/0 conn(0x7f6ff006fc30 legacy=0x7f6ff006c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.722+0000 7f6fef400640 1 -- 172.21.15.71:0/3628494216 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff006e310 con 0x7f6ff0162c00 2024-04-20T21:20:03.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.723+0000 7f6fef400640 1 --2- 172.21.15.71:0/3628494216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ff0162c00 0x7f6ff00d0360 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00097a0 tx=0x7f6fe002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a61b12e1dffb5b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:03.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.723+0000 7f6feea00640 1 -- 172.21.15.71:0/3628494216 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00315a0 con 0x7f6ff0162c00 2024-04-20T21:20:03.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.723+0000 7f6feea00640 1 -- 172.21.15.71:0/3628494216 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe0037070 con 0x7f6ff0162c00 2024-04-20T21:20:03.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.723+0000 7f6feea00640 1 -- 172.21.15.71:0/3628494216 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0031960 con 0x7f6ff0162c00 2024-04-20T21:20:03.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.724+0000 7f6ff6200640 1 -- 172.21.15.71:0/3628494216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ff0162c00 msgr2=0x7f6ff00d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.724+0000 7f6ff6200640 1 --2- 172.21.15.71:0/3628494216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ff0162c00 0x7f6ff00d0360 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00097a0 tx=0x7f6fe002b840 comp rx=0 tx=0).stop 2024-04-20T21:20:03.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.724+0000 7f6ff6200640 1 -- 172.21.15.71:0/3628494216 shutdown_connections 2024-04-20T21:20:03.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.724+0000 7f6ff6200640 1 --2- 172.21.15.71:0/3628494216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ff0162c00 0x7f6ff00d0360 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.724+0000 7f6ff6200640 1 -- 172.21.15.71:0/3628494216 >> 172.21.15.71:0/3628494216 conn(0x7f6ff00b3350 msgr2=0x7f6ff00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:03.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.724+0000 7f6ff6200640 1 -- 172.21.15.71:0/3628494216 shutdown_connections 2024-04-20T21:20:03.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.724+0000 7f6ff6200640 1 -- 172.21.15.71:0/3628494216 wait complete. 2024-04-20T21:20:03.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.726+0000 7f6ff6200640 1 Processor -- start 2024-04-20T21:20:03.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.726+0000 7f6ff6200640 1 -- start start 2024-04-20T21:20:03.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.727+0000 7f6ff6200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ff006f090 0x7f6ff0158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:03.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.727+0000 7f6ff6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff006fc30 0x7f6ff0165c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:03.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.727+0000 7f6ff6200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ff0162c00 0x7f6ff00ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.727+0000 7f6ff6200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff006e890 con 0x7f6ff0162c00 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.727+0000 7f6ff6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff006ec00 con 0x7f6ff006fc30 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.727+0000 7f6ff6200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff006dbb0 con 0x7f6ff006f090 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.727+0000 7f6fefe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ff0162c00 0x7f6ff00ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.728+0000 7f6fefe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ff0162c00 0x7f6ff00ae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42254/0 (socket says 172.21.15.71:42254) 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.728+0000 7f6fefe00640 1 -- 172.21.15.71:0/2450436051 learned_addr learned my addr 172.21.15.71:0/2450436051 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.728+0000 7f6fef400640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ff006f090 0x7f6ff0158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.728+0000 7f6fe6a00640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff006fc30 0x7f6ff0165c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.728+0000 7f6fefe00640 1 -- 172.21.15.71:0/2450436051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ff006f090 msgr2=0x7f6ff0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.728+0000 7f6fefe00640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ff006f090 0x7f6ff0158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.728+0000 7f6fefe00640 1 -- 172.21.15.71:0/2450436051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff006fc30 msgr2=0x7f6ff0165c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.728+0000 7f6fefe00640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff006fc30 0x7f6ff0165c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.728+0000 7f6fefe00640 1 -- 172.21.15.71:0/2450436051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff0165640 con 0x7f6ff0162c00 2024-04-20T21:20:03.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.728+0000 7f6fefe00640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ff0162c00 0x7f6ff00ae320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800caa0 tx=0x7f6fe800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:03.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.728+0000 7f6fe7e00640 1 -- 172.21.15.71:0/2450436051 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8017070 con 0x7f6ff0162c00 2024-04-20T21:20:03.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.729+0000 7f6fe7e00640 1 -- 172.21.15.71:0/2450436051 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe800ac00 con 0x7f6ff0162c00 2024-04-20T21:20:03.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.729+0000 7f6ff6200640 1 -- 172.21.15.71:0/2450436051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff0156af0 con 0x7f6ff0162c00 2024-04-20T21:20:03.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.729+0000 7f6fe7e00640 1 -- 172.21.15.71:0/2450436051 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8012400 con 0x7f6ff0162c00 2024-04-20T21:20:03.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.729+0000 7f6ff6200640 1 -- 172.21.15.71:0/2450436051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff01570b0 con 0x7f6ff0162c00 2024-04-20T21:20:03.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.730+0000 7f6ff6200640 1 -- 172.21.15.71:0/2450436051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff0068980 con 0x7f6ff0162c00 2024-04-20T21:20:03.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.731+0000 7f6fe7e00640 1 -- 172.21.15.71:0/2450436051 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fe801a070 con 0x7f6ff0162c00 2024-04-20T21:20:03.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.732+0000 7f6fe7e00640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6fcc06c920 0x7f6fcc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:03.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.732+0000 7f6fe7e00640 1 -- 172.21.15.71:0/2450436051 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6fe808bac0 con 0x7f6ff0162c00 2024-04-20T21:20:03.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.732+0000 7f6fef400640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6fcc06c920 0x7f6fcc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:03.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.733+0000 7f6fef400640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6fcc06c920 0x7f6fcc06ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0036000 tx=0x7f6fe003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:03.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.736+0000 7f6fe7e00640 1 -- 172.21.15.71:0/2450436051 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6fe8059550 con 0x7f6ff0162c00 2024-04-20T21:20:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.937+0000 7f6ff6200640 1 -- 172.21.15.71:0/2450436051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6ff00b0da0 con 0x7f6ff0162c00 2024-04-20T21:20:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.938+0000 7f6fe7e00640 1 -- 172.21.15.71:0/2450436051 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f6fe805d850 con 0x7f6ff0162c00 2024-04-20T21:20:03.938 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.940+0000 7f6ff6200640 1 -- 172.21.15.71:0/2450436051 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6fcc06c920 msgr2=0x7f6fcc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.940+0000 7f6ff6200640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6fcc06c920 0x7f6fcc06ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0036000 tx=0x7f6fe003d040 comp rx=0 tx=0).stop 2024-04-20T21:20:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.940+0000 7f6ff6200640 1 -- 172.21.15.71:0/2450436051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ff0162c00 msgr2=0x7f6ff00ae320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.940+0000 7f6ff6200640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ff0162c00 0x7f6ff00ae320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800caa0 tx=0x7f6fe800cf60 comp rx=0 tx=0).stop 2024-04-20T21:20:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.940+0000 7f6ff6200640 1 -- 172.21.15.71:0/2450436051 shutdown_connections 2024-04-20T21:20:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.940+0000 7f6ff6200640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6fcc06c920 0x7f6fcc06ede0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.940+0000 7f6ff6200640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ff0162c00 0x7f6ff00ae320 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.940+0000 7f6ff6200640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff006fc30 0x7f6ff0165c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.940+0000 7f6ff6200640 1 --2- 172.21.15.71:0/2450436051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ff006f090 0x7f6ff0158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.940+0000 7f6ff6200640 1 -- 172.21.15.71:0/2450436051 >> 172.21.15.71:0/2450436051 conn(0x7f6ff00b3350 msgr2=0x7f6ff0072350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.941+0000 7f6ff6200640 1 -- 172.21.15.71:0/2450436051 shutdown_connections 2024-04-20T21:20:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:03.941+0000 7f6ff6200640 1 -- 172.21.15.71:0/2450436051 wait complete. 2024-04-20T21:20:03.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:04.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.147+0000 7f10cd400640 1 Processor -- start 2024-04-20T21:20:04.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.147+0000 7f10cd400640 1 -- start start 2024-04-20T21:20:04.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.148+0000 7f10cd400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f10c8156c20 0x7f10c806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.148+0000 7f10cd400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10c80d0360 0x7f10c80d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10cd400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c8141c60 con 0x7f10c815ca40 2024-04-20T21:20:04.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10cd400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f10c80adab0 con 0x7f10c8156c20 2024-04-20T21:20:04.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10cd400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f10c815cf90 con 0x7f10c80d0360 2024-04-20T21:20:04.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10c6800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f10c8156c20 0x7f10c806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:04.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10c5e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f10c815ca40 0x7f10c80ad3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53648/0 (socket says 172.21.15.71:53648) 2024-04-20T21:20:04.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10c5e00640 1 -- 172.21.15.71:0/2328525578 learned_addr learned my addr 172.21.15.71:0/2328525578 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:04.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10c7200640 1 --2- 172.21.15.71:0/2328525578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10c80d0360 0x7f10c80d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:04.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10c6800640 1 -- 172.21.15.71:0/2328525578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10c80d0360 msgr2=0x7f10c80d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:04.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10c6800640 1 --2- 172.21.15.71:0/2328525578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10c80d0360 0x7f10c80d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10c6800640 1 -- 172.21.15.71:0/2328525578 >> v1:172.21.15.71:6789/0 conn(0x7f10c815ca40 legacy=0x7f10c80ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10c6800640 1 -- 172.21.15.71:0/2328525578 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c815d270 con 0x7f10c8156c20 2024-04-20T21:20:04.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.149+0000 7f10c5400640 1 -- 172.21.15.71:0/2328525578 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1630808688 0 0) 0x7f10c8141c60 con 0x7f10c815ca40 2024-04-20T21:20:04.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.151+0000 7f10c6800640 1 --2- 172.21.15.71:0/2328525578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c8156c20 0x7f10c806b900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f10b80097a0 tx=0x7f10b802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbed6ef372877ef server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:04.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.151+0000 7f10c5400640 1 -- 172.21.15.71:0/2328525578 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8035020 con 0x7f10c8156c20 2024-04-20T21:20:04.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.151+0000 7f10c5400640 1 -- 172.21.15.71:0/2328525578 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b8031810 con 0x7f10c8156c20 2024-04-20T21:20:04.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.151+0000 7f10c5400640 1 -- 172.21.15.71:0/2328525578 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8031be0 con 0x7f10c8156c20 2024-04-20T21:20:04.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.151+0000 7f10cd400640 1 -- 172.21.15.71:0/2328525578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c8156c20 msgr2=0x7f10c806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.151+0000 7f10cd400640 1 --2- 172.21.15.71:0/2328525578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c8156c20 0x7f10c806b900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f10b80097a0 tx=0x7f10b802b8b0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.152+0000 7f10cd400640 1 -- 172.21.15.71:0/2328525578 shutdown_connections 2024-04-20T21:20:04.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.152+0000 7f10cd400640 1 --2- 172.21.15.71:0/2328525578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10c80d0360 0x7f10c80d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.152+0000 7f10cd400640 1 --2- 172.21.15.71:0/2328525578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c8156c20 0x7f10c806b900 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.152+0000 7f10cd400640 1 -- 172.21.15.71:0/2328525578 >> 172.21.15.71:0/2328525578 conn(0x7f10c80b3350 msgr2=0x7f10c80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:04.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.152+0000 7f10cd400640 1 -- 172.21.15.71:0/2328525578 shutdown_connections 2024-04-20T21:20:04.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.152+0000 7f10cd400640 1 -- 172.21.15.71:0/2328525578 wait complete. 2024-04-20T21:20:04.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.153+0000 7f10cd400640 1 Processor -- start 2024-04-20T21:20:04.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.154+0000 7f10cd400640 1 -- start start 2024-04-20T21:20:04.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.154+0000 7f10cd400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10c80d0360 0x7f10c8150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.154+0000 7f10cd400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10c8156c20 0x7f10c8073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10cd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c815ca40 0x7f10c815e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10cd400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f10c806be40 con 0x7f10c815ca40 2024-04-20T21:20:04.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10cd400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10c815d830 con 0x7f10c80d0360 2024-04-20T21:20:04.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10cd400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f10c806bfc0 con 0x7f10c8156c20 2024-04-20T21:20:04.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10c7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c815ca40 0x7f10c815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:04.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10c7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c815ca40 0x7f10c815e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42262/0 (socket says 172.21.15.71:42262) 2024-04-20T21:20:04.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10c7200640 1 -- 172.21.15.71:0/792636399 learned_addr learned my addr 172.21.15.71:0/792636399 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:04.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10c6800640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10c80d0360 0x7f10c8150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:04.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10c5e00640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10c8156c20 0x7f10c8073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:04.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10c7200640 1 -- 172.21.15.71:0/792636399 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10c8156c20 msgr2=0x7f10c8073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10c7200640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10c8156c20 0x7f10c8073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10c7200640 1 -- 172.21.15.71:0/792636399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10c80d0360 msgr2=0x7f10c8150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10c7200640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10c80d0360 0x7f10c8150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.155+0000 7f10c7200640 1 -- 172.21.15.71:0/792636399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c8151000 con 0x7f10c815ca40 2024-04-20T21:20:04.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.156+0000 7f10c7200640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c815ca40 0x7f10c815e450 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f10c0007dc0 tx=0x7f10c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:04.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.156+0000 7f10bea00640 1 -- 172.21.15.71:0/792636399 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0014420 con 0x7f10c815ca40 2024-04-20T21:20:04.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.156+0000 7f10bea00640 1 -- 172.21.15.71:0/792636399 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c0019070 con 0x7f10c815ca40 2024-04-20T21:20:04.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.156+0000 7f10cd400640 1 -- 172.21.15.71:0/792636399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c81512e0 con 0x7f10c815ca40 2024-04-20T21:20:04.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.156+0000 7f10bea00640 1 -- 172.21.15.71:0/792636399 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0014820 con 0x7f10c815ca40 2024-04-20T21:20:04.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.156+0000 7f10cd400640 1 -- 172.21.15.71:0/792636399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c81518a0 con 0x7f10c815ca40 2024-04-20T21:20:04.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.157+0000 7f10cd400640 1 -- 172.21.15.71:0/792636399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c8068980 con 0x7f10c815ca40 2024-04-20T21:20:04.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.158+0000 7f10bea00640 1 -- 172.21.15.71:0/792636399 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10c00149c0 con 0x7f10c815ca40 2024-04-20T21:20:04.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.159+0000 7f10bea00640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f10a806c8f0 0x7f10a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.159+0000 7f10bea00640 1 -- 172.21.15.71:0/792636399 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f10c008c690 con 0x7f10c815ca40 2024-04-20T21:20:04.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.159+0000 7f10c6800640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f10a806c8f0 0x7f10a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:04.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.160+0000 7f10c6800640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f10a806c8f0 0x7f10a806edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f10b8036000 tx=0x7f10b8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:04.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.164+0000 7f10bea00640 1 -- 172.21.15.71:0/792636399 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f10c005a780 con 0x7f10c815ca40 2024-04-20T21:20:04.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.347+0000 7f10cd400640 1 -- 172.21.15.71:0/792636399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f10c806d5d0 con 0x7f10c815ca40 2024-04-20T21:20:04.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.348+0000 7f10bea00640 1 -- 172.21.15.71:0/792636399 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f10c005a080 con 0x7f10c815ca40 2024-04-20T21:20:04.348 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:04.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.350+0000 7f10cd400640 1 -- 172.21.15.71:0/792636399 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f10a806c8f0 msgr2=0x7f10a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.350+0000 7f10cd400640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f10a806c8f0 0x7f10a806edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f10b8036000 tx=0x7f10b8008030 comp rx=0 tx=0).stop 2024-04-20T21:20:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.350+0000 7f10cd400640 1 -- 172.21.15.71:0/792636399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c815ca40 msgr2=0x7f10c815e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.350+0000 7f10cd400640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c815ca40 0x7f10c815e450 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f10c0007dc0 tx=0x7f10c000e4b0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.351+0000 7f10cd400640 1 -- 172.21.15.71:0/792636399 shutdown_connections 2024-04-20T21:20:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.351+0000 7f10cd400640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f10a806c8f0 0x7f10a806edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.351+0000 7f10cd400640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c815ca40 0x7f10c815e450 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.351+0000 7f10cd400640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10c8156c20 0x7f10c8073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.351+0000 7f10cd400640 1 --2- 172.21.15.71:0/792636399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10c80d0360 0x7f10c8150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.351+0000 7f10cd400640 1 -- 172.21.15.71:0/792636399 >> 172.21.15.71:0/792636399 conn(0x7f10c80b3350 msgr2=0x7f10c81543f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.351+0000 7f10cd400640 1 -- 172.21.15.71:0/792636399 shutdown_connections 2024-04-20T21:20:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.351+0000 7f10cd400640 1 -- 172.21.15.71:0/792636399 wait complete. 2024-04-20T21:20:04.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:20:04.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.550+0000 7f5172400640 1 Processor -- start 2024-04-20T21:20:04.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.550+0000 7f5172400640 1 -- start start 2024-04-20T21:20:04.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.552+0000 7f5172400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f516c06cde0 0x7f516c0d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.552+0000 7f5172400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516c0b3330 0x7f516c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.552+0000 7f5172400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516c06c190 con 0x7f516c161d50 2024-04-20T21:20:04.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.552+0000 7f5172400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f516c162130 con 0x7f516c06cde0 2024-04-20T21:20:04.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.552+0000 7f5172400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f516c06c470 con 0x7f516c0b3330 2024-04-20T21:20:04.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.552+0000 7f5171000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f516c161d50 0x7f516c06c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53660/0 (socket says 172.21.15.71:53660) 2024-04-20T21:20:04.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.552+0000 7f5171000640 1 -- 172.21.15.71:0/487597169 learned_addr learned my addr 172.21.15.71:0/487597169 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:04.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.552+0000 7f516be00640 1 --2- 172.21.15.71:0/487597169 >> v2:172.21.15.71:3300/0 conn(0x7f516c06cde0 0x7f516c0d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:04.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.553+0000 7f5171a00640 1 --2- 172.21.15.71:0/487597169 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516c0b3330 0x7f516c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:04.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.553+0000 7f516b400640 1 -- 172.21.15.71:0/487597169 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403240778 0 0) 0x7f516c06c190 con 0x7f516c161d50 2024-04-20T21:20:04.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.553+0000 7f516b400640 1 -- 172.21.15.71:0/487597169 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5150003520 con 0x7f516c161d50 2024-04-20T21:20:04.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.553+0000 7f516be00640 1 -- 172.21.15.71:0/487597169 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516c0b3330 msgr2=0x7f516c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:04.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.553+0000 7f516be00640 1 --2- 172.21.15.71:0/487597169 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516c0b3330 0x7f516c0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.553+0000 7f516be00640 1 -- 172.21.15.71:0/487597169 >> v1:172.21.15.71:6789/0 conn(0x7f516c161d50 legacy=0x7f516c06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.553+0000 7f516be00640 1 -- 172.21.15.71:0/487597169 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c0d2e00 con 0x7f516c06cde0 2024-04-20T21:20:04.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.553+0000 7f5171a00640 1 --2- 172.21.15.71:0/487597169 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516c0b3330 0x7f516c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.554+0000 7f516be00640 1 --2- 172.21.15.71:0/487597169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516c06cde0 0x7f516c0d38e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f515c009d90 tx=0x7f515c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be46cc7b3b28a8c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.554+0000 7f516b400640 1 -- 172.21.15.71:0/487597169 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c039070 con 0x7f516c06cde0 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.554+0000 7f516b400640 1 -- 172.21.15.71:0/487597169 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f515c02cc50 con 0x7f516c06cde0 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.554+0000 7f516b400640 1 -- 172.21.15.71:0/487597169 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c034440 con 0x7f516c06cde0 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.555+0000 7f5172400640 1 -- 172.21.15.71:0/487597169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516c06cde0 msgr2=0x7f516c0d38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.555+0000 7f5172400640 1 --2- 172.21.15.71:0/487597169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516c06cde0 0x7f516c0d38e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f515c009d90 tx=0x7f515c02bea0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.555+0000 7f5172400640 1 -- 172.21.15.71:0/487597169 shutdown_connections 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.555+0000 7f5172400640 1 --2- 172.21.15.71:0/487597169 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516c0b3330 0x7f516c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.555+0000 7f5172400640 1 --2- 172.21.15.71:0/487597169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516c06cde0 0x7f516c0d38e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.555+0000 7f5172400640 1 -- 172.21.15.71:0/487597169 >> 172.21.15.71:0/487597169 conn(0x7f516c0d4450 msgr2=0x7f516c0d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.555+0000 7f5172400640 1 -- 172.21.15.71:0/487597169 shutdown_connections 2024-04-20T21:20:04.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.555+0000 7f5172400640 1 -- 172.21.15.71:0/487597169 wait complete. 2024-04-20T21:20:04.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.557+0000 7f5172400640 1 Processor -- start 2024-04-20T21:20:04.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.557+0000 7f5172400640 1 -- start start 2024-04-20T21:20:04.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5172400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516c06cde0 0x7f516c14f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5172400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f516c0b3330 0x7f516c0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5172400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516c161d50 0x7f516c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5172400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f516c0b7660 con 0x7f516c06cde0 2024-04-20T21:20:04.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5172400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f516c0d33c0 con 0x7f516c0b3330 2024-04-20T21:20:04.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5172400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f516c0b77e0 con 0x7f516c161d50 2024-04-20T21:20:04.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5171000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516c06cde0 0x7f516c14f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:04.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5171000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516c06cde0 0x7f516c14f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42288/0 (socket says 172.21.15.71:42288) 2024-04-20T21:20:04.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5171000640 1 -- 172.21.15.71:0/1014515136 learned_addr learned my addr 172.21.15.71:0/1014515136 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5171a00640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516c161d50 0x7f516c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5171000640 1 -- 172.21.15.71:0/1014515136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516c161d50 msgr2=0x7f516c0b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5171000640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516c161d50 0x7f516c0b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5171000640 1 -- 172.21.15.71:0/1014515136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f516c0b3330 msgr2=0x7f516c0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5171000640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f516c0b3330 0x7f516c0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.558+0000 7f5171000640 1 -- 172.21.15.71:0/1014515136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c0cb5c0 con 0x7f516c06cde0 2024-04-20T21:20:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.559+0000 7f5171000640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516c06cde0 0x7f516c14f3e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51540010e0 tx=0x7f515400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.559+0000 7f5168c00640 1 -- 172.21.15.71:0/1014515136 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154017070 con 0x7f516c06cde0 2024-04-20T21:20:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.559+0000 7f5168c00640 1 -- 172.21.15.71:0/1014515136 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5154005d00 con 0x7f516c06cde0 2024-04-20T21:20:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.559+0000 7f5168c00640 1 -- 172.21.15.71:0/1014515136 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154007310 con 0x7f516c06cde0 2024-04-20T21:20:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.559+0000 7f5172400640 1 -- 172.21.15.71:0/1014515136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516c0cb8a0 con 0x7f516c06cde0 2024-04-20T21:20:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.559+0000 7f5172400640 1 -- 172.21.15.71:0/1014515136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f516c0cc140 con 0x7f516c06cde0 2024-04-20T21:20:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.560+0000 7f5172400640 1 -- 172.21.15.71:0/1014515136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f516c0cba70 con 0x7f516c06cde0 2024-04-20T21:20:04.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.561+0000 7f5168c00640 1 -- 172.21.15.71:0/1014515136 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f515401a070 con 0x7f516c06cde0 2024-04-20T21:20:04.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.562+0000 7f5168c00640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f514806c8f0 0x7f514806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:04.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.562+0000 7f5168c00640 1 -- 172.21.15.71:0/1014515136 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f515408b2c0 con 0x7f516c06cde0 2024-04-20T21:20:04.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.562+0000 7f516be00640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f514806c8f0 0x7f514806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:04.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.563+0000 7f516be00640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f514806c8f0 0x7f514806edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f515c036000 tx=0x7f515c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:04.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.566+0000 7f5168c00640 1 -- 172.21.15.71:0/1014515136 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f51540593a0 con 0x7f516c06cde0 2024-04-20T21:20:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.788+0000 7f5172400640 1 -- 172.21.15.71:0/1014515136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f516c15ed70 con 0x7f516c06cde0 2024-04-20T21:20:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.789+0000 7f5168c00640 1 -- 172.21.15.71:0/1014515136 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5201 (secure 0 0 0) 0x7f5154058ca0 con 0x7f516c06cde0 2024-04-20T21:20:04.789 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:04.789 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3502151495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3502151495},{"type":"v1","addr":"172.21.15.137:6833","nonce":3502151495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2603023903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2603023903},{"type":"v1","addr":"172.21.15.137:6835","nonce":2603023903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3246613850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3246613850},{"type":"v1","addr":"172.21.15.71:6835","nonce":3246613850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:19:28.763862+0000","modified":"2024-04-20T21:19:51.195122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/4085222328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":4085222328},{"type":"v1","addr":"172.21.15.71:6837","nonce":4085222328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-20T21:20:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2024-04-20T21:20:04.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.791+0000 7f5172400640 1 -- 172.21.15.71:0/1014515136 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f514806c8f0 msgr2=0x7f514806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.791+0000 7f5172400640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f514806c8f0 0x7f514806edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f515c036000 tx=0x7f515c02e000 comp rx=0 tx=0).stop 2024-04-20T21:20:04.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.791+0000 7f5172400640 1 -- 172.21.15.71:0/1014515136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516c06cde0 msgr2=0x7f516c14f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:04.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.791+0000 7f5172400640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516c06cde0 0x7f516c14f3e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51540010e0 tx=0x7f515400c890 comp rx=0 tx=0).stop 2024-04-20T21:20:04.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.792+0000 7f5172400640 1 -- 172.21.15.71:0/1014515136 shutdown_connections 2024-04-20T21:20:04.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.792+0000 7f5172400640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f514806c8f0 0x7f514806edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.792+0000 7f5172400640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516c161d50 0x7f516c0b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.792+0000 7f5172400640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f516c0b3330 0x7f516c0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.792+0000 7f5172400640 1 --2- 172.21.15.71:0/1014515136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f516c06cde0 0x7f516c14f3e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:04.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.792+0000 7f5172400640 1 -- 172.21.15.71:0/1014515136 >> 172.21.15.71:0/1014515136 conn(0x7f516c0d4450 msgr2=0x7f516c0b9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:04.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.792+0000 7f5172400640 1 -- 172.21.15.71:0/1014515136 shutdown_connections 2024-04-20T21:20:04.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:04.792+0000 7f5172400640 1 -- 172.21.15.71:0/1014515136 wait complete. 2024-04-20T21:20:04.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:05.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.002+0000 7f7a1b400640 1 Processor -- start 2024-04-20T21:20:05.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.002+0000 7f7a1b400640 1 -- start start 2024-04-20T21:20:05.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.004+0000 7f7a1b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7a14156c20 0x7f7a1406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.004+0000 7f7a1b400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7a1415ca40 0x7f7a140ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.004+0000 7f7a1b400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a14141c60 con 0x7f7a140ad8e0 2024-04-20T21:20:05.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.004+0000 7f7a1b400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7a1415cf90 con 0x7f7a1415ca40 2024-04-20T21:20:05.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.004+0000 7f7a1b400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7a1415d270 con 0x7f7a14156c20 2024-04-20T21:20:05.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.004+0000 7f7a13e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7a1415ca40 0x7f7a140ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.004+0000 7f7a13e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7a1415ca40 0x7f7a140ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42300/0 (socket says 172.21.15.71:42300) 2024-04-20T21:20:05.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.004+0000 7f7a13e00640 1 -- 172.21.15.71:0/3977889159 learned_addr learned my addr 172.21.15.71:0/3977889159 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:05.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.004+0000 7f7a18a00640 1 --2- 172.21.15.71:0/3977889159 >> v2:172.21.15.137:3300/0 conn(0x7f7a14156c20 0x7f7a1406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.005+0000 7f7a13e00640 1 -- 172.21.15.71:0/3977889159 >> v2:172.21.15.137:3300/0 conn(0x7f7a14156c20 msgr2=0x7f7a1406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:05.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.005+0000 7f7a13e00640 1 --2- 172.21.15.71:0/3977889159 >> v2:172.21.15.137:3300/0 conn(0x7f7a14156c20 0x7f7a1406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.005+0000 7f7a13e00640 1 -- 172.21.15.71:0/3977889159 >> v1:172.21.15.71:6789/0 conn(0x7f7a140ad8e0 legacy=0x7f7a140d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:05.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.005+0000 7f7a13e00640 1 -- 172.21.15.71:0/3977889159 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1415d550 con 0x7f7a1415ca40 2024-04-20T21:20:05.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.006+0000 7f7a13e00640 1 --2- 172.21.15.71:0/3977889159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a1415ca40 0x7f7a140ad3a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7a1406fdc0 tx=0x7f7a0002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3df5e81cc024f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:05.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.006+0000 7f7a13400640 1 -- 172.21.15.71:0/3977889159 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00034070 con 0x7f7a1415ca40 2024-04-20T21:20:05.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.006+0000 7f7a13400640 1 -- 172.21.15.71:0/3977889159 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a00030860 con 0x7f7a1415ca40 2024-04-20T21:20:05.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.006+0000 7f7a13400640 1 -- 172.21.15.71:0/3977889159 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00030c30 con 0x7f7a1415ca40 2024-04-20T21:20:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.007+0000 7f7a1b400640 1 -- 172.21.15.71:0/3977889159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a1415ca40 msgr2=0x7f7a140ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.007+0000 7f7a1b400640 1 --2- 172.21.15.71:0/3977889159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a1415ca40 0x7f7a140ad3a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7a1406fdc0 tx=0x7f7a0002b9a0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.007+0000 7f7a1b400640 1 -- 172.21.15.71:0/3977889159 shutdown_connections 2024-04-20T21:20:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.007+0000 7f7a1b400640 1 --2- 172.21.15.71:0/3977889159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a1415ca40 0x7f7a140ad3a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.007+0000 7f7a1b400640 1 --2- 172.21.15.71:0/3977889159 >> v2:172.21.15.137:3300/0 conn(0x7f7a14156c20 0x7f7a1406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.007+0000 7f7a1b400640 1 -- 172.21.15.71:0/3977889159 >> 172.21.15.71:0/3977889159 conn(0x7f7a140b3350 msgr2=0x7f7a140b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.007+0000 7f7a1b400640 1 -- 172.21.15.71:0/3977889159 shutdown_connections 2024-04-20T21:20:05.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.007+0000 7f7a1b400640 1 -- 172.21.15.71:0/3977889159 wait complete. 2024-04-20T21:20:05.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.009+0000 7f7a1b400640 1 Processor -- start 2024-04-20T21:20:05.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.009+0000 7f7a1b400640 1 -- start start 2024-04-20T21:20:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a1b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a140ad8e0 0x7f7a140ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a1b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a14156c20 0x7f7a14099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a1b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a1415ca40 0x7f7a1406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a1b400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1406bfc0 con 0x7f7a14156c20 2024-04-20T21:20:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a1b400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1406be40 con 0x7f7a140ad8e0 2024-04-20T21:20:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a1b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7a140d0a70 con 0x7f7a1415ca40 2024-04-20T21:20:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a13e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a14156c20 0x7f7a14099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a13e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a14156c20 0x7f7a14099810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42304/0 (socket says 172.21.15.71:42304) 2024-04-20T21:20:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a13e00640 1 -- 172.21.15.71:0/758249643 learned_addr learned my addr 172.21.15.71:0/758249643 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a18a00640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a140ad8e0 0x7f7a140ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a13e00640 1 -- 172.21.15.71:0/758249643 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a1415ca40 msgr2=0x7f7a1406f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a19400640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a1415ca40 0x7f7a1406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.010+0000 7f7a13e00640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a1415ca40 0x7f7a1406f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.011+0000 7f7a13e00640 1 -- 172.21.15.71:0/758249643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a140ad8e0 msgr2=0x7f7a140ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.011+0000 7f7a13e00640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a140ad8e0 0x7f7a140ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.011+0000 7f7a13e00640 1 -- 172.21.15.71:0/758249643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1406e320 con 0x7f7a14156c20 2024-04-20T21:20:05.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.011+0000 7f7a13e00640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a14156c20 0x7f7a14099810 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7a0002b9e0 tx=0x7f7a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:05.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.011+0000 7f7a10c00640 1 -- 172.21.15.71:0/758249643 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00034040 con 0x7f7a14156c20 2024-04-20T21:20:05.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.011+0000 7f7a10c00640 1 -- 172.21.15.71:0/758249643 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a0003ad20 con 0x7f7a14156c20 2024-04-20T21:20:05.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.011+0000 7f7a1b400640 1 -- 172.21.15.71:0/758249643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1406e5c0 con 0x7f7a14156c20 2024-04-20T21:20:05.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.011+0000 7f7a10c00640 1 -- 172.21.15.71:0/758249643 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00044610 con 0x7f7a14156c20 2024-04-20T21:20:05.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.011+0000 7f7a1b400640 1 -- 172.21.15.71:0/758249643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1406eb80 con 0x7f7a14156c20 2024-04-20T21:20:05.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.013+0000 7f7a1b400640 1 -- 172.21.15.71:0/758249643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a14074000 con 0x7f7a14156c20 2024-04-20T21:20:05.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.013+0000 7f7a10c00640 1 -- 172.21.15.71:0/758249643 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a0004b060 con 0x7f7a14156c20 2024-04-20T21:20:05.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.014+0000 7f7a10c00640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f79f406c8f0 0x7f79f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.014+0000 7f7a10c00640 1 -- 172.21.15.71:0/758249643 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7a000adf90 con 0x7f7a14156c20 2024-04-20T21:20:05.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.015+0000 7f7a18a00640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f79f406c8f0 0x7f79f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.015+0000 7f7a18a00640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f79f406c8f0 0x7f79f406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a08006fd0 tx=0x7f7a08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:05.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.019+0000 7f7a10c00640 1 -- 172.21.15.71:0/758249643 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7a14074000 con 0x7f7a14156c20 2024-04-20T21:20:05.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.223+0000 7f7a1b400640 1 -- 172.21.15.71:0/758249643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a140cfd90 con 0x7f7a14156c20 2024-04-20T21:20:05.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.226+0000 7f7a10c00640 1 -- 172.21.15.71:0/758249643 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f7a0003f070 con 0x7f7a14156c20 2024-04-20T21:20:05.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:05.226 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:19:35.616498+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:05.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.229+0000 7f7a1b400640 1 -- 172.21.15.71:0/758249643 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f79f406c8f0 msgr2=0x7f79f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:05.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.229+0000 7f7a1b400640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f79f406c8f0 0x7f79f406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a08006fd0 tx=0x7f7a08008040 comp rx=0 tx=0).stop 2024-04-20T21:20:05.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.229+0000 7f7a1b400640 1 -- 172.21.15.71:0/758249643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a14156c20 msgr2=0x7f7a14099810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:05.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.229+0000 7f7a1b400640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a14156c20 0x7f7a14099810 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7a0002b9e0 tx=0x7f7a000046c0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.229+0000 7f7a1b400640 1 -- 172.21.15.71:0/758249643 shutdown_connections 2024-04-20T21:20:05.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.229+0000 7f7a1b400640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f79f406c8f0 0x7f79f406edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.229+0000 7f7a1b400640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a1415ca40 0x7f7a1406f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.229+0000 7f7a1b400640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a14156c20 0x7f7a14099810 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.229+0000 7f7a1b400640 1 --2- 172.21.15.71:0/758249643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a140ad8e0 0x7f7a140ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.229+0000 7f7a1b400640 1 -- 172.21.15.71:0/758249643 >> 172.21.15.71:0/758249643 conn(0x7f7a140b3350 msgr2=0x7f7a14154de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:05.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.229+0000 7f7a1b400640 1 -- 172.21.15.71:0/758249643 shutdown_connections 2024-04-20T21:20:05.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.230+0000 7f7a1b400640 1 -- 172.21.15.71:0/758249643 wait complete. 2024-04-20T21:20:05.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:20:05.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.439+0000 7f0135400640 1 Processor -- start 2024-04-20T21:20:05.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.439+0000 7f0135400640 1 -- start start 2024-04-20T21:20:05.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.441+0000 7f0135400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0130161d50 0x7f01300d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.441+0000 7f0135400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01300b3330 0x7f01300b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.441+0000 7f0135400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f013006c6d0 0x7f013006cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.441+0000 7f0135400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f0130162130 con 0x7f01300b3330 2024-04-20T21:20:05.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.441+0000 7f0135400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f013006c190 con 0x7f013006c6d0 2024-04-20T21:20:05.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.441+0000 7f0135400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f013006c470 con 0x7f0130161d50 2024-04-20T21:20:05.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.441+0000 7f012f400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01300b3330 0x7f01300b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.441+0000 7f012f400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01300b3330 0x7f01300b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42318/0 (socket says 172.21.15.71:42318) 2024-04-20T21:20:05.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.441+0000 7f012f400640 1 -- 172.21.15.71:0/1993065666 learned_addr learned my addr 172.21.15.71:0/1993065666 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:05.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.442+0000 7f012fe00640 1 --2- 172.21.15.71:0/1993065666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0130161d50 0x7f01300d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.442+0000 7f0134a00640 1 --2- 172.21.15.71:0/1993065666 >> v2:172.21.15.137:3300/0 conn(0x7f013006c6d0 0x7f013006cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.442+0000 7f012f400640 1 -- 172.21.15.71:0/1993065666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0130161d50 msgr2=0x7f01300d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:05.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.442+0000 7f012f400640 1 --2- 172.21.15.71:0/1993065666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0130161d50 0x7f01300d38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.442+0000 7f012f400640 1 -- 172.21.15.71:0/1993065666 >> v2:172.21.15.137:3300/0 conn(0x7f013006c6d0 msgr2=0x7f013006cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:05.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.442+0000 7f012f400640 1 --2- 172.21.15.71:0/1993065666 >> v2:172.21.15.137:3300/0 conn(0x7f013006c6d0 0x7f013006cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.442+0000 7f012f400640 1 -- 172.21.15.71:0/1993065666 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01300d2e00 con 0x7f01300b3330 2024-04-20T21:20:05.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.442+0000 7f012fe00640 1 --2- 172.21.15.71:0/1993065666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0130161d50 0x7f01300d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:05.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.442+0000 7f0134a00640 1 --2- 172.21.15.71:0/1993065666 >> v2:172.21.15.137:3300/0 conn(0x7f013006c6d0 0x7f013006cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:05.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.443+0000 7f012f400640 1 --2- 172.21.15.71:0/1993065666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01300b3330 0x7f01300b3880 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f01300b32e0 tx=0x7f011c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee56a20b3a3ba4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:05.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.443+0000 7f012ea00640 1 -- 172.21.15.71:0/1993065666 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c035020 con 0x7f01300b3330 2024-04-20T21:20:05.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.443+0000 7f012ea00640 1 -- 172.21.15.71:0/1993065666 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011c031870 con 0x7f01300b3330 2024-04-20T21:20:05.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.443+0000 7f012ea00640 1 -- 172.21.15.71:0/1993065666 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c031c40 con 0x7f01300b3330 2024-04-20T21:20:05.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.444+0000 7f0135400640 1 -- 172.21.15.71:0/1993065666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01300b3330 msgr2=0x7f01300b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:05.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.444+0000 7f0135400640 1 --2- 172.21.15.71:0/1993065666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01300b3330 0x7f01300b3880 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f01300b32e0 tx=0x7f011c02b910 comp rx=0 tx=0).stop 2024-04-20T21:20:05.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.444+0000 7f0135400640 1 -- 172.21.15.71:0/1993065666 shutdown_connections 2024-04-20T21:20:05.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.444+0000 7f0135400640 1 --2- 172.21.15.71:0/1993065666 >> v2:172.21.15.137:3300/0 conn(0x7f013006c6d0 0x7f013006cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.444+0000 7f0135400640 1 --2- 172.21.15.71:0/1993065666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01300b3330 0x7f01300b3880 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.444+0000 7f0135400640 1 --2- 172.21.15.71:0/1993065666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0130161d50 0x7f01300d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.444+0000 7f0135400640 1 -- 172.21.15.71:0/1993065666 >> 172.21.15.71:0/1993065666 conn(0x7f01300d4450 msgr2=0x7f01300d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:05.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.444+0000 7f0135400640 1 -- 172.21.15.71:0/1993065666 shutdown_connections 2024-04-20T21:20:05.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.444+0000 7f0135400640 1 -- 172.21.15.71:0/1993065666 wait complete. 2024-04-20T21:20:05.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.446+0000 7f0135400640 1 Processor -- start 2024-04-20T21:20:05.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.446+0000 7f0135400640 1 -- start start 2024-04-20T21:20:05.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.447+0000 7f0135400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f013006c6d0 0x7f013014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.447+0000 7f0135400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01300b3330 0x7f01300cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.447+0000 7f0135400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0130161d50 0x7f01300cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.447+0000 7f0135400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f01300cfa00 con 0x7f0130161d50 2024-04-20T21:20:05.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.447+0000 7f0135400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f01300d33c0 con 0x7f01300b3330 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.447+0000 7f0135400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f01300cfb80 con 0x7f013006c6d0 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.447+0000 7f0134a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0130161d50 0x7f01300cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.447+0000 7f0134a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0130161d50 0x7f01300cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42326/0 (socket says 172.21.15.71:42326) 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.447+0000 7f0134a00640 1 -- 172.21.15.71:0/3059200464 learned_addr learned my addr 172.21.15.71:0/3059200464 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f012fe00640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f013006c6d0 0x7f013014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f012f400640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01300b3330 0x7f01300cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f0134a00640 1 -- 172.21.15.71:0/3059200464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f013006c6d0 msgr2=0x7f013014c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f0134a00640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f013006c6d0 0x7f013014c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f0134a00640 1 -- 172.21.15.71:0/3059200464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01300b3330 msgr2=0x7f01300cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f0134a00640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01300b3330 0x7f01300cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f0134a00640 1 -- 172.21.15.71:0/3059200464 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013014cdb0 con 0x7f0130161d50 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f012fe00640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f013006c6d0 0x7f013014c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:05.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f0134a00640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0130161d50 0x7f01300cdb90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f012800cf20 tx=0x7f012800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:05.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f0127e00640 1 -- 172.21.15.71:0/3059200464 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012801a070 con 0x7f0130161d50 2024-04-20T21:20:05.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f0127e00640 1 -- 172.21.15.71:0/3059200464 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012800d840 con 0x7f0130161d50 2024-04-20T21:20:05.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f0135400640 1 -- 172.21.15.71:0/3059200464 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013015a540 con 0x7f0130161d50 2024-04-20T21:20:05.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f0127e00640 1 -- 172.21.15.71:0/3059200464 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012800dc30 con 0x7f0130161d50 2024-04-20T21:20:05.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.448+0000 7f0135400640 1 -- 172.21.15.71:0/3059200464 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013014d480 con 0x7f0130161d50 2024-04-20T21:20:05.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.450+0000 7f0135400640 1 -- 172.21.15.71:0/3059200464 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0130075b60 con 0x7f0130161d50 2024-04-20T21:20:05.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.450+0000 7f0127e00640 1 -- 172.21.15.71:0/3059200464 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f012801d070 con 0x7f0130161d50 2024-04-20T21:20:05.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.451+0000 7f0127e00640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f011006c8f0 0x7f011006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:05.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.451+0000 7f0127e00640 1 -- 172.21.15.71:0/3059200464 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f012808c6e0 con 0x7f0130161d50 2024-04-20T21:20:05.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.452+0000 7f012fe00640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f011006c8f0 0x7f011006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:05.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.452+0000 7f012fe00640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f011006c8f0 0x7f011006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0120006fd0 tx=0x7f0120008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.455+0000 7f0127e00640 1 -- 172.21.15.71:0/3059200464 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f013014cdb0 con 0x7f0130161d50 2024-04-20T21:20:05.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.697+0000 7f0135400640 1 -- 172.21.15.71:0/3059200464 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0130074dd0 con 0x7f0130161d50 2024-04-20T21:20:05.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.698+0000 7f0127e00640 1 -- 172.21.15.71:0/3059200464 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5201 (secure 0 0 0) 0x7f012805a7c0 con 0x7f0130161d50 2024-04-20T21:20:05.698 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:05.698 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3502151495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3502151495},{"type":"v1","addr":"172.21.15.137:6833","nonce":3502151495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2603023903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2603023903},{"type":"v1","addr":"172.21.15.137:6835","nonce":2603023903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3246613850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3246613850},{"type":"v1","addr":"172.21.15.71:6835","nonce":3246613850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:19:28.763862+0000","modified":"2024-04-20T21:19:51.195122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/4085222328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":4085222328},{"type":"v1","addr":"172.21.15.71:6837","nonce":4085222328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-20T21:20:05.698 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 -- 172.21.15.71:0/3059200464 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f011006c8f0 msgr2=0x7f011006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f011006c8f0 0x7f011006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0120006fd0 tx=0x7f0120008040 comp rx=0 tx=0).stop 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 -- 172.21.15.71:0/3059200464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0130161d50 msgr2=0x7f01300cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0130161d50 0x7f01300cdb90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f012800cf20 tx=0x7f012800a710 comp rx=0 tx=0).stop 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 -- 172.21.15.71:0/3059200464 shutdown_connections 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f011006c8f0 0x7f011006edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0130161d50 0x7f01300cdb90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01300b3330 0x7f01300cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 --2- 172.21.15.71:0/3059200464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f013006c6d0 0x7f013014c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 -- 172.21.15.71:0/3059200464 >> 172.21.15.71:0/3059200464 conn(0x7f01300d4450 msgr2=0x7f01300d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 -- 172.21.15.71:0/3059200464 shutdown_connections 2024-04-20T21:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:05.701+0000 7f0135400640 1 -- 172.21.15.71:0/3059200464 wait complete. 2024-04-20T21:20:06.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-20T21:19:28.763862+0000', 'modified': '2024-04-20T21:19:51.195122+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6837/4085222328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 4085222328}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 4085222328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4254, 'qdb_cluster': [4254]} 2024-04-20T21:20:06.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-20T21:20:06.121 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-20T21:20:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.328+0000 7f8dbba00640 1 Processor -- start 2024-04-20T21:20:06.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.329+0000 7f8dbba00640 1 -- start start 2024-04-20T21:20:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.330+0000 7f8dbba00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8db415ca40 0x7f8db40ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.330+0000 7f8dbba00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db4141c60 con 0x7f8db4156c20 2024-04-20T21:20:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.330+0000 7f8dbba00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db415cf90 con 0x7f8db40ad8e0 2024-04-20T21:20:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.330+0000 7f8dbba00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8db406c010 con 0x7f8db415ca40 2024-04-20T21:20:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.330+0000 7f8db9000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8db4156c20 0x7f8db406b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53678/0 (socket says 172.21.15.71:53678) 2024-04-20T21:20:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.330+0000 7f8db9000640 1 -- 172.21.15.71:0/2111715647 learned_addr learned my addr 172.21.15.71:0/2111715647 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.330+0000 7f8db3e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8db415ca40 0x7f8db40ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.331+0000 7f8db3e00640 1 -- 172.21.15.71:0/2111715647 >> v1:172.21.15.137:6789/0 conn(0x7f8db40ad8e0 legacy=0x7f8db40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.331+0000 7f8db3e00640 1 -- 172.21.15.71:0/2111715647 >> v1:172.21.15.71:6789/0 conn(0x7f8db4156c20 legacy=0x7f8db406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.331+0000 7f8db3400640 1 -- 172.21.15.71:0/2111715647 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1077783759 0 0) 0x7f8db4141c60 con 0x7f8db4156c20 2024-04-20T21:20:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.331+0000 7f8db3e00640 1 -- 172.21.15.71:0/2111715647 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db415d270 con 0x7f8db415ca40 2024-04-20T21:20:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.332+0000 7f8db3e00640 1 --2- 172.21.15.71:0/2111715647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8db415ca40 0x7f8db40ad3a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8db4141e30 tx=0x7f8da402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438b4db5cf09a2d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.332+0000 7f8db3400640 1 -- 172.21.15.71:0/2111715647 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4039070 con 0x7f8db415ca40 2024-04-20T21:20:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.332+0000 7f8db3400640 1 -- 172.21.15.71:0/2111715647 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da402cce0 con 0x7f8db415ca40 2024-04-20T21:20:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.333+0000 7f8db3400640 1 -- 172.21.15.71:0/2111715647 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4034660 con 0x7f8db415ca40 2024-04-20T21:20:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.333+0000 7f8dbba00640 1 -- 172.21.15.71:0/2111715647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8db415ca40 msgr2=0x7f8db40ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.333+0000 7f8dbba00640 1 --2- 172.21.15.71:0/2111715647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8db415ca40 0x7f8db40ad3a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8db4141e30 tx=0x7f8da402bf30 comp rx=0 tx=0).stop 2024-04-20T21:20:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.333+0000 7f8dbba00640 1 -- 172.21.15.71:0/2111715647 shutdown_connections 2024-04-20T21:20:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.333+0000 7f8dbba00640 1 --2- 172.21.15.71:0/2111715647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8db415ca40 0x7f8db40ad3a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.333+0000 7f8dbba00640 1 -- 172.21.15.71:0/2111715647 >> 172.21.15.71:0/2111715647 conn(0x7f8db40b3350 msgr2=0x7f8db40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.334+0000 7f8dbba00640 1 -- 172.21.15.71:0/2111715647 shutdown_connections 2024-04-20T21:20:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.334+0000 7f8dbba00640 1 -- 172.21.15.71:0/2111715647 wait complete. 2024-04-20T21:20:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.335+0000 7f8dbba00640 1 Processor -- start 2024-04-20T21:20:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.335+0000 7f8dbba00640 1 -- start start 2024-04-20T21:20:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.336+0000 7f8dbba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8db40ad8e0 0x7f8db414f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.336+0000 7f8dbba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8db4156c20 0x7f8db409dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.336+0000 7f8dbba00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8db415ca40 0x7f8db40996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.336+0000 7f8dbba00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8db40d0a70 con 0x7f8db415ca40 2024-04-20T21:20:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.336+0000 7f8dbba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8db415d830 con 0x7f8db4156c20 2024-04-20T21:20:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.336+0000 7f8dbba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8db40d0bf0 con 0x7f8db40ad8e0 2024-04-20T21:20:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.337+0000 7f8db9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8db415ca40 0x7f8db40996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.337+0000 7f8db9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8db415ca40 0x7f8db40996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42346/0 (socket says 172.21.15.71:42346) 2024-04-20T21:20:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.337+0000 7f8db9a00640 1 -- 172.21.15.71:0/2796230127 learned_addr learned my addr 172.21.15.71:0/2796230127 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.337+0000 7f8db3e00640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8db4156c20 0x7f8db409dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.337+0000 7f8db9000640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8db40ad8e0 0x7f8db414f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.337+0000 7f8db9a00640 1 -- 172.21.15.71:0/2796230127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8db40ad8e0 msgr2=0x7f8db414f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.337+0000 7f8db9a00640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8db40ad8e0 0x7f8db414f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.337+0000 7f8db9a00640 1 -- 172.21.15.71:0/2796230127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8db4156c20 msgr2=0x7f8db409dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.337+0000 7f8db9a00640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8db4156c20 0x7f8db409dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.337+0000 7f8db9a00640 1 -- 172.21.15.71:0/2796230127 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db414fb30 con 0x7f8db415ca40 2024-04-20T21:20:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.338+0000 7f8db9a00640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8db415ca40 0x7f8db40996a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00c390 tx=0x7f8dac00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.338+0000 7f8db0c00640 1 -- 172.21.15.71:0/2796230127 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac017070 con 0x7f8db415ca40 2024-04-20T21:20:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.338+0000 7f8db0c00640 1 -- 172.21.15.71:0/2796230127 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dac0052d0 con 0x7f8db415ca40 2024-04-20T21:20:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.338+0000 7f8dbba00640 1 -- 172.21.15.71:0/2796230127 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db414fe10 con 0x7f8db415ca40 2024-04-20T21:20:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.338+0000 7f8db0c00640 1 -- 172.21.15.71:0/2796230127 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0037f0 con 0x7f8db415ca40 2024-04-20T21:20:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.338+0000 7f8dbba00640 1 -- 172.21.15.71:0/2796230127 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db41503d0 con 0x7f8db415ca40 2024-04-20T21:20:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.341+0000 7f8db0c00640 1 -- 172.21.15.71:0/2796230127 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8dac01a070 con 0x7f8db415ca40 2024-04-20T21:20:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.342+0000 7f8db0c00640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8d9006c920 0x7f8d9006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.342+0000 7f8db0c00640 1 -- 172.21.15.71:0/2796230127 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8dac08af70 con 0x7f8db415ca40 2024-04-20T21:20:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.342+0000 7f8db9000640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8d9006c920 0x7f8d9006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.342+0000 7f8dbe7ee740 1 Processor -- start 2024-04-20T21:20:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.343+0000 7f8dbe7ee740 1 -- start start 2024-04-20T21:20:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.343+0000 7f8db9000640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8d9006c920 0x7f8d9006ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c000f60 tx=0x7f8d9c007b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:06.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.343+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70bba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.343+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af70ba4e0 0x556af70bbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.343+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af70b6930 0x556af70e6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.343+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556af70229d0 con 0x556af7104460 2024-04-20T21:20:06.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.343+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556af6fc9270 con 0x556af70b6930 2024-04-20T21:20:06.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.343+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x556af701e990 con 0x556af70ba4e0 2024-04-20T21:20:06.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.344+0000 7f8db9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70bba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.344+0000 7f8db9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70bba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42348/0 (socket says 172.21.15.71:42348) 2024-04-20T21:20:06.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.344+0000 7f8db9000640 1 -- 172.21.15.71:0/3160766644 learned_addr learned my addr 172.21.15.71:0/3160766644 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:06.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.344+0000 7f8db3e00640 1 --2- 172.21.15.71:0/3160766644 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af70ba4e0 0x556af70bbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.344+0000 7f8db9000640 1 -- 172.21.15.71:0/3160766644 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af70ba4e0 msgr2=0x556af70bbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:06.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.344+0000 7f8db9000640 1 --2- 172.21.15.71:0/3160766644 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af70ba4e0 0x556af70bbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.344+0000 7f8db9000640 1 -- 172.21.15.71:0/3160766644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af70b6930 msgr2=0x556af70e6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:06.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.344+0000 7f8db9000640 1 --2- 172.21.15.71:0/3160766644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af70b6930 0x556af70e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.344+0000 7f8db9000640 1 -- 172.21.15.71:0/3160766644 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af6d352d0 con 0x556af7104460 2024-04-20T21:20:06.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.344+0000 7f8db3e00640 1 --2- 172.21.15.71:0/3160766644 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af70ba4e0 0x556af70bbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:06.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.344+0000 7f8db9000640 1 --2- 172.21.15.71:0/3160766644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70bba90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005c80 tx=0x7f8d9c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba9444a3ce35f41 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:06.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.345+0000 7f8da9600640 1 -- 172.21.15.71:0/3160766644 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c005cb0 con 0x556af7104460 2024-04-20T21:20:06.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.345+0000 7f8da9600640 1 -- 172.21.15.71:0/3160766644 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9c005e50 con 0x556af7104460 2024-04-20T21:20:06.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.345+0000 7f8da9600640 1 -- 172.21.15.71:0/3160766644 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c015bc0 con 0x556af7104460 2024-04-20T21:20:06.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.345+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/3160766644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 msgr2=0x556af70bba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:06.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.345+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/3160766644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70bba90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005c80 tx=0x7f8d9c012000 comp rx=0 tx=0).stop 2024-04-20T21:20:06.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.345+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/3160766644 shutdown_connections 2024-04-20T21:20:06.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.345+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/3160766644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af70b6930 0x556af70e6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.345+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/3160766644 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af70ba4e0 0x556af70bbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.345+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/3160766644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70bba90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.345+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/3160766644 >> 172.21.15.71:0/3160766644 conn(0x556af70b8bf0 msgr2=0x556af7101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.346+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/3160766644 shutdown_connections 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.346+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/3160766644 wait complete. 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.346+0000 7f8dbe7ee740 1 -- start start 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.347+0000 7f8dbe7ee740 1 Processor -- start 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.347+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af70ba4e0 0x556af7116780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.347+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70dea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.347+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af7112620 0x556af7112a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.347+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556af70ba9f0 con 0x556af7104460 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.347+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556af6fdc5e0 con 0x556af70ba4e0 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.347+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x556af70bacd0 con 0x556af7112620 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8dbe7ee740 10 client.0 _ll_register_callbacks cb 0x556af6d34ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8db3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70dea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8db3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70dea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42356/0 (socket says 172.21.15.71:42356) 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8db3e00640 1 -- 172.21.15.71:0/190812634 learned_addr learned my addr 172.21.15.71:0/190812634 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8db9000640 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af70ba4e0 0x556af7116780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8db9a00640 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af7112620 0x556af7112a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8db3e00640 1 -- 172.21.15.71:0/190812634 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af7112620 msgr2=0x556af7112a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8db3e00640 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af7112620 0x556af7112a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8db3e00640 1 -- 172.21.15.71:0/190812634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af70ba4e0 msgr2=0x556af7116780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8db3e00640 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af70ba4e0 0x556af7116780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8db3e00640 1 -- 172.21.15.71:0/190812634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af6dff6b0 con 0x556af7104460 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.348+0000 7f8db9a00640 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af7112620 0x556af7112a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.349+0000 7f8db3e00640 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70dea70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009e80 tx=0x7f8da4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981a1151ce685f44 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.349+0000 7f8da2000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.349+0000 7f8da2000640 1 -- 172.21.15.71:0/190812634 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4045070 con 0x556af7104460 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.349+0000 7f8da2000640 1 -- 172.21.15.71:0/190812634 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8da4034c00 con 0x556af7104460 2024-04-20T21:20:06.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.349+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/190812634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d9c005e50 con 0x556af7104460 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.349+0000 7f8da2000640 1 -- 172.21.15.71:0/190812634 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f8da404f050 con 0x556af7104460 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.349+0000 7f8dbe7ee740 10 client.4833 fetch_fsmap learned FSMap version 8 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.349+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/190812634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x556af70defb0 con 0x556af7104460 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.349+0000 7f8da2000640 1 -- 172.21.15.71:0/190812634 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9c005e50 con 0x556af7104460 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.350+0000 7f8da2000640 1 -- 172.21.15.71:0/190812634 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 8) ==== 3503+0+0 (secure 0 0 0) 0x7f8da4052020 con 0x556af7104460 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.350+0000 7f8dbe7ee740 10 client.4833 fetch_fsmap finished waiting for FSMap version 8 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.350+0000 7f8dbe7ee740 10 client.4833 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.350+0000 7f8dbe7ee740 20 client.4833 populate_metadata read hostname 'smithi071' 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.350+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x556af70e2140 0x556af70e2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.350+0000 7f8dbe7ee740 4 client.4833 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.350+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/190812634 --> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556af70303f0 con 0x556af70e2140 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.350+0000 7f8db9000640 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x556af70e2140 0x556af70e2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.351+0000 7f8db9000640 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x556af70e2140 0x556af70e2520 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9345eed65b71301d server_cookie=986af13ec85f6119 in_seq=0 out_seq=0 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.351+0000 7f8da2000640 10 client.4833 ms_handle_connect on v2:172.21.15.71:6836/4085222328 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.351+0000 7f8da2000640 1 -- 172.21.15.71:0/190812634 <== mds.0 v2:172.21.15.71:6836/4085222328 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556af70303f0 con 0x556af70e2140 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.351+0000 7f8da2000640 10 client.4833 handle_command_reply: tid=0 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.351+0000 7f8dbe7ee740 1 client.4833 shutdown 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/190812634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 msgr2=0x556af70dea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70dea70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009e80 tx=0x7f8da4004ab0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/190812634 shutdown_connections 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x556af70e2140 0x556af70e2520 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af7112620 0x556af7112a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af70dea70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8da2000640 0 client.4833 ms_handle_reset on v2:172.21.15.71:6836/4085222328 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/190812634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af70ba4e0 0x556af7116780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/190812634 >> 172.21.15.71:0/190812634 conn(0x556af70b6930 msgr2=0x556af7101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:06.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/190812634 shutdown_connections 2024-04-20T21:20:06.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/190812634 wait complete. 2024-04-20T21:20:06.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.352+0000 7f8dbe7ee740 20 client.4833 trim_cache size 0 max 16384 2024-04-20T21:20:06.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.372+0000 7f8dbe7ee740 1 Processor -- start 2024-04-20T21:20:06.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.372+0000 7f8dbe7ee740 1 -- start start 2024-04-20T21:20:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.373+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af70ba4e0 0x556af7102460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.373+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af71260c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.373+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af7112620 0x556af7126600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.373+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8db41ff000 con 0x556af7104460 2024-04-20T21:20:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.373+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8db40ce490 con 0x556af7112620 2024-04-20T21:20:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.373+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8db41fec00 con 0x556af70ba4e0 2024-04-20T21:20:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.373+0000 7f8db3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af71260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.373+0000 7f8db3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af71260c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42370/0 (socket says 172.21.15.71:42370) 2024-04-20T21:20:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.373+0000 7f8db3e00640 1 -- 172.21.15.71:0/1466550802 learned_addr learned my addr 172.21.15.71:0/1466550802 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.374+0000 7f8db3e00640 1 -- 172.21.15.71:0/1466550802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af70ba4e0 msgr2=0x556af7102460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.374+0000 7f8db3e00640 1 --2- 172.21.15.71:0/1466550802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af70ba4e0 0x556af7102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.374+0000 7f8db3e00640 1 -- 172.21.15.71:0/1466550802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af7112620 msgr2=0x556af7126600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.374+0000 7f8db3e00640 1 --2- 172.21.15.71:0/1466550802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af7112620 0x556af7126600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.374+0000 7f8db3e00640 1 -- 172.21.15.71:0/1466550802 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af7106ac0 con 0x556af7104460 2024-04-20T21:20:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.374+0000 7f8db3e00640 1 --2- 172.21.15.71:0/1466550802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af71260c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8da4034ed0 tx=0x7f8da403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6366276801ee871 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.374+0000 7f8da8c00640 1 -- 172.21.15.71:0/1466550802 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4058070 con 0x556af7104460 2024-04-20T21:20:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.374+0000 7f8da8c00640 1 -- 172.21.15.71:0/1466550802 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da4034440 con 0x556af7104460 2024-04-20T21:20:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.374+0000 7f8da8c00640 1 -- 172.21.15.71:0/1466550802 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4045040 con 0x556af7104460 2024-04-20T21:20:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.375+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1466550802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 msgr2=0x556af71260c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.375+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/1466550802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af71260c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8da4034ed0 tx=0x7f8da403f000 comp rx=0 tx=0).stop 2024-04-20T21:20:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.375+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1466550802 shutdown_connections 2024-04-20T21:20:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.375+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/1466550802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af7112620 0x556af7126600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.375+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/1466550802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af7104460 0x556af71260c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.375+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/1466550802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af70ba4e0 0x556af7102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.375+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1466550802 >> 172.21.15.71:0/1466550802 conn(0x556af70b6930 msgr2=0x556af70df180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.375+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1466550802 shutdown_connections 2024-04-20T21:20:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.375+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1466550802 wait complete. 2024-04-20T21:20:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.376+0000 7f8dbe7ee740 1 -- start start 2024-04-20T21:20:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.376+0000 7f8dbe7ee740 1 Processor -- start 2024-04-20T21:20:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.377+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af70ba4e0 0x556af7177090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.377+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af7104460 0x556af70bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.377+0000 7f8dbe7ee740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af7112620 0x556af70bbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.377+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556af7116000 con 0x556af70ba4e0 2024-04-20T21:20:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.377+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556af71132a0 con 0x556af7104460 2024-04-20T21:20:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.377+0000 7f8dbe7ee740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x556af70ced50 con 0x556af7112620 2024-04-20T21:20:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.377+0000 7f8dbe7ee740 10 client.0 _ll_register_callbacks cb 0x7f8da4037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T21:20:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.377+0000 7f8db9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af70ba4e0 0x556af7177090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.377+0000 7f8db9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af70ba4e0 0x556af7177090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42376/0 (socket says 172.21.15.71:42376) 2024-04-20T21:20:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.377+0000 7f8db9000640 1 -- 172.21.15.71:0/1464841265 learned_addr learned my addr 172.21.15.71:0/1464841265 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8db9000640 1 -- 172.21.15.71:0/1464841265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af7112620 msgr2=0x556af70bbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8db9000640 1 --2- 172.21.15.71:0/1464841265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af7112620 0x556af70bbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8db9000640 1 -- 172.21.15.71:0/1464841265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af7104460 msgr2=0x556af70bb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8db9000640 1 --2- 172.21.15.71:0/1464841265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af7104460 0x556af70bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8db9000640 1 -- 172.21.15.71:0/1464841265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af717d060 con 0x556af70ba4e0 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8db9000640 1 --2- 172.21.15.71:0/1464841265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af70ba4e0 0x556af7177090 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c008fd0 tx=0x7f8d9c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc5295eff2bffd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8da2000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8da2000640 1 -- 172.21.15.71:0/1464841265 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c010040 con 0x556af70ba4e0 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8da2000640 1 -- 172.21.15.71:0/1464841265 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8d9c015d60 con 0x556af70ba4e0 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1464841265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8da4034440 con 0x556af70ba4e0 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8da2000640 1 -- 172.21.15.71:0/1464841265 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f8d9c02c350 con 0x556af70ba4e0 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8dbe7ee740 10 client.4839 fetch_fsmap learned FSMap version 8 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.378+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1464841265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x556af71813c0 con 0x556af70ba4e0 2024-04-20T21:20:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.379+0000 7f8da2000640 1 -- 172.21.15.71:0/1464841265 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da4034440 con 0x556af70ba4e0 2024-04-20T21:20:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.379+0000 7f8da2000640 1 -- 172.21.15.71:0/1464841265 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 8) ==== 3503+0+0 (secure 0 0 0) 0x7f8d9c02c4f0 con 0x556af70ba4e0 2024-04-20T21:20:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.379+0000 7f8dbe7ee740 10 client.4839 fetch_fsmap finished waiting for FSMap version 8 2024-04-20T21:20:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.379+0000 7f8dbe7ee740 10 client.4839 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-20T21:20:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.379+0000 7f8dbe7ee740 20 client.4839 populate_metadata read hostname 'smithi071' 2024-04-20T21:20:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.379+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/1464841265 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x556af7104840 0x556af7104c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.379+0000 7f8dbe7ee740 4 client.4839 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T21:20:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.379+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1464841265 --> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] -- command(tid 0: {"prefix": "status"}) -- 0x556af70e5240 con 0x556af7104840 2024-04-20T21:20:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.379+0000 7f8db3e00640 1 --2- 172.21.15.71:0/1464841265 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x556af7104840 0x556af7104c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.379+0000 7f8db3e00640 1 --2- 172.21.15.71:0/1464841265 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x556af7104840 0x556af7104c20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ef2e332bc7a2dbc server_cookie=a6739b0345c00fcb in_seq=0 out_seq=0 2024-04-20T21:20:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.379+0000 7f8da2000640 10 client.4839 ms_handle_connect on v2:172.21.15.71:6836/4085222328 2024-04-20T21:20:06.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8da2000640 1 -- 172.21.15.71:0/1464841265 <== mds.0 v2:172.21.15.71:6836/4085222328 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x556af70e5240 con 0x556af7104840 2024-04-20T21:20:06.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8da2000640 10 client.4839 handle_command_reply: tid=0 2024-04-20T21:20:06.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 1 client.4839 shutdown 2024-04-20T21:20:06.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1464841265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af70ba4e0 msgr2=0x556af7177090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:06.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/1464841265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af70ba4e0 0x556af7177090 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c008fd0 tx=0x7f8d9c000ed0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1464841265 shutdown_connections 2024-04-20T21:20:06.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/1464841265 >> [v2:172.21.15.71:6836/4085222328,v1:172.21.15.71:6837/4085222328] conn(0x556af7104840 0x556af7104c20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/1464841265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x556af7112620 0x556af70bbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/1464841265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556af7104460 0x556af70bb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 1 --2- 172.21.15.71:0/1464841265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556af70ba4e0 0x556af7177090 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1464841265 >> 172.21.15.71:0/1464841265 conn(0x556af70b6930 msgr2=0x556af70df180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:06.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8da2000640 0 client.4839 ms_handle_reset on v2:172.21.15.71:6836/4085222328 2024-04-20T21:20:06.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1464841265 shutdown_connections 2024-04-20T21:20:06.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 1 -- 172.21.15.71:0/1464841265 wait complete. 2024-04-20T21:20:06.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.380+0000 7f8dbe7ee740 20 client.4839 trim_cache size 0 max 16384 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "da776687-7be6-4259-b098-1ebb1c5bd96b", 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4254, 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 37.016093052000002, 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 8, 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 25, 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 25, 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 42.471418485999997 2024-04-20T21:20:06.385 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-20T21:20:06.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 -- 172.21.15.71:0/2796230127 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8d9006c920 msgr2=0x7f8d9006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8d9006c920 0x7f8d9006ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c000f60 tx=0x7f8d9c007b90 comp rx=0 tx=0).stop 2024-04-20T21:20:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 -- 172.21.15.71:0/2796230127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8db415ca40 msgr2=0x7f8db40996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8db415ca40 0x7f8db40996a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00c390 tx=0x7f8dac00c850 comp rx=0 tx=0).stop 2024-04-20T21:20:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 -- 172.21.15.71:0/2796230127 shutdown_connections 2024-04-20T21:20:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8d9006c920 0x7f8d9006ede0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8db415ca40 0x7f8db40996a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8db4156c20 0x7f8db409dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 --2- 172.21.15.71:0/2796230127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8db40ad8e0 0x7f8db414f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 -- 172.21.15.71:0/2796230127 >> 172.21.15.71:0/2796230127 conn(0x7f8db40b3350 msgr2=0x7f8db415e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 -- 172.21.15.71:0/2796230127 shutdown_connections 2024-04-20T21:20:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:06.381+0000 7f8dbba00640 1 -- 172.21.15.71:0/2796230127 wait complete. 2024-04-20T21:20:06.398 INFO:teuthology.run_tasks:Running task sequential... 2024-04-20T21:20:06.406 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-20T21:20:06.406 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-20T21:20:06.407 INFO:teuthology.task.print:Enabling mgr modules 2024-04-20T21:20:06.407 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-20T21:20:06.426 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-20T21:20:06.426 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-20T21:20:06.426 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-20T21:20:06.426 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-20T21:20:06.427 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-20T21:20:06.427 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-20T21:20:06.427 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-20T21:20:06.427 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-20T21:20:06.427 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-20T21:20:06.427 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-20T21:20:06.427 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-20T21:20:06.428 INFO:tasks.ceph_fuse:client.3 config is {} 2024-04-20T21:20:06.428 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-20T21:20:06.428 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-20T21:20:06.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:06.428 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-20T21:20:06.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:06.487 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-20T21:20:06.578 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-20T21:20:06.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:20:06.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:06.583 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-20T21:20:06.639 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-20T21:20:06.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:06.641 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T21:20:06.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:06.725 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-04-20T21:20:06.844 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-20T21:20:06.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-20T21:20:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.018+0000 7f4045400640 1 Processor -- start 2024-04-20T21:20:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.018+0000 7f4045400640 1 -- start start 2024-04-20T21:20:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.020+0000 7f4045400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40400d0a70 0x7f40400ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.020+0000 7f4045400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f404006f090 0x7f40400ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:07.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.020+0000 7f4045400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f404006df70 con 0x7f4040162c00 2024-04-20T21:20:07.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.020+0000 7f4045400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4040162fe0 con 0x7f404006f090 2024-04-20T21:20:07.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.020+0000 7f4045400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f404006ec00 con 0x7f40400d0a70 2024-04-20T21:20:07.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.020+0000 7f403e800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4040162c00 0x7f40400d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53684/0 (socket says 172.21.15.71:53684) 2024-04-20T21:20:07.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.020+0000 7f403e800640 1 -- 172.21.15.71:0/3066742110 learned_addr learned my addr 172.21.15.71:0/3066742110 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.020+0000 7f403f200640 1 --2- 172.21.15.71:0/3066742110 >> v2:172.21.15.137:3300/0 conn(0x7f404006f090 0x7f40400ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403de00640 1 --2- 172.21.15.71:0/3066742110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40400d0a70 0x7f40400ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324013300 0 0) 0x7f404006df70 con 0x7f4040162c00 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4024003520 con 0x7f4040162c00 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 647026178 0 0) 0x7f4024003520 con 0x7f4040162c00 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40400d0a70 msgr2=0x7f40400ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 --2- 172.21.15.71:0/3066742110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40400d0a70 0x7f40400ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 >> v2:172.21.15.137:3300/0 conn(0x7f404006f090 msgr2=0x7f40400ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 --2- 172.21.15.71:0/3066742110 >> v2:172.21.15.137:3300/0 conn(0x7f404006f090 0x7f40400ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404006e310 con 0x7f4040162c00 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f4028001670 con 0x7f4040162c00 2024-04-20T21:20:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 >> v1:172.21.15.71:6789/0 conn(0x7f4040162c00 legacy=0x7f40400d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 --2- 172.21.15.71:0/3066742110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40400d0a70 0x7f40240039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 --2- 172.21.15.71:0/3066742110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4024003f30 0x7f4024004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 --2- 172.21.15.71:0/3066742110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 0x7f40240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f404006ec00 con 0x7f4024004d40 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f402400b9c0 con 0x7f4024003f30 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.021+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f402400bb90 con 0x7f40400d0a70 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.022+0000 7f403f200640 1 --2- 172.21.15.71:0/3066742110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 0x7f40240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.022+0000 7f403de00640 1 --2- 172.21.15.71:0/3066742110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4024003f30 0x7f4024004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.022+0000 7f403f200640 1 -- 172.21.15.71:0/3066742110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40400d0a70 msgr2=0x7f40240039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.022+0000 7f403f200640 1 --2- 172.21.15.71:0/3066742110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40400d0a70 0x7f40240039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.022+0000 7f403f200640 1 -- 172.21.15.71:0/3066742110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4024003f30 msgr2=0x7f4024004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.022+0000 7f403f200640 1 --2- 172.21.15.71:0/3066742110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4024003f30 0x7f4024004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.022+0000 7f403f200640 1 -- 172.21.15.71:0/3066742110 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4024003520 con 0x7f4024004d40 2024-04-20T21:20:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.023+0000 7f403f200640 1 --2- 172.21.15.71:0/3066742110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 0x7f40240051c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4038009a90 tx=0x7f4024005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fcdc6f4be52d4c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.023+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038039070 con 0x7f4024004d40 2024-04-20T21:20:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.023+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f403802c680 con 0x7f4024004d40 2024-04-20T21:20:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.023+0000 7f403d400640 1 -- 172.21.15.71:0/3066742110 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038009690 con 0x7f4024004d40 2024-04-20T21:20:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.024+0000 7f4045400640 1 -- 172.21.15.71:0/3066742110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 msgr2=0x7f40240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.024+0000 7f4045400640 1 --2- 172.21.15.71:0/3066742110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 0x7f40240051c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4038009a90 tx=0x7f4024005830 comp rx=0 tx=0).stop 2024-04-20T21:20:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.024+0000 7f403f200640 1 -- 172.21.15.71:0/3066742110 reap_dead start 2024-04-20T21:20:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.024+0000 7f4045400640 1 -- 172.21.15.71:0/3066742110 shutdown_connections 2024-04-20T21:20:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.024+0000 7f4045400640 1 -- 172.21.15.71:0/3066742110 >> 172.21.15.71:0/3066742110 conn(0x7f40400b3350 msgr2=0x7f40400b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.024+0000 7f4045400640 1 -- 172.21.15.71:0/3066742110 shutdown_connections 2024-04-20T21:20:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.024+0000 7f4045400640 1 -- 172.21.15.71:0/3066742110 wait complete. 2024-04-20T21:20:07.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.026+0000 7f4045400640 1 Processor -- start 2024-04-20T21:20:07.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.026+0000 7f4045400640 1 -- start start 2024-04-20T21:20:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.027+0000 7f4045400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 0x7f40401554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.027+0000 7f4045400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4040158e60 0x7f40401592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.027+0000 7f4045400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4040156e50 0x7f40401572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.027+0000 7f4045400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f404006dbb0 con 0x7f4024004d40 2024-04-20T21:20:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.027+0000 7f4045400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f404006e890 con 0x7f4040158e60 2024-04-20T21:20:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.027+0000 7f4045400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f404006dd30 con 0x7f4040156e50 2024-04-20T21:20:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.027+0000 7f403e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 0x7f40401554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.027+0000 7f403e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 0x7f40401554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42400/0 (socket says 172.21.15.71:42400) 2024-04-20T21:20:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.027+0000 7f403e800640 1 -- 172.21.15.71:0/2299489969 learned_addr learned my addr 172.21.15.71:0/2299489969 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f403de00640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4040158e60 0x7f40401592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f403e800640 1 -- 172.21.15.71:0/2299489969 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4040156e50 msgr2=0x7f40401572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f403e800640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4040156e50 0x7f40401572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f403e800640 1 -- 172.21.15.71:0/2299489969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4040158e60 msgr2=0x7f40401592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f403e800640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4040158e60 0x7f40401592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f403e800640 1 -- 172.21.15.71:0/2299489969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40401fbca0 con 0x7f4024004d40 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f403de00640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4040158e60 0x7f40401592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f403e800640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 0x7f40401554e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f402800c800 tx=0x7f402800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f4036a00640 1 -- 172.21.15.71:0/2299489969 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028018070 con 0x7f4024004d40 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f4036a00640 1 -- 172.21.15.71:0/2299489969 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40280074e0 con 0x7f4024004d40 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f4036a00640 1 -- 172.21.15.71:0/2299489969 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028004a20 con 0x7f4024004d40 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.028+0000 7f4045400640 1 -- 172.21.15.71:0/2299489969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40401fbf80 con 0x7f4024004d40 2024-04-20T21:20:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.029+0000 7f4045400640 1 -- 172.21.15.71:0/2299489969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40401fc540 con 0x7f4024004d40 2024-04-20T21:20:07.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.030+0000 7f4045400640 1 -- 172.21.15.71:0/2299489969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4040068980 con 0x7f4024004d40 2024-04-20T21:20:07.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.031+0000 7f4036a00640 1 -- 172.21.15.71:0/2299489969 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4028004bc0 con 0x7f4024004d40 2024-04-20T21:20:07.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.032+0000 7f4036a00640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f401c06c8f0 0x7f401c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:07.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.032+0000 7f4036a00640 1 -- 172.21.15.71:0/2299489969 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f402808b2e0 con 0x7f4024004d40 2024-04-20T21:20:07.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.032+0000 7f403de00640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f401c06c8f0 0x7f401c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:07.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.033+0000 7f403de00640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f401c06c8f0 0x7f401c06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4030007440 tx=0x7f403000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:07.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.037+0000 7f4036a00640 1 -- 172.21.15.71:0/2299489969 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f40280593b0 con 0x7f4024004d40 2024-04-20T21:20:07.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.275+0000 7f4045400640 1 -- 172.21.15.71:0/2299489969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f40400b0040 con 0x7f4024004d40 2024-04-20T21:20:07.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.276+0000 7f4036a00640 1 -- 172.21.15.71:0/2299489969 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f4028058cb0 con 0x7f4024004d40 2024-04-20T21:20:07.276 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-20T21:20:07.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 -- 172.21.15.71:0/2299489969 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f401c06c8f0 msgr2=0x7f401c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:07.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f401c06c8f0 0x7f401c06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4030007440 tx=0x7f403000b040 comp rx=0 tx=0).stop 2024-04-20T21:20:07.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 -- 172.21.15.71:0/2299489969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 msgr2=0x7f40401554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:07.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 0x7f40401554e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f402800c800 tx=0x7f402800ccc0 comp rx=0 tx=0).stop 2024-04-20T21:20:07.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 -- 172.21.15.71:0/2299489969 shutdown_connections 2024-04-20T21:20:07.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f401c06c8f0 0x7f401c06edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:07.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4040156e50 0x7f40401572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:07.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4040158e60 0x7f40401592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:07.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 --2- 172.21.15.71:0/2299489969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4024004d40 0x7f40401554e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:07.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 -- 172.21.15.71:0/2299489969 >> 172.21.15.71:0/2299489969 conn(0x7f40400b3350 msgr2=0x7f4040160520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:07.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 -- 172.21.15.71:0/2299489969 shutdown_connections 2024-04-20T21:20:07.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07.279+0000 7f4045400640 1 -- 172.21.15.71:0/2299489969 wait complete. 2024-04-20T21:20:07.298 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-20T21:20:07.298 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T21:20:07.298 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-04-20T21:20:07.298 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-20T21:20:07.298 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-20T21:20:07.298 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-20T21:20:07.298 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T21:20:07.298 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T21:20:07.299 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-20T21:20:07.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:07.299 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-04-20T21:20:07.349 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:20:07.349 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:20:07.349 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:20:07.349 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:07.349 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-20T21:20:07.349 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42578sec preferred_lft 42578sec 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2024-04-20T21:20:07.350 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:07.351 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-20T21:20:07.352 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:07.352 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:20:07.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add name ceph-brx type bridge 2024-04-20T21:20:07.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr flush dev ceph-brx 2024-04-20T21:20:07.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set ceph-brx up 2024-04-20T21:20:07.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-20T21:20:07.352 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:20:07.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:07.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:07.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:07.597 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T21:20:07.661 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-04-20T21:20:07.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:07.665 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-04-20T21:20:07.715 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-04-20T21:20:07.715 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T21:20:07.715 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T21:20:07.715 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T21:20:07.715 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T21:20:07.716 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:07.716 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:20:07.716 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T21:20:07.716 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T21:20:07.716 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T21:20:07.716 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:20:07.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:07.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:07.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:07.923 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-20T21:20:07.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:07.971 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2024-04-20T21:20:08.020 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:08.020 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:20:08.020 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:20:08.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-20T21:20:08.021 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:20:08.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:08.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:08.200 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-20T21:20:08.201 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:08.201 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:20:08.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-20T21:20:08.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-20T21:20:08.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-20T21:20:08.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-20T21:20:08.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-20T21:20:08.201 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:20:08.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:08.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:08.462 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:08.462 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:20:08.462 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2024-04-20T21:20:08.462 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.0 master ceph-brx 2024-04-20T21:20:08.462 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:20:08.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:08.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:08.666 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-20T21:20:08.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:20:08.666 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-20T21:20:08.711 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-20T21:20:08.711 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:20:08.712 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-20T21:20:08.808 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2024-04-20T21:20:08.894 DEBUG:teuthology.orchestra.run.smithi071:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:20:08.950 INFO:teuthology.orchestra.run.smithi071.stdout:/proc 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/sys 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/dev 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/security 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/shm 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/pts 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/run 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/cgroup 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/pstore 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/bpf 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/ 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/selinux 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/mqueue 2024-04-20T21:20:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/hugepages 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/debug 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/tracing 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/fuse/connections 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/config 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/1000 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-0 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-1 2024-04-20T21:20:08.952 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-2 2024-04-20T21:20:08.953 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-3 2024-04-20T21:20:08.953 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns 2024-04-20T21:20:08.953 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:20:08.953 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:20:08.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:08.954 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2024-04-20T21:20:09.003 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-20T21:20:09.003 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-20T21:20:09.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2024-04-20T21:20:09.075 DEBUG:teuthology.orchestra.run.smithi071:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:20:09.118 INFO:teuthology.orchestra.run.smithi071.stdout:/proc 2024-04-20T21:20:09.118 INFO:teuthology.orchestra.run.smithi071.stdout:/sys 2024-04-20T21:20:09.118 INFO:teuthology.orchestra.run.smithi071.stdout:/dev 2024-04-20T21:20:09.118 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/security 2024-04-20T21:20:09.118 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/shm 2024-04-20T21:20:09.118 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/pts 2024-04-20T21:20:09.118 INFO:teuthology.orchestra.run.smithi071.stdout:/run 2024-04-20T21:20:09.118 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/cgroup 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/pstore 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/bpf 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/ 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/selinux 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/mqueue 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/hugepages 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/debug 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/tracing 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/fuse/connections 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/config 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/1000 2024-04-20T21:20:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph 2024-04-20T21:20:09.120 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-0 2024-04-20T21:20:09.120 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-1 2024-04-20T21:20:09.120 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-2 2024-04-20T21:20:09.120 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-3 2024-04-20T21:20:09.120 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns 2024-04-20T21:20:09.120 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:20:09.120 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:20:09.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:09.121 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2024-04-20T21:20:09.180 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2024-04-20T21:20:09.181+0000 7feca7449480 -1 init, newargv = 0x558cd0228fa0 newargc=15 2024-04-20T21:20:09.181 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[33243]: starting ceph client 2024-04-20T21:20:09.191 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[33243]: starting fuse 2024-04-20T21:20:09.206 INFO:teuthology.orchestra.run.smithi071.stdout:42 2024-04-20T21:20:09.206 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-20T21:20:09.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo stdin-killer -- python3 -c ' 2024-04-20T21:20:09.206 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2024-04-20T21:20:09.206 DEBUG:teuthology.orchestra.run.smithi071:> import re 2024-04-20T21:20:09.206 DEBUG:teuthology.orchestra.run.smithi071:> import os 2024-04-20T21:20:09.206 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2024-04-20T21:20:09.206 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:20:09.206 DEBUG:teuthology.orchestra.run.smithi071:> def _find_admin_socket(client_name): 2024-04-20T21:20:09.206 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> contents = proc_f.read() 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> if mountpoint in contents: 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> return f 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-20T21:20:09.207 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:20:09.208 DEBUG:teuthology.orchestra.run.smithi071:> print(_find_admin_socket("client.0")) 2024-04-20T21:20:09.208 DEBUG:teuthology.orchestra.run.smithi071:> ' 2024-04-20T21:20:09.397 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.33243.asok 2024-04-20T21:20:09.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:09.412 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33243.asok 2024-04-20T21:20:09.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:09.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33243.asok status 2024-04-20T21:20:09.634 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-20T21:20:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2024-04-20T21:20:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "33243", 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4848, 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4848 2024-04-20T21:20:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2083078829 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2083078829 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.4848 192.168.0.1:0/2083078829", 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "192.168.0.1:0/2083078829", 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2024-04-20T21:20:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 8, 2024-04-20T21:20:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 25, 2024-04-20T21:20:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2024-04-20T21:20:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklisted": false, 2024-04-20T21:20:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2024-04-20T21:20:09.637 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-20T21:20:09.649 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-20T21:20:09.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.857+0000 7f3855400640 1 Processor -- start 2024-04-20T21:20:09.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.857+0000 7f3855400640 1 -- start start 2024-04-20T21:20:09.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.858+0000 7f3855400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3850156c20 0x7f385006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:09.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.858+0000 7f3855400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f385015ca40 0x7f38500ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:09.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.858+0000 7f3855400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3850141c60 con 0x7f38500ad8e0 2024-04-20T21:20:09.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.858+0000 7f3855400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f385015cf90 con 0x7f3850156c20 2024-04-20T21:20:09.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.858+0000 7f3855400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f385015d270 con 0x7f385015ca40 2024-04-20T21:20:09.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.858+0000 7f384e800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3850156c20 0x7f385006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:09.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.859+0000 7f384e800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3850156c20 0x7f385006b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42414/0 (socket says 172.21.15.71:42414) 2024-04-20T21:20:09.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.859+0000 7f384e800640 1 -- 172.21.15.71:0/618511278 learned_addr learned my addr 172.21.15.71:0/618511278 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:09.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.859+0000 7f384de00640 1 --2- 172.21.15.71:0/618511278 >> v2:172.21.15.137:3300/0 conn(0x7f385015ca40 0x7f38500ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:09.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.859+0000 7f384e800640 1 -- 172.21.15.71:0/618511278 >> v2:172.21.15.137:3300/0 conn(0x7f385015ca40 msgr2=0x7f38500ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:09.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.859+0000 7f384e800640 1 --2- 172.21.15.71:0/618511278 >> v2:172.21.15.137:3300/0 conn(0x7f385015ca40 0x7f38500ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:09.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.859+0000 7f384e800640 1 -- 172.21.15.71:0/618511278 >> v1:172.21.15.137:6789/0 conn(0x7f38500ad8e0 legacy=0x7f38500d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:09.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.859+0000 7f384e800640 1 -- 172.21.15.71:0/618511278 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385015d550 con 0x7f3850156c20 2024-04-20T21:20:09.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.860+0000 7f384e800640 1 --2- 172.21.15.71:0/618511278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3850156c20 0x7f385006b900 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f385006fe40 tx=0x7f384002b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c2c8fca32b1aa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:09.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.865+0000 7f384d400640 1 -- 172.21.15.71:0/618511278 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840034070 con 0x7f3850156c20 2024-04-20T21:20:09.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.865+0000 7f384d400640 1 -- 172.21.15.71:0/618511278 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3840030870 con 0x7f3850156c20 2024-04-20T21:20:09.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.865+0000 7f384d400640 1 -- 172.21.15.71:0/618511278 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840030c40 con 0x7f3850156c20 2024-04-20T21:20:09.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.866+0000 7f3855400640 1 -- 172.21.15.71:0/618511278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3850156c20 msgr2=0x7f385006b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:09.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.866+0000 7f3855400640 1 --2- 172.21.15.71:0/618511278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3850156c20 0x7f385006b900 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f385006fe40 tx=0x7f384002b9b0 comp rx=0 tx=0).stop 2024-04-20T21:20:09.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.867+0000 7f3855400640 1 -- 172.21.15.71:0/618511278 shutdown_connections 2024-04-20T21:20:09.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.867+0000 7f3855400640 1 --2- 172.21.15.71:0/618511278 >> v2:172.21.15.137:3300/0 conn(0x7f385015ca40 0x7f38500ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:09.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.867+0000 7f3855400640 1 --2- 172.21.15.71:0/618511278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3850156c20 0x7f385006b900 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:09.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.867+0000 7f3855400640 1 -- 172.21.15.71:0/618511278 >> 172.21.15.71:0/618511278 conn(0x7f38500b3350 msgr2=0x7f38500b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:09.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.874+0000 7f3855400640 1 -- 172.21.15.71:0/618511278 shutdown_connections 2024-04-20T21:20:09.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.874+0000 7f3855400640 1 -- 172.21.15.71:0/618511278 wait complete. 2024-04-20T21:20:09.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.876+0000 7f3855400640 1 Processor -- start 2024-04-20T21:20:09.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.876+0000 7f3855400640 1 -- start start 2024-04-20T21:20:09.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.877+0000 7f3855400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38500ad8e0 0x7f385014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:09.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.877+0000 7f3855400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3850156c20 0x7f38501f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:09.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.877+0000 7f3855400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f385015ca40 0x7f385015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:09.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.877+0000 7f3855400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f385006bfc0 con 0x7f385015ca40 2024-04-20T21:20:09.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.877+0000 7f3855400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f385006be40 con 0x7f38500ad8e0 2024-04-20T21:20:09.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.877+0000 7f3855400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f38500d0a70 con 0x7f3850156c20 2024-04-20T21:20:09.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.877+0000 7f384f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f385015ca40 0x7f385015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:09.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.877+0000 7f384f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f385015ca40 0x7f385015b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42418/0 (socket says 172.21.15.71:42418) 2024-04-20T21:20:09.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.877+0000 7f384f200640 1 -- 172.21.15.71:0/4258977881 learned_addr learned my addr 172.21.15.71:0/4258977881 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:09.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.878+0000 7f384f200640 1 -- 172.21.15.71:0/4258977881 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3850156c20 msgr2=0x7f38501f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:09.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.878+0000 7f384f200640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3850156c20 0x7f38501f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:09.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.878+0000 7f384f200640 1 -- 172.21.15.71:0/4258977881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38500ad8e0 msgr2=0x7f385014f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:09.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.878+0000 7f384f200640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38500ad8e0 0x7f385014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:09.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.878+0000 7f384f200640 1 -- 172.21.15.71:0/4258977881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38500b0cc0 con 0x7f385015ca40 2024-04-20T21:20:09.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.878+0000 7f384f200640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f385015ca40 0x7f385015b410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f384800c730 tx=0x7f384800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:09.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.879+0000 7f3846a00640 1 -- 172.21.15.71:0/4258977881 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848003b70 con 0x7f385015ca40 2024-04-20T21:20:09.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.879+0000 7f3846a00640 1 -- 172.21.15.71:0/4258977881 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3848003d10 con 0x7f385015ca40 2024-04-20T21:20:09.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.879+0000 7f3846a00640 1 -- 172.21.15.71:0/4258977881 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848005310 con 0x7f385015ca40 2024-04-20T21:20:09.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.879+0000 7f3855400640 1 -- 172.21.15.71:0/4258977881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38500732f0 con 0x7f385015ca40 2024-04-20T21:20:09.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.879+0000 7f3855400640 1 -- 172.21.15.71:0/4258977881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3850071c90 con 0x7f385015ca40 2024-04-20T21:20:09.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.881+0000 7f3855400640 1 -- 172.21.15.71:0/4258977881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3850068980 con 0x7f385015ca40 2024-04-20T21:20:09.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.882+0000 7f3846a00640 1 -- 172.21.15.71:0/4258977881 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38480054b0 con 0x7f385015ca40 2024-04-20T21:20:09.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.883+0000 7f3846a00640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f383006c940 0x7f383006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:09.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.883+0000 7f3846a00640 1 -- 172.21.15.71:0/4258977881 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f384808bdd0 con 0x7f385015ca40 2024-04-20T21:20:09.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.883+0000 7f384e800640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f383006c940 0x7f383006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:09.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.884+0000 7f384e800640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f383006c940 0x7f383006ee00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3840036000 tx=0x7f384003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:09.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:09.888+0000 7f3846a00640 1 -- 172.21.15.71:0/4258977881 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3848059dc0 con 0x7f385015ca40 2024-04-20T21:20:10.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.132+0000 7f3855400640 1 -- 172.21.15.71:0/4258977881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f38500cfd90 con 0x7f385015ca40 2024-04-20T21:20:10.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.133+0000 7f3846a00640 1 -- 172.21.15.71:0/4258977881 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f38480596c0 con 0x7f385015ca40 2024-04-20T21:20:10.133 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-20T21:20:10.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 -- 172.21.15.71:0/4258977881 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f383006c940 msgr2=0x7f383006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:10.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f383006c940 0x7f383006ee00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3840036000 tx=0x7f384003b040 comp rx=0 tx=0).stop 2024-04-20T21:20:10.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 -- 172.21.15.71:0/4258977881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f385015ca40 msgr2=0x7f385015b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:10.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f385015ca40 0x7f385015b410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f384800c730 tx=0x7f384800cb30 comp rx=0 tx=0).stop 2024-04-20T21:20:10.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 -- 172.21.15.71:0/4258977881 shutdown_connections 2024-04-20T21:20:10.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f383006c940 0x7f383006ee00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:10.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f385015ca40 0x7f385015b410 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:10.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3850156c20 0x7f38501f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:10.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 --2- 172.21.15.71:0/4258977881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38500ad8e0 0x7f385014f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:10.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 -- 172.21.15.71:0/4258977881 >> 172.21.15.71:0/4258977881 conn(0x7f38500b3350 msgr2=0x7f3850155580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:10.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 -- 172.21.15.71:0/4258977881 shutdown_connections 2024-04-20T21:20:10.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10.136+0000 7f3855400640 1 -- 172.21.15.71:0/4258977881 wait complete. 2024-04-20T21:20:10.154 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-20T21:20:10.154 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T21:20:10.154 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-04-20T21:20:10.155 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-20T21:20:10.155 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-20T21:20:10.155 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-20T21:20:10.155 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T21:20:10.155 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T21:20:10.155 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-20T21:20:10.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:10.155 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-04-20T21:20:10.205 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42575sec preferred_lft 42575sec 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 1e:98:41:14:ed:dd brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::3047:a7ff:fe3a:dca4/64 scope link 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-20T21:20:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 1e:98:41:14:ed:dd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:20:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::1c98:41ff:fe14:eddd/64 scope link tentative 2024-04-20T21:20:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:10.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:10.207 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T21:20:10.283 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-04-20T21:20:10.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:10.288 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-04-20T21:20:10.339 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-04-20T21:20:10.340 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T21:20:10.340 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T21:20:10.340 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T21:20:10.340 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T21:20:10.340 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:10.340 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:20:10.340 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T21:20:10.340 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T21:20:10.340 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T21:20:10.340 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:20:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:10.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:10.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:10.549 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-20T21:20:10.595 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-20T21:20:10.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:10.595 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2024-04-20T21:20:10.691 INFO:teuthology.orchestra.run.smithi071.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-20T21:20:10.691 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:10.691 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:20:10.691 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-20T21:20:10.691 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-20T21:20:10.691 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:20:10.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:10.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:10.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:10.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-20T21:20:10.940 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:20:10.940 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:20:10.940 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:20:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-20T21:20:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:10.941 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-20T21:20:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 86:c0:05:d4:fc:28 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-20T21:20:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-20T21:20:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::84c0:5ff:fed4:fc28/64 scope link 2024-04-20T21:20:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:10.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:10.944 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-20T21:20:11.014 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:20:11.015 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:20:11.015 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:20:11.015 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:11.015 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-20T21:20:11.015 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:11.015 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-20T21:20:11.015 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 86:c0:05:d4:fc:28 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-20T21:20:11.015 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-20T21:20:11.015 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:11.015 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::84c0:5ff:fed4:fc28/64 scope link 2024-04-20T21:20:11.015 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:11.018 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-20T21:20:11.018 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:11.018 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:20:11.018 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-20T21:20:11.018 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-20T21:20:11.018 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-20T21:20:11.018 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-20T21:20:11.019 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-20T21:20:11.019 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:20:11.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:11.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:11.284 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:11.284 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:20:11.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.1 up 2024-04-20T21:20:11.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.1 master ceph-brx 2024-04-20T21:20:11.285 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:20:11.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:11.489 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-20T21:20:11.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:20:11.489 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-20T21:20:11.534 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-20T21:20:11.534 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:20:11.535 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-20T21:20:11.627 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2024-04-20T21:20:11.698 DEBUG:teuthology.orchestra.run.smithi071:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:20:11.742 INFO:teuthology.orchestra.run.smithi071.stdout:/proc 2024-04-20T21:20:11.742 INFO:teuthology.orchestra.run.smithi071.stdout:/sys 2024-04-20T21:20:11.742 INFO:teuthology.orchestra.run.smithi071.stdout:/dev 2024-04-20T21:20:11.743 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/security 2024-04-20T21:20:11.743 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/shm 2024-04-20T21:20:11.743 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/pts 2024-04-20T21:20:11.743 INFO:teuthology.orchestra.run.smithi071.stdout:/run 2024-04-20T21:20:11.743 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/cgroup 2024-04-20T21:20:11.743 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/pstore 2024-04-20T21:20:11.743 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/bpf 2024-04-20T21:20:11.743 INFO:teuthology.orchestra.run.smithi071.stdout:/ 2024-04-20T21:20:11.743 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/selinux 2024-04-20T21:20:11.743 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:20:11.743 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/mqueue 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/hugepages 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/debug 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/tracing 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/fuse/connections 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/config 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/1000 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-0 2024-04-20T21:20:11.744 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-1 2024-04-20T21:20:11.745 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-2 2024-04-20T21:20:11.745 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-3 2024-04-20T21:20:11.745 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns 2024-04-20T21:20:11.745 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:20:11.745 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:20:11.745 INFO:teuthology.orchestra.run.smithi071.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-20T21:20:11.745 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-20T21:20:11.745 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-20T21:20:11.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:11.746 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2024-04-20T21:20:11.837 INFO:teuthology.orchestra.run.smithi071.stdout:42 2024-04-20T21:20:11.837 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2024-04-20T21:20:11.838 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-20T21:20:11.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2024-04-20T21:20:11.906 DEBUG:teuthology.orchestra.run.smithi071:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:20:11.946 INFO:teuthology.orchestra.run.smithi071.stdout:/proc 2024-04-20T21:20:11.946 INFO:teuthology.orchestra.run.smithi071.stdout:/sys 2024-04-20T21:20:11.946 INFO:teuthology.orchestra.run.smithi071.stdout:/dev 2024-04-20T21:20:11.946 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/security 2024-04-20T21:20:11.946 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/shm 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/pts 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/run 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/cgroup 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/pstore 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/bpf 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/ 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/selinux 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/mqueue 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/hugepages 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/debug 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/tracing 2024-04-20T21:20:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/fuse/connections 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/config 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/1000 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-0 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-1 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-2 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-3 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:20:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:20:11.949 INFO:teuthology.orchestra.run.smithi071.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-20T21:20:11.949 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-20T21:20:11.949 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-20T21:20:11.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:11.950 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2024-04-20T21:20:12.004 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi071.stderr:2024-04-20T21:20:12.004+0000 7f25f52c5480 -1 init, newargv = 0x55da4ba39e20 newargc=15 2024-04-20T21:20:12.004 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi071.stderr:ceph-fuse[33742]: starting ceph client 2024-04-20T21:20:12.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi071.stderr:ceph-fuse[33742]: starting fuse 2024-04-20T21:20:12.033 INFO:teuthology.orchestra.run.smithi071.stdout:42 2024-04-20T21:20:12.033 INFO:teuthology.orchestra.run.smithi071.stdout:43 2024-04-20T21:20:12.034 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo stdin-killer -- python3 -c ' 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> import re 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> import os 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> def _find_admin_socket(client_name): 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:20:12.034 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> contents = proc_f.read() 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> if mountpoint in contents: 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> return f 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:20:12.035 DEBUG:teuthology.orchestra.run.smithi071:> print(_find_admin_socket("client.2")) 2024-04-20T21:20:12.036 DEBUG:teuthology.orchestra.run.smithi071:> ' 2024-04-20T21:20:12.216 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.2.33742.asok 2024-04-20T21:20:12.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:12.232 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.33742.asok 2024-04-20T21:20:12.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:12.233 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.33742.asok status 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "2", 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "33742", 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2024-04-20T21:20:12.444 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4860, 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4860 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.2:0", 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1355444431 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2024-04-20T21:20:12.445 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.2:0", 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1355444431 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.4860 192.168.0.2:0/1355444431", 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "192.168.0.2:0/1355444431", 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 8, 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 27, 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklisted": false, 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2024-04-20T21:20:12.446 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-20T21:20:12.458 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-20T21:20:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.653+0000 7fc7aa000640 1 Processor -- start 2024-04-20T21:20:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.653+0000 7fc7aa000640 1 -- start start 2024-04-20T21:20:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.654+0000 7fc7aa000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7a40d1430 0x7fc7a415ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.654+0000 7fc7aa000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a4160910 con 0x7fc7a415a080 2024-04-20T21:20:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.654+0000 7fc7aa000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a4160bf0 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.654+0000 7fc7aa000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a40c8360 con 0x7fc7a40d1430 2024-04-20T21:20:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.655+0000 7fc7a8c00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc7a415a080 0x7fc7a40c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53700/0 (socket says 172.21.15.71:53700) 2024-04-20T21:20:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.655+0000 7fc7a8c00640 1 -- 172.21.15.71:0/3266678313 learned_addr learned my addr 172.21.15.71:0/3266678313 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.655+0000 7fc7a3e00640 1 --2- 172.21.15.71:0/3266678313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7a40d1430 0x7fc7a415ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.655+0000 7fc7a3400640 1 -- 172.21.15.71:0/3266678313 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879678134 0 0) 0x7fc7a4160910 con 0x7fc7a415a080 2024-04-20T21:20:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.655+0000 7fc7a3400640 1 -- 172.21.15.71:0/3266678313 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc78c003520 con 0x7fc7a415a080 2024-04-20T21:20:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.656+0000 7fc7a3400640 1 -- 172.21.15.71:0/3266678313 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2126861175 0 0) 0x7fc7a4160bf0 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.656+0000 7fc7a3400640 1 -- 172.21.15.71:0/3266678313 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a4160910 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.656+0000 7fc7a3400640 1 -- 172.21.15.71:0/3266678313 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2190827814 0 0) 0x7fc78c003520 con 0x7fc7a415a080 2024-04-20T21:20:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.656+0000 7fc7a3e00640 1 -- 172.21.15.71:0/3266678313 >> v1:172.21.15.137:6789/0 conn(0x7fc7a40cd2a0 legacy=0x7fc7a415c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.656+0000 7fc7a3e00640 1 -- 172.21.15.71:0/3266678313 >> v1:172.21.15.71:6789/0 conn(0x7fc7a415a080 legacy=0x7fc7a40c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.656+0000 7fc7a3e00640 1 -- 172.21.15.71:0/3266678313 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a40c8640 con 0x7fc7a40d1430 2024-04-20T21:20:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.657+0000 7fc7a3e00640 1 --2- 172.21.15.71:0/3266678313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7a40d1430 0x7fc7a415ffa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7900097d0 tx=0x7fc79002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55bc5683a8b7ab0d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.658+0000 7fc7a3400640 1 -- 172.21.15.71:0/3266678313 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790037070 con 0x7fc7a40d1430 2024-04-20T21:20:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.658+0000 7fc7a3400640 1 -- 172.21.15.71:0/3266678313 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc790030510 con 0x7fc7a40d1430 2024-04-20T21:20:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.658+0000 7fc7a3400640 1 -- 172.21.15.71:0/3266678313 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798001670 con 0x7fc7a40d1430 2024-04-20T21:20:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.658+0000 7fc7aa000640 1 -- 172.21.15.71:0/3266678313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7a40d1430 msgr2=0x7fc7a415ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.658+0000 7fc7aa000640 1 --2- 172.21.15.71:0/3266678313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7a40d1430 0x7fc7a415ffa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7900097d0 tx=0x7fc79002b800 comp rx=0 tx=0).stop 2024-04-20T21:20:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.658+0000 7fc7aa000640 1 -- 172.21.15.71:0/3266678313 shutdown_connections 2024-04-20T21:20:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.658+0000 7fc7aa000640 1 --2- 172.21.15.71:0/3266678313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7a40d1430 0x7fc7a415ffa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.658+0000 7fc7aa000640 1 -- 172.21.15.71:0/3266678313 >> 172.21.15.71:0/3266678313 conn(0x7fc7a40b3f40 msgr2=0x7fc7a40b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.658+0000 7fc7aa000640 1 -- 172.21.15.71:0/3266678313 shutdown_connections 2024-04-20T21:20:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.659+0000 7fc7aa000640 1 -- 172.21.15.71:0/3266678313 wait complete. 2024-04-20T21:20:12.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.660+0000 7fc7aa000640 1 Processor -- start 2024-04-20T21:20:12.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.660+0000 7fc7aa000640 1 -- start start 2024-04-20T21:20:12.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.661+0000 7fc7aa000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7a40cd2a0 0x7fc7a4153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:12.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.661+0000 7fc7aa000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7a40d1430 0x7fc7a40c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:12.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.661+0000 7fc7aa000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a415a080 0x7fc7a415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:12.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.661+0000 7fc7aa000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a40cd730 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.661+0000 7fc7aa000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41606f0 con 0x7fc7a415a080 2024-04-20T21:20:12.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.661+0000 7fc7aa000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a40cd8b0 con 0x7fc7a40d1430 2024-04-20T21:20:12.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.662+0000 7fc7a8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7a40cd2a0 0x7fc7a4153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:12.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.662+0000 7fc7a8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7a40cd2a0 0x7fc7a4153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42428/0 (socket says 172.21.15.71:42428) 2024-04-20T21:20:12.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.662+0000 7fc7a8c00640 1 -- 172.21.15.71:0/2718115079 learned_addr learned my addr 172.21.15.71:0/2718115079 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:12.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.662+0000 7fc7a3e00640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7a40d1430 0x7fc7a40c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:12.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.662+0000 7fc7a9600640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a415a080 0x7fc7a415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:12.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.662+0000 7fc7a8c00640 1 -- 172.21.15.71:0/2718115079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7a40d1430 msgr2=0x7fc7a40c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:12.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.662+0000 7fc7a8c00640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7a40d1430 0x7fc7a40c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:12.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.662+0000 7fc7a8c00640 1 -- 172.21.15.71:0/2718115079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a415a080 msgr2=0x7fc7a415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:12.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.662+0000 7fc7a8c00640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a415a080 0x7fc7a415dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:12.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.662+0000 7fc7a8c00640 1 -- 172.21.15.71:0/2718115079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a4154270 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.663+0000 7fc7a8c00640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7a40cd2a0 0x7fc7a4153ad0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc79800c520 tx=0x7fc79800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:12.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.663+0000 7fc7a0c00640 1 -- 172.21.15.71:0/2718115079 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798017070 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.663+0000 7fc7a0c00640 1 -- 172.21.15.71:0/2718115079 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc798005d00 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.663+0000 7fc7aa000640 1 -- 172.21.15.71:0/2718115079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a4154550 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.663+0000 7fc7a0c00640 1 -- 172.21.15.71:0/2718115079 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7980072b0 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.663+0000 7fc7aa000640 1 -- 172.21.15.71:0/2718115079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a4154b10 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.664+0000 7fc7aa000640 1 -- 172.21.15.71:0/2718115079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a4075b30 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.665+0000 7fc7a0c00640 1 -- 172.21.15.71:0/2718115079 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc79801a070 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.667+0000 7fc7a0c00640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc78406c8f0 0x7fc78406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.667+0000 7fc7a0c00640 1 -- 172.21.15.71:0/2718115079 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fc79808b420 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.667+0000 7fc7a3e00640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc78406c8f0 0x7fc78406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.668+0000 7fc7a3e00640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc78406c8f0 0x7fc78406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc790034000 tx=0x7fc790008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.671+0000 7fc7a0c00640 1 -- 172.21.15.71:0/2718115079 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc798059430 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.911+0000 7fc7aa000640 1 -- 172.21.15.71:0/2718115079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc7a4074dd0 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.911+0000 7fc7a0c00640 1 -- 172.21.15.71:0/2718115079 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fc798058d30 con 0x7fc7a40cd2a0 2024-04-20T21:20:12.910 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-20T21:20:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 -- 172.21.15.71:0/2718115079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc78406c8f0 msgr2=0x7fc78406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc78406c8f0 0x7fc78406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc790034000 tx=0x7fc790008030 comp rx=0 tx=0).stop 2024-04-20T21:20:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 -- 172.21.15.71:0/2718115079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7a40cd2a0 msgr2=0x7fc7a4153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7a40cd2a0 0x7fc7a4153ad0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc79800c520 tx=0x7fc79800c9e0 comp rx=0 tx=0).stop 2024-04-20T21:20:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 -- 172.21.15.71:0/2718115079 shutdown_connections 2024-04-20T21:20:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc78406c8f0 0x7fc78406edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a415a080 0x7fc7a415dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7a40d1430 0x7fc7a40c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 --2- 172.21.15.71:0/2718115079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7a40cd2a0 0x7fc7a4153ad0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 -- 172.21.15.71:0/2718115079 >> 172.21.15.71:0/2718115079 conn(0x7fc7a40b3f40 msgr2=0x7fc7a40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 -- 172.21.15.71:0/2718115079 shutdown_connections 2024-04-20T21:20:12.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:12.914+0000 7fc7aa000640 1 -- 172.21.15.71:0/2718115079 wait complete. 2024-04-20T21:20:12.934 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-20T21:20:12.934 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T21:20:12.934 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-20T21:20:12.934 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-20T21:20:12.934 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-20T21:20:12.934 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-20T21:20:12.934 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T21:20:12.934 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T21:20:12.934 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-20T21:20:12.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:12.935 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-20T21:20:12.992 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:20:12.992 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:12.993 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-20T21:20:12.994 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42701sec preferred_lft 42701sec 2024-04-20T21:20:12.994 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-20T21:20:12.994 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:12.995 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-20T21:20:12.995 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:12.995 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-20T21:20:12.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add name ceph-brx type bridge 2024-04-20T21:20:12.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr flush dev ceph-brx 2024-04-20T21:20:12.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set ceph-brx up 2024-04-20T21:20:12.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-20T21:20:12.995 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-20T21:20:13.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:13.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:13.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:13.468 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T21:20:13.528 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-20T21:20:13.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:13.531 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-20T21:20:13.586 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-20T21:20:13.587 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T21:20:13.587 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T21:20:13.587 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T21:20:13.587 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T21:20:13.587 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:13.587 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-20T21:20:13.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T21:20:13.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T21:20:13.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T21:20:13.587 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-20T21:20:13.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:14.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:14.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:14.350 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-20T21:20:14.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:14.391 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-04-20T21:20:14.478 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:14.478 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-20T21:20:14.478 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:14.479 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-20T21:20:14.479 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-20T21:20:14.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:14.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:14.695 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-20T21:20:14.695 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:14.695 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-20T21:20:14.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-20T21:20:14.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-20T21:20:14.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-20T21:20:14.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-20T21:20:14.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-20T21:20:14.695 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-20T21:20:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:14.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:14.973 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:14.973 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-20T21:20:14.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-20T21:20:14.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.0 master ceph-brx 2024-04-20T21:20:14.974 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-20T21:20:15.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:15.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:15.156 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-20T21:20:15.156 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:20:15.157 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-20T21:20:15.198 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-20T21:20:15.199 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:20:15.199 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-20T21:20:15.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-20T21:20:15.359 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:20:15.406 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-20T21:20:15.406 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-20T21:20:15.406 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-20T21:20:15.406 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-20T21:20:15.406 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-20T21:20:15.406 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-20T21:20:15.406 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-20T21:20:15.406 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-20T21:20:15.406 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-20T21:20:15.406 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/selinux 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:20:15.407 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-20T21:20:15.408 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-20T21:20:15.408 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-4 2024-04-20T21:20:15.408 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-5 2024-04-20T21:20:15.408 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-6 2024-04-20T21:20:15.408 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-7 2024-04-20T21:20:15.408 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-20T21:20:15.408 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:15.408 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:15.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:15.409 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-20T21:20:15.451 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-20T21:20:15.451 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-20T21:20:15.497 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-20T21:20:15.567 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:20:15.609 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-20T21:20:15.609 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-20T21:20:15.609 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-20T21:20:15.609 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-20T21:20:15.609 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-20T21:20:15.609 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-20T21:20:15.609 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-20T21:20:15.609 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-20T21:20:15.609 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/selinux 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:20:15.610 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:20:15.611 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:20:15.611 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-20T21:20:15.611 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-20T21:20:15.611 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-4 2024-04-20T21:20:15.611 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-5 2024-04-20T21:20:15.611 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-6 2024-04-20T21:20:15.611 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-7 2024-04-20T21:20:15.611 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-20T21:20:15.611 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:15.611 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:15.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:15.612 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-20T21:20:15.708 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi137.stderr:2024-04-20T21:20:15.709+0000 7f9b2844e480 -1 init, newargv = 0x56282ff3a0e0 newargc=15 2024-04-20T21:20:15.708 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi137.stderr:ceph-fuse[28440]: starting ceph client 2024-04-20T21:20:15.721 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi137.stderr:ceph-fuse[28440]: starting fuse 2024-04-20T21:20:16.799 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-20T21:20:16.891 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:20:16.947 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-20T21:20:16.947 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-20T21:20:16.947 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-20T21:20:16.947 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-20T21:20:16.947 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-20T21:20:16.947 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-20T21:20:16.947 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-20T21:20:16.947 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/selinux 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:20:16.948 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-4 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-5 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-6 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-7 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:16.949 INFO:teuthology.orchestra.run.smithi137.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-20T21:20:16.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:16.950 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-20T21:20:17.000 INFO:teuthology.orchestra.run.smithi137.stdout:40 2024-04-20T21:20:17.000 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-20T21:20:17.001 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.1")) 2024-04-20T21:20:17.002 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-20T21:20:17.165 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.1.28440.asok 2024-04-20T21:20:17.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:17.182 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.28440.asok 2024-04-20T21:20:17.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:17.182 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.28440.asok status 2024-04-20T21:20:17.412 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "1", 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "28440", 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2024-04-20T21:20:17.413 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4499, 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 4499 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 3617319948 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-20T21:20:17.414 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:20:17.415 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 3617319948 2024-04-20T21:20:17.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-20T21:20:17.415 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.4499 192.168.0.1:0/3617319948", 2024-04-20T21:20:17.415 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "192.168.0.1:0/3617319948", 2024-04-20T21:20:17.415 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2024-04-20T21:20:17.415 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 8, 2024-04-20T21:20:17.415 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 27, 2024-04-20T21:20:17.415 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2024-04-20T21:20:17.415 INFO:teuthology.orchestra.run.smithi137.stdout: "blocklisted": false, 2024-04-20T21:20:17.415 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2024-04-20T21:20:17.415 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-20T21:20:17.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-20T21:20:17.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.635+0000 7f744f200640 1 Processor -- start 2024-04-20T21:20:17.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.635+0000 7f744f200640 1 -- start start 2024-04-20T21:20:17.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744f200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f744806cde0 0x7f74480d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:17.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 0x7f74480b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:17.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744f200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f744806c190 con 0x7f7448161d50 2024-04-20T21:20:17.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744f200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7448162130 con 0x7f744806cde0 2024-04-20T21:20:17.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f744806c470 con 0x7f74480b3330 2024-04-20T21:20:17.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744de00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7448161d50 0x7f744806c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48122/0 (socket says 172.21.15.71:48122) 2024-04-20T21:20:17.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744de00640 1 -- 172.21.15.71:0/2966031854 learned_addr learned my addr 172.21.15.71:0/2966031854 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:17.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744d400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f744806cde0 0x7f74480d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:17.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744e800640 1 --2- 172.21.15.71:0/2966031854 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 0x7f74480b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:17.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744d400640 1 -- 172.21.15.71:0/2966031854 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 msgr2=0x7f74480b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:17.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744d400640 1 --2- 172.21.15.71:0/2966031854 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 0x7f74480b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:17.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744d400640 1 -- 172.21.15.71:0/2966031854 >> v1:172.21.15.71:6789/0 conn(0x7f7448161d50 legacy=0x7f744806c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:17.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744d400640 1 -- 172.21.15.71:0/2966031854 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74480d2e00 con 0x7f744806cde0 2024-04-20T21:20:17.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.637+0000 7f744ca00640 1 -- 172.21.15.71:0/2966031854 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307575038 0 0) 0x7f744806c190 con 0x7f7448161d50 2024-04-20T21:20:17.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.638+0000 7f744e800640 1 --2- 172.21.15.71:0/2966031854 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 0x7f74480b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:17.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.639+0000 7f744d400640 1 --2- 172.21.15.71:0/2966031854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f744806cde0 0x7f74480d38e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f74380097a0 tx=0x7f743802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76119996a2b02a5b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:17.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.639+0000 7f744ca00640 1 -- 172.21.15.71:0/2966031854 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7438035020 con 0x7f744806cde0 2024-04-20T21:20:17.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.639+0000 7f744ca00640 1 -- 172.21.15.71:0/2966031854 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7438031810 con 0x7f744806cde0 2024-04-20T21:20:17.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.639+0000 7f744ca00640 1 -- 172.21.15.71:0/2966031854 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7438031be0 con 0x7f744806cde0 2024-04-20T21:20:17.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.639+0000 7f744f200640 1 -- 172.21.15.71:0/2966031854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f744806cde0 msgr2=0x7f74480d38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:17.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.639+0000 7f744f200640 1 --2- 172.21.15.71:0/2966031854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f744806cde0 0x7f74480d38e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f74380097a0 tx=0x7f743802b8b0 comp rx=0 tx=0).stop 2024-04-20T21:20:17.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.640+0000 7f744f200640 1 -- 172.21.15.71:0/2966031854 shutdown_connections 2024-04-20T21:20:17.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.640+0000 7f744f200640 1 --2- 172.21.15.71:0/2966031854 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 0x7f74480b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:17.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.640+0000 7f744f200640 1 --2- 172.21.15.71:0/2966031854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f744806cde0 0x7f74480d38e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:17.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.640+0000 7f744f200640 1 -- 172.21.15.71:0/2966031854 >> 172.21.15.71:0/2966031854 conn(0x7f74480d4450 msgr2=0x7f74480d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:17.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.640+0000 7f744f200640 1 -- 172.21.15.71:0/2966031854 shutdown_connections 2024-04-20T21:20:17.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.640+0000 7f744f200640 1 -- 172.21.15.71:0/2966031854 wait complete. 2024-04-20T21:20:17.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.642+0000 7f744f200640 1 Processor -- start 2024-04-20T21:20:17.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.642+0000 7f744f200640 1 -- start start 2024-04-20T21:20:17.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744806cde0 0x7f744814f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:17.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 0x7f74480cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:17.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7448161d50 0x7f74480cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:17.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f74480b7660 con 0x7f7448161d50 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f74480d33c0 con 0x7f744806cde0 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f74480b77e0 con 0x7f74480b3330 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7448161d50 0x7f74480cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7448161d50 0x7f74480cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38084/0 (socket says 172.21.15.71:38084) 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744e800640 1 -- 172.21.15.71:0/3516631563 learned_addr learned my addr 172.21.15.71:0/3516631563 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744de00640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744806cde0 0x7f744814f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744d400640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 0x7f74480cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.643+0000 7f744e800640 1 -- 172.21.15.71:0/3516631563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 msgr2=0x7f74480cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.644+0000 7f744e800640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 0x7f74480cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.644+0000 7f744e800640 1 -- 172.21.15.71:0/3516631563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744806cde0 msgr2=0x7f744814f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.644+0000 7f744e800640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744806cde0 0x7f744814f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.644+0000 7f744e800640 1 -- 172.21.15.71:0/3516631563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74480cbf30 con 0x7f7448161d50 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.644+0000 7f744d400640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 0x7f74480cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:17.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.644+0000 7f744e800640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7448161d50 0x7f74480cd400 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f744400cef0 tx=0x7f744400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:17.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.644+0000 7f7442000640 1 -- 172.21.15.71:0/3516631563 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744401a070 con 0x7f7448161d50 2024-04-20T21:20:17.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.644+0000 7f7442000640 1 -- 172.21.15.71:0/3516631563 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744400d860 con 0x7f7448161d50 2024-04-20T21:20:17.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.644+0000 7f744f200640 1 -- 172.21.15.71:0/3516631563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74480cc210 con 0x7f7448161d50 2024-04-20T21:20:17.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.644+0000 7f7442000640 1 -- 172.21.15.71:0/3516631563 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744400dc50 con 0x7f7448161d50 2024-04-20T21:20:17.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.644+0000 7f744f200640 1 -- 172.21.15.71:0/3516631563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74480cc7d0 con 0x7f7448161d50 2024-04-20T21:20:17.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.645+0000 7f744f200640 1 -- 172.21.15.71:0/3516631563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7448075b60 con 0x7f7448161d50 2024-04-20T21:20:17.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.646+0000 7f7442000640 1 -- 172.21.15.71:0/3516631563 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f744401d070 con 0x7f7448161d50 2024-04-20T21:20:17.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.647+0000 7f7442000640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f742c06c8f0 0x7f742c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:17.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.647+0000 7f7442000640 1 -- 172.21.15.71:0/3516631563 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f744408c8e0 con 0x7f7448161d50 2024-04-20T21:20:17.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.647+0000 7f744de00640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f742c06c8f0 0x7f742c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:17.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.648+0000 7f744de00640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f742c06c8f0 0x7f742c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f743c000f60 tx=0x7f743c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:17.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.652+0000 7f7442000640 1 -- 172.21.15.71:0/3516631563 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f744405a910 con 0x7f7448161d50 2024-04-20T21:20:17.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.888+0000 7f744f200640 1 -- 172.21.15.71:0/3516631563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f74480cdb70 con 0x7f7448161d50 2024-04-20T21:20:17.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.889+0000 7f7442000640 1 -- 172.21.15.71:0/3516631563 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f744405a210 con 0x7f7448161d50 2024-04-20T21:20:17.887 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-20T21:20:17.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 -- 172.21.15.71:0/3516631563 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f742c06c8f0 msgr2=0x7f742c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:17.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f742c06c8f0 0x7f742c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f743c000f60 tx=0x7f743c009040 comp rx=0 tx=0).stop 2024-04-20T21:20:17.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 -- 172.21.15.71:0/3516631563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7448161d50 msgr2=0x7f74480cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:17.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7448161d50 0x7f74480cd400 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f744400cef0 tx=0x7f744400a710 comp rx=0 tx=0).stop 2024-04-20T21:20:17.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 -- 172.21.15.71:0/3516631563 shutdown_connections 2024-04-20T21:20:17.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f742c06c8f0 0x7f742c06edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:17.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7448161d50 0x7f74480cd400 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:17.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74480b3330 0x7f74480cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:17.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 --2- 172.21.15.71:0/3516631563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744806cde0 0x7f744814f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:17.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 -- 172.21.15.71:0/3516631563 >> 172.21.15.71:0/3516631563 conn(0x7f74480d4450 msgr2=0x7f74480d4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:17.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 -- 172.21.15.71:0/3516631563 shutdown_connections 2024-04-20T21:20:17.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:17.891+0000 7f744f200640 1 -- 172.21.15.71:0/3516631563 wait complete. 2024-04-20T21:20:17.908 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-20T21:20:17.908 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T21:20:17.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-20T21:20:17.909 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-20T21:20:17.909 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-20T21:20:17.909 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-20T21:20:17.909 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T21:20:17.909 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T21:20:17.909 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-20T21:20:17.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:17.909 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-20T21:20:17.964 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:20:17.964 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:20:17.964 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:20:17.964 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:17.964 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-20T21:20:17.964 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42696sec preferred_lft 42696sec 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:17.965 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-20T21:20:17.966 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether b6:95:eb:75:42:f7 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:20:17.966 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-20T21:20:17.966 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:17.966 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::587d:ccff:fe6d:760e/64 scope link 2024-04-20T21:20:17.966 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:17.966 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-20T21:20:17.966 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether b6:95:eb:75:42:f7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:17.966 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::b495:ebff:fe75:42f7/64 scope link 2024-04-20T21:20:17.966 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:17.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:17.967 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T21:20:18.046 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-20T21:20:18.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:18.050 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-20T21:20:18.102 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-20T21:20:18.102 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T21:20:18.102 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T21:20:18.102 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T21:20:18.102 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T21:20:18.103 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:18.103 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-20T21:20:18.103 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T21:20:18.103 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T21:20:18.103 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T21:20:18.103 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-20T21:20:18.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:18.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:18.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:18.311 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-20T21:20:18.357 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-20T21:20:18.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:18.358 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-04-20T21:20:18.456 INFO:teuthology.orchestra.run.smithi137.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-20T21:20:18.457 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:18.458 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-20T21:20:18.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-20T21:20:18.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-20T21:20:18.458 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-20T21:20:18.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:18.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:18.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:18.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-20T21:20:18.721 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:20:18.721 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:20:18.721 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:20:18.721 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:18.721 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-20T21:20:18.722 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:18.722 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-20T21:20:18.722 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether d6:65:bf:33:1d:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-20T21:20:18.722 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-20T21:20:18.722 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:18.722 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::d465:bfff:fe33:1db7/64 scope link 2024-04-20T21:20:18.722 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:18.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:18.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-20T21:20:18.802 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:20:18.803 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:20:18.803 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:20:18.803 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:18.803 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-20T21:20:18.803 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:18.803 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-20T21:20:18.803 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether d6:65:bf:33:1d:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-20T21:20:18.803 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-20T21:20:18.803 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:18.803 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::d465:bfff:fe33:1db7/64 scope link 2024-04-20T21:20:18.803 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:20:18.806 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-20T21:20:18.809 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:18.809 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-20T21:20:18.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-20T21:20:18.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-20T21:20:18.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-20T21:20:18.810 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-20T21:20:18.810 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-20T21:20:18.810 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-20T21:20:18.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:19.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:19.079 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:20:19.079 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-20T21:20:19.079 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.1 up 2024-04-20T21:20:19.079 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.1 master ceph-brx 2024-04-20T21:20:19.079 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-20T21:20:19.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:20:19.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:19.286 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-04-20T21:20:19.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:20:19.286 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-20T21:20:19.333 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-20T21:20:19.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:20:19.333 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-20T21:20:19.427 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-20T21:20:19.508 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:20:19.561 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/selinux 2024-04-20T21:20:19.562 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-20T21:20:19.563 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-4 2024-04-20T21:20:19.564 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-5 2024-04-20T21:20:19.564 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-6 2024-04-20T21:20:19.564 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-7 2024-04-20T21:20:19.564 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-20T21:20:19.564 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:19.564 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:19.564 INFO:teuthology.orchestra.run.smithi137.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-20T21:20:19.564 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-20T21:20:19.564 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-20T21:20:19.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:19.565 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-20T21:20:19.616 INFO:teuthology.orchestra.run.smithi137.stdout:40 2024-04-20T21:20:19.616 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2024-04-20T21:20:19.616 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-04-20T21:20:19.621 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-20T21:20:19.692 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:20:19.732 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-20T21:20:19.732 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-20T21:20:19.732 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-20T21:20:19.732 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/selinux 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-20T21:20:19.733 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-4 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-5 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-6 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-7 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-20T21:20:19.734 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-20T21:20:19.735 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-20T21:20:19.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:19.735 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-20T21:20:19.796 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi137.stderr:2024-04-20T21:20:19.796+0000 7fe97d3ff480 -1 init, newargv = 0x56441f0cc040 newargc=15 2024-04-20T21:20:19.796 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi137.stderr:ceph-fuse[28960]: starting ceph client 2024-04-20T21:20:19.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi137.stderr:ceph-fuse[28960]: starting fuse 2024-04-20T21:20:19.822 INFO:teuthology.orchestra.run.smithi137.stdout:40 2024-04-20T21:20:19.822 INFO:teuthology.orchestra.run.smithi137.stdout:43 2024-04-20T21:20:19.822 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 43] 2024-04-20T21:20:19.822 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-20T21:20:19.822 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-20T21:20:19.822 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-20T21:20:19.822 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-20T21:20:19.823 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-20T21:20:19.824 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-20T21:20:19.824 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-20T21:20:19.824 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-20T21:20:19.824 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-20T21:20:19.824 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.3")) 2024-04-20T21:20:19.824 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-20T21:20:20.018 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.3.28960.asok 2024-04-20T21:20:20.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-20T21:20:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:20:20.035 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.28960.asok 2024-04-20T21:20:20.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:20.036 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.28960.asok status 2024-04-20T21:20:20.257 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-20T21:20:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2024-04-20T21:20:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-20T21:20:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-20T21:20:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "3", 2024-04-20T21:20:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2024-04-20T21:20:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-04-20T21:20:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "28960", 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4672, 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 4672 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-20T21:20:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.2:0", 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 4104461503 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.2:0", 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 4104461503 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.4672 192.168.0.2:0/4104461503", 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "192.168.0.2:0/4104461503", 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 8, 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 27, 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2024-04-20T21:20:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "blocklisted": false, 2024-04-20T21:20:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2024-04-20T21:20:20.260 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-20T21:20:20.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:20.272 DEBUG:teuthology.orchestra.run.smithi071:> stat --file-system '--printf=%T 2024-04-20T21:20:20.272 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-20T21:20:20.331 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2024-04-20T21:20:20.332 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-20T21:20:20.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:20.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-20T21:20:20.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:20.416 DEBUG:teuthology.orchestra.run.smithi071:> stat --file-system '--printf=%T 2024-04-20T21:20:20.416 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-20T21:20:20.468 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2024-04-20T21:20:20.469 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-20T21:20:20.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:20.469 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-20T21:20:20.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:20.553 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2024-04-20T21:20:20.553 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-20T21:20:20.611 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2024-04-20T21:20:20.611 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-20T21:20:20.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:20.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-20T21:20:20.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:20.698 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2024-04-20T21:20:20.698 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.3 2024-04-20T21:20:20.752 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2024-04-20T21:20:20.752 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-04-20T21:20:20.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:20.753 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-20T21:20:20.835 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-20T21:20:20.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:21.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.065+0000 7f816be00640 1 Processor -- start 2024-04-20T21:20:21.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.065+0000 7f816be00640 1 -- start start 2024-04-20T21:20:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.067+0000 7f816be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f816c0b2f70 0x7f816c0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.067+0000 7f816be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f816c0adf60 0x7f816c15f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.067+0000 7f816be00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f816c071a80 con 0x7f816c15faf0 2024-04-20T21:20:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.067+0000 7f816be00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f816c0ae3f0 con 0x7f816c0b2f70 2024-04-20T21:20:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.067+0000 7f816be00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f816c071cf0 con 0x7f816c0adf60 2024-04-20T21:20:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.067+0000 7f816aa00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f816c0b2f70 0x7f816c0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.067+0000 7f816b400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f816c15faf0 0x7f816c06b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48136/0 (socket says 172.21.15.71:48136) 2024-04-20T21:20:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.067+0000 7f816b400640 1 -- 172.21.15.71:0/2141017099 learned_addr learned my addr 172.21.15.71:0/2141017099 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:21.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.068+0000 7f816a000640 1 --2- 172.21.15.71:0/2141017099 >> v2:172.21.15.137:3300/0 conn(0x7f816c0adf60 0x7f816c15f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.068+0000 7f8169600640 1 -- 172.21.15.71:0/2141017099 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393540744 0 0) 0x7f816c071a80 con 0x7f816c15faf0 2024-04-20T21:20:21.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.068+0000 7f8169600640 1 -- 172.21.15.71:0/2141017099 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8150003520 con 0x7f816c15faf0 2024-04-20T21:20:21.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.068+0000 7f816aa00640 1 -- 172.21.15.71:0/2141017099 >> v2:172.21.15.137:3300/0 conn(0x7f816c0adf60 msgr2=0x7f816c15f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:21.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.068+0000 7f816aa00640 1 --2- 172.21.15.71:0/2141017099 >> v2:172.21.15.137:3300/0 conn(0x7f816c0adf60 0x7f816c15f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.068+0000 7f816aa00640 1 -- 172.21.15.71:0/2141017099 >> v1:172.21.15.71:6789/0 conn(0x7f816c15faf0 legacy=0x7f816c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.068+0000 7f816aa00640 1 -- 172.21.15.71:0/2141017099 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816c071fd0 con 0x7f816c0b2f70 2024-04-20T21:20:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.069+0000 7f816aa00640 1 --2- 172.21.15.71:0/2141017099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816c0b2f70 0x7f816c0b4320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f816c0503d0 tx=0x7f815c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe0d10121f35302 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.069+0000 7f8169600640 1 -- 172.21.15.71:0/2141017099 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c035020 con 0x7f816c0b2f70 2024-04-20T21:20:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.069+0000 7f8169600640 1 -- 172.21.15.71:0/2141017099 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815c031830 con 0x7f816c0b2f70 2024-04-20T21:20:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.069+0000 7f8169600640 1 -- 172.21.15.71:0/2141017099 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c031c00 con 0x7f816c0b2f70 2024-04-20T21:20:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.070+0000 7f816be00640 1 -- 172.21.15.71:0/2141017099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816c0b2f70 msgr2=0x7f816c0b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.070+0000 7f816be00640 1 --2- 172.21.15.71:0/2141017099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816c0b2f70 0x7f816c0b4320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f816c0503d0 tx=0x7f815c02b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.070+0000 7f816be00640 1 -- 172.21.15.71:0/2141017099 shutdown_connections 2024-04-20T21:20:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.070+0000 7f816be00640 1 --2- 172.21.15.71:0/2141017099 >> v2:172.21.15.137:3300/0 conn(0x7f816c0adf60 0x7f816c15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.070+0000 7f816be00640 1 --2- 172.21.15.71:0/2141017099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816c0b2f70 0x7f816c0b4320 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.070+0000 7f816be00640 1 -- 172.21.15.71:0/2141017099 >> 172.21.15.71:0/2141017099 conn(0x7f816c0d0040 msgr2=0x7f816c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.070+0000 7f816be00640 1 -- 172.21.15.71:0/2141017099 shutdown_connections 2024-04-20T21:20:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.070+0000 7f816be00640 1 -- 172.21.15.71:0/2141017099 wait complete. 2024-04-20T21:20:21.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.072+0000 7f816be00640 1 Processor -- start 2024-04-20T21:20:21.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.072+0000 7f816be00640 1 -- start start 2024-04-20T21:20:21.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.073+0000 7f816be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f816c0adf60 0x7f816c1e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.073+0000 7f816be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f816c0b2f70 0x7f816c1574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.073+0000 7f816be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816c15faf0 0x7f816c157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.073+0000 7f816be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f816c06c010 con 0x7f816c15faf0 2024-04-20T21:20:21.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.073+0000 7f816be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f816c0736c0 con 0x7f816c0b2f70 2024-04-20T21:20:21.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.073+0000 7f816be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f816c06c190 con 0x7f816c0adf60 2024-04-20T21:20:21.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.073+0000 7f816b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816c15faf0 0x7f816c157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.073+0000 7f816b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816c15faf0 0x7f816c157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38108/0 (socket says 172.21.15.71:38108) 2024-04-20T21:20:21.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.073+0000 7f816b400640 1 -- 172.21.15.71:0/867067375 learned_addr learned my addr 172.21.15.71:0/867067375 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:21.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f816b400640 1 -- 172.21.15.71:0/867067375 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f816c0adf60 msgr2=0x7f816c1e5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f816b400640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f816c0adf60 0x7f816c1e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f816b400640 1 -- 172.21.15.71:0/867067375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f816c0b2f70 msgr2=0x7f816c1574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f816a000640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f816c0b2f70 0x7f816c1574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f816b400640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f816c0b2f70 0x7f816c1574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f816b400640 1 -- 172.21.15.71:0/867067375 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816c157290 con 0x7f816c15faf0 2024-04-20T21:20:21.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f816b400640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816c15faf0 0x7f816c157a10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f816400cb40 tx=0x7f816400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:21.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f8162a00640 1 -- 172.21.15.71:0/867067375 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164017070 con 0x7f816c15faf0 2024-04-20T21:20:21.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f8162a00640 1 -- 172.21.15.71:0/867067375 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f816400aca0 con 0x7f816c15faf0 2024-04-20T21:20:21.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f816be00640 1 -- 172.21.15.71:0/867067375 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816c1e66f0 con 0x7f816c15faf0 2024-04-20T21:20:21.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f8162a00640 1 -- 172.21.15.71:0/867067375 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164012620 con 0x7f816c15faf0 2024-04-20T21:20:21.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.074+0000 7f816be00640 1 -- 172.21.15.71:0/867067375 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f816c15bf60 con 0x7f816c15faf0 2024-04-20T21:20:21.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.075+0000 7f816be00640 1 -- 172.21.15.71:0/867067375 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f816c072360 con 0x7f816c15faf0 2024-04-20T21:20:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.076+0000 7f8162a00640 1 -- 172.21.15.71:0/867067375 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f816401a070 con 0x7f816c15faf0 2024-04-20T21:20:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.077+0000 7f8162a00640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f814c06c8f0 0x7f814c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.077+0000 7f8162a00640 1 -- 172.21.15.71:0/867067375 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f816408be70 con 0x7f816c15faf0 2024-04-20T21:20:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.078+0000 7f816aa00640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f814c06c8f0 0x7f814c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.078+0000 7f816aa00640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f814c06c8f0 0x7f814c06edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f815c036000 tx=0x7f815c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.082+0000 7f8162a00640 1 -- 172.21.15.71:0/867067375 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f816c072360 con 0x7f816c15faf0 2024-04-20T21:20:21.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.287+0000 7f816be00640 1 -- 172.21.15.71:0/867067375 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f816c15c160 con 0x7f816c15faf0 2024-04-20T21:20:21.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.289+0000 7f8162a00640 1 -- 172.21.15.71:0/867067375 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7f816c15c160 con 0x7f816c15faf0 2024-04-20T21:20:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:21.288 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:21.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.291+0000 7f816be00640 1 -- 172.21.15.71:0/867067375 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f814c06c8f0 msgr2=0x7f814c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.291+0000 7f816be00640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f814c06c8f0 0x7f814c06edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f815c036000 tx=0x7f815c030000 comp rx=0 tx=0).stop 2024-04-20T21:20:21.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.291+0000 7f816be00640 1 -- 172.21.15.71:0/867067375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816c15faf0 msgr2=0x7f816c157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.291+0000 7f816be00640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816c15faf0 0x7f816c157a10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f816400cb40 tx=0x7f816400a060 comp rx=0 tx=0).stop 2024-04-20T21:20:21.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.292+0000 7f816be00640 1 -- 172.21.15.71:0/867067375 shutdown_connections 2024-04-20T21:20:21.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.292+0000 7f816be00640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f814c06c8f0 0x7f814c06edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.292+0000 7f816be00640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816c15faf0 0x7f816c157a10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.292+0000 7f816be00640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f816c0b2f70 0x7f816c1574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.292+0000 7f816be00640 1 --2- 172.21.15.71:0/867067375 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f816c0adf60 0x7f816c1e5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.292+0000 7f816be00640 1 -- 172.21.15.71:0/867067375 >> 172.21.15.71:0/867067375 conn(0x7f816c0d0040 msgr2=0x7f816c06f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:21.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.292+0000 7f816be00640 1 -- 172.21.15.71:0/867067375 shutdown_connections 2024-04-20T21:20:21.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.292+0000 7f816be00640 1 -- 172.21.15.71:0/867067375 wait complete. 2024-04-20T21:20:21.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:21.310 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:21.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.519+0000 7f6827e00640 1 Processor -- start 2024-04-20T21:20:21.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.519+0000 7f6827e00640 1 -- start start 2024-04-20T21:20:21.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.521+0000 7f6827e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f682815a130 0x7f6828073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.521+0000 7f6827e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828071a60 0x7f68280739b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.521+0000 7f6827e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f682815cc20 con 0x7f682806f160 2024-04-20T21:20:21.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.521+0000 7f6827e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f682815d7f0 con 0x7f682815a130 2024-04-20T21:20:21.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.521+0000 7f6827e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f682815cec0 con 0x7f6828071a60 2024-04-20T21:20:21.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.521+0000 7f6827400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f682806f160 0x7f682806f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48146/0 (socket says 172.21.15.71:48146) 2024-04-20T21:20:21.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.521+0000 7f6827400640 1 -- 172.21.15.71:0/1874360130 learned_addr learned my addr 172.21.15.71:0/1874360130 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:21.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.521+0000 7f6826000640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828071a60 0x7f68280739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6826a00640 1 --2- 172.21.15.71:0/1874360130 >> v2:172.21.15.137:3300/0 conn(0x7f682815a130 0x7f6828073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880298231 0 0) 0x7f682815cc20 con 0x7f682806f160 2024-04-20T21:20:21.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f680c003520 con 0x7f682806f160 2024-04-20T21:20:21.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3336987396 0 0) 0x7f680c003520 con 0x7f682806f160 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828071a60 msgr2=0x7f68280739b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828071a60 0x7f68280739b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 >> v2:172.21.15.137:3300/0 conn(0x7f682815a130 msgr2=0x7f6828073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 --2- 172.21.15.71:0/1874360130 >> v2:172.21.15.137:3300/0 conn(0x7f682815a130 0x7f6828073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682815d1a0 con 0x7f682806f160 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f68200019f0 con 0x7f682806f160 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 >> v1:172.21.15.71:6789/0 conn(0x7f682806f160 legacy=0x7f682806f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f680c0039b0 0x7f680c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f680c004800 0x7f680c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828071a60 0x7f680c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f682815d7f0 con 0x7f680c004800 2024-04-20T21:20:21.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f682815cec0 con 0x7f680c0039b0 2024-04-20T21:20:21.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.522+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f680c00ba40 con 0x7f6828071a60 2024-04-20T21:20:21.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.523+0000 7f6826000640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f680c004800 0x7f680c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.523+0000 7f6826a00640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f680c0039b0 0x7f680c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.523+0000 7f6826000640 1 -- 172.21.15.71:0/1874360130 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828071a60 msgr2=0x7f680c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:21.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.523+0000 7f6826000640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828071a60 0x7f680c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.523+0000 7f6826000640 1 -- 172.21.15.71:0/1874360130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f680c0039b0 msgr2=0x7f680c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:21.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.523+0000 7f6826000640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f680c0039b0 0x7f680c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.523+0000 7f6826000640 1 -- 172.21.15.71:0/1874360130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c003520 con 0x7f680c004800 2024-04-20T21:20:21.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.523+0000 7f6826a00640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f680c0039b0 0x7f680c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:21.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.524+0000 7f6826000640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f680c004800 0x7f680c004c80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6814009ac0 tx=0x7f680c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752cc596480ee171 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:21.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.524+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814039070 con 0x7f680c004800 2024-04-20T21:20:21.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.524+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f681402c710 con 0x7f680c004800 2024-04-20T21:20:21.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.524+0000 7f6825600640 1 -- 172.21.15.71:0/1874360130 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814009690 con 0x7f680c004800 2024-04-20T21:20:21.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.525+0000 7f6827e00640 1 -- 172.21.15.71:0/1874360130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f680c004800 msgr2=0x7f680c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.525+0000 7f6827e00640 1 --2- 172.21.15.71:0/1874360130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f680c004800 0x7f680c004c80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6814009ac0 tx=0x7f680c005830 comp rx=0 tx=0).stop 2024-04-20T21:20:21.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.525+0000 7f6827400640 1 -- 172.21.15.71:0/1874360130 reap_dead start 2024-04-20T21:20:21.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.525+0000 7f6827e00640 1 -- 172.21.15.71:0/1874360130 shutdown_connections 2024-04-20T21:20:21.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.525+0000 7f6827e00640 1 -- 172.21.15.71:0/1874360130 >> 172.21.15.71:0/1874360130 conn(0x7f68280cffa0 msgr2=0x7f68280d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:21.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.525+0000 7f6827e00640 1 -- 172.21.15.71:0/1874360130 shutdown_connections 2024-04-20T21:20:21.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.525+0000 7f6827e00640 1 -- 172.21.15.71:0/1874360130 wait complete. 2024-04-20T21:20:21.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.527+0000 7f6827e00640 1 Processor -- start 2024-04-20T21:20:21.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.527+0000 7f6827e00640 1 -- start start 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.528+0000 7f6827e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f680c004800 0x7f682806c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.528+0000 7f6827e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68280b0c60 0x7f68280b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.528+0000 7f6827e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828153980 0x7f6828153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.528+0000 7f6827e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6828073b30 con 0x7f68280b0c60 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.528+0000 7f6827e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68280739b0 con 0x7f680c004800 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.528+0000 7f6827e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6828073cb0 con 0x7f6828153980 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.528+0000 7f6826000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68280b0c60 0x7f68280b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.529+0000 7f6826000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68280b0c60 0x7f68280b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38134/0 (socket says 172.21.15.71:38134) 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.529+0000 7f6826000640 1 -- 172.21.15.71:0/2968082568 learned_addr learned my addr 172.21.15.71:0/2968082568 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.529+0000 7f6826a00640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f680c004800 0x7f682806c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.529+0000 7f6827400640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828153980 0x7f6828153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.529+0000 7f6826000640 1 -- 172.21.15.71:0/2968082568 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828153980 msgr2=0x7f6828153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.529+0000 7f6826000640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828153980 0x7f6828153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.529+0000 7f6826000640 1 -- 172.21.15.71:0/2968082568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f680c004800 msgr2=0x7f682806c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.529+0000 7f6826000640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f680c004800 0x7f682806c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.529+0000 7f6826000640 1 -- 172.21.15.71:0/2968082568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6828154340 con 0x7f68280b0c60 2024-04-20T21:20:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.529+0000 7f6827400640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828153980 0x7f6828153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.529+0000 7f6826000640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68280b0c60 0x7f68280b10e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6814000c00 tx=0x7f6814004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.530+0000 7f681f400640 1 -- 172.21.15.71:0/2968082568 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814039050 con 0x7f68280b0c60 2024-04-20T21:20:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.530+0000 7f681f400640 1 -- 172.21.15.71:0/2968082568 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6814045070 con 0x7f68280b0c60 2024-04-20T21:20:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.530+0000 7f681f400640 1 -- 172.21.15.71:0/2968082568 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814003a50 con 0x7f68280b0c60 2024-04-20T21:20:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.530+0000 7f6827e00640 1 -- 172.21.15.71:0/2968082568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68280cd7f0 con 0x7f68280b0c60 2024-04-20T21:20:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.530+0000 7f6827e00640 1 -- 172.21.15.71:0/2968082568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68281f5360 con 0x7f68280b0c60 2024-04-20T21:20:21.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.531+0000 7f6827e00640 1 -- 172.21.15.71:0/2968082568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6828075b30 con 0x7f68280b0c60 2024-04-20T21:20:21.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.532+0000 7f681f400640 1 -- 172.21.15.71:0/2968082568 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6814003bf0 con 0x7f68280b0c60 2024-04-20T21:20:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.533+0000 7f681f400640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f680806c8f0 0x7f680806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.533+0000 7f681f400640 1 -- 172.21.15.71:0/2968082568 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f68140adad0 con 0x7f68280b0c60 2024-04-20T21:20:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.533+0000 7f6826a00640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f680806c8f0 0x7f680806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.534+0000 7f6826a00640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f680806c8f0 0x7f680806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6818009b20 tx=0x7f6818008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:21.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.538+0000 7f681f400640 1 -- 172.21.15.71:0/2968082568 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f681404e020 con 0x7f68280b0c60 2024-04-20T21:20:21.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.744+0000 7f6827e00640 1 -- 172.21.15.71:0/2968082568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6828074dd0 con 0x7f68280b0c60 2024-04-20T21:20:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.745+0000 7f681f400640 1 -- 172.21.15.71:0/2968082568 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f681407ba40 con 0x7f68280b0c60 2024-04-20T21:20:21.744 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 -- 172.21.15.71:0/2968082568 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f680806c8f0 msgr2=0x7f680806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f680806c8f0 0x7f680806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6818009b20 tx=0x7f6818008040 comp rx=0 tx=0).stop 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 -- 172.21.15.71:0/2968082568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68280b0c60 msgr2=0x7f68280b10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68280b0c60 0x7f68280b10e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6814000c00 tx=0x7f6814004730 comp rx=0 tx=0).stop 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 -- 172.21.15.71:0/2968082568 shutdown_connections 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f680806c8f0 0x7f680806edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6828153980 0x7f6828153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68280b0c60 0x7f68280b10e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 --2- 172.21.15.71:0/2968082568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f680c004800 0x7f682806c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 -- 172.21.15.71:0/2968082568 >> 172.21.15.71:0/2968082568 conn(0x7f68280cffa0 msgr2=0x7f68280ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 -- 172.21.15.71:0/2968082568 shutdown_connections 2024-04-20T21:20:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.748+0000 7f6827e00640 1 -- 172.21.15.71:0/2968082568 wait complete. 2024-04-20T21:20:21.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.971+0000 7f15fae00640 1 Processor -- start 2024-04-20T21:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.971+0000 7f15fae00640 1 -- start start 2024-04-20T21:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.973+0000 7f15fae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15f40d3b20 0x7f15f40b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.973+0000 7f15fae00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f15f406c010 0x7f15f40ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.973+0000 7f15fae00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f40d0980 con 0x7f15f4161a50 2024-04-20T21:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.973+0000 7f15fae00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f15f40d0c60 con 0x7f15f406c010 2024-04-20T21:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.973+0000 7f15fae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f15f4162ae0 con 0x7f15f40d3b20 2024-04-20T21:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.973+0000 7f15f9a00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f15f4161a50 0x7f15f406b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48160/0 (socket says 172.21.15.71:48160) 2024-04-20T21:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.973+0000 7f15f9a00640 1 -- 172.21.15.71:0/2029491380 learned_addr learned my addr 172.21.15.71:0/2029491380 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f9000640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15f40d3b20 0x7f15f40b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15fa400640 1 --2- 172.21.15.71:0/2029491380 >> v2:172.21.15.137:3300/0 conn(0x7f15f406c010 0x7f15f40ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518723069 0 0) 0x7f15f40d0980 con 0x7f15f4161a50 2024-04-20T21:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15dc003520 con 0x7f15f4161a50 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 611123956 0 0) 0x7f15dc003520 con 0x7f15f4161a50 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15f40d3b20 msgr2=0x7f15f40b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15f40d3b20 0x7f15f40b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 >> v2:172.21.15.137:3300/0 conn(0x7f15f406c010 msgr2=0x7f15f40ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 --2- 172.21.15.71:0/2029491380 >> v2:172.21.15.137:3300/0 conn(0x7f15f406c010 0x7f15f40ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f4162490 con 0x7f15f4161a50 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f15e8001670 con 0x7f15f4161a50 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 >> v1:172.21.15.71:6789/0 conn(0x7f15f4161a50 legacy=0x7f15f406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15dc0039b0 0x7f15dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15dc004800 0x7f15dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc005180 0x7f15dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f15f40d0c60 con 0x7f15dc005180 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f15f4162ae0 con 0x7f15dc0039b0 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.974+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f15dc00bf00 con 0x7f15dc004800 2024-04-20T21:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.975+0000 7f15fa400640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc005180 0x7f15dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.975+0000 7f15f9a00640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15dc0039b0 0x7f15dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.975+0000 7f15f9000640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15dc004800 0x7f15dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.975+0000 7f15fa400640 1 -- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15dc004800 msgr2=0x7f15dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.975+0000 7f15fa400640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15dc004800 0x7f15dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.975+0000 7f15fa400640 1 -- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15dc0039b0 msgr2=0x7f15dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.975+0000 7f15fa400640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15dc0039b0 0x7f15dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.975+0000 7f15fa400640 1 -- 172.21.15.71:0/2029491380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc003520 con 0x7f15dc005180 2024-04-20T21:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.975+0000 7f15f9000640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15dc004800 0x7f15dc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.975+0000 7f15f9a00640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15dc0039b0 0x7f15dc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.976+0000 7f15fa400640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc005180 0x7f15dc00b9c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009fc0 tx=0x7f15dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798dd91b391b9961 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.977+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec039070 con 0x7f15dc005180 2024-04-20T21:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.977+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ec02cc60 con 0x7f15dc005180 2024-04-20T21:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.977+0000 7f15f3e00640 1 -- 172.21.15.71:0/2029491380 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec009c10 con 0x7f15dc005180 2024-04-20T21:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.977+0000 7f15fae00640 1 -- 172.21.15.71:0/2029491380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc005180 msgr2=0x7f15dc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.977+0000 7f15fae00640 1 --2- 172.21.15.71:0/2029491380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc005180 0x7f15dc00b9c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009fc0 tx=0x7f15dc005830 comp rx=0 tx=0).stop 2024-04-20T21:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.977+0000 7f15fa400640 1 -- 172.21.15.71:0/2029491380 reap_dead start 2024-04-20T21:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.977+0000 7f15fae00640 1 -- 172.21.15.71:0/2029491380 shutdown_connections 2024-04-20T21:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.977+0000 7f15fae00640 1 -- 172.21.15.71:0/2029491380 >> 172.21.15.71:0/2029491380 conn(0x7f15f40d0ed0 msgr2=0x7f15f40d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.977+0000 7f15fae00640 1 -- 172.21.15.71:0/2029491380 shutdown_connections 2024-04-20T21:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.977+0000 7f15fae00640 1 -- 172.21.15.71:0/2029491380 wait complete. 2024-04-20T21:20:21.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.979+0000 7f15fae00640 1 Processor -- start 2024-04-20T21:20:21.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.979+0000 7f15fae00640 1 -- start start 2024-04-20T21:20:21.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.980+0000 7f15fae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15dc005180 0x7f15f414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.980+0000 7f15fae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f40cc5e0 0x7f15f40cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.980+0000 7f15fae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15f40ceb00 0x7f15f40cef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.980+0000 7f15fae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f15f40d0600 con 0x7f15f40cc5e0 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.980+0000 7f15fae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f15f40d0480 con 0x7f15f40ceb00 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.980+0000 7f15fae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f15f4161e30 con 0x7f15dc005180 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.980+0000 7f15f9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f40cc5e0 0x7f15f40cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.981+0000 7f15f9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f40cc5e0 0x7f15f40cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38154/0 (socket says 172.21.15.71:38154) 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.981+0000 7f15f9000640 1 -- 172.21.15.71:0/3790918675 learned_addr learned my addr 172.21.15.71:0/3790918675 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.981+0000 7f15f9a00640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15dc005180 0x7f15f414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.981+0000 7f15fa400640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15f40ceb00 0x7f15f40cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.981+0000 7f15f9000640 1 -- 172.21.15.71:0/3790918675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15dc005180 msgr2=0x7f15f414f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.981+0000 7f15f9000640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15dc005180 0x7f15f414f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.981+0000 7f15f9000640 1 -- 172.21.15.71:0/3790918675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15f40ceb00 msgr2=0x7f15f40cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.981+0000 7f15f9000640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15f40ceb00 0x7f15f40cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.981+0000 7f15f9000640 1 -- 172.21.15.71:0/3790918675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f414ede0 con 0x7f15f40cc5e0 2024-04-20T21:20:21.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.981+0000 7f15f9000640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f40cc5e0 0x7f15f40cca60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f15e00108e0 tx=0x7f15e0010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:21.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.981+0000 7f15f1600640 1 -- 172.21.15.71:0/3790918675 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e000f040 con 0x7f15f40cc5e0 2024-04-20T21:20:21.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.982+0000 7f15f1600640 1 -- 172.21.15.71:0/3790918675 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e000ec20 con 0x7f15f40cc5e0 2024-04-20T21:20:21.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.982+0000 7f15fae00640 1 -- 172.21.15.71:0/3790918675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f40ccfa0 con 0x7f15f40cc5e0 2024-04-20T21:20:21.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.982+0000 7f15f1600640 1 -- 172.21.15.71:0/3790918675 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e001c400 con 0x7f15f40cc5e0 2024-04-20T21:20:21.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.982+0000 7f15fae00640 1 -- 172.21.15.71:0/3790918675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f40cdd40 con 0x7f15f40cc5e0 2024-04-20T21:20:21.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.983+0000 7f15fae00640 1 -- 172.21.15.71:0/3790918675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f4075b30 con 0x7f15f40cc5e0 2024-04-20T21:20:21.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.984+0000 7f15f1600640 1 -- 172.21.15.71:0/3790918675 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15e001c5a0 con 0x7f15f40cc5e0 2024-04-20T21:20:21.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.985+0000 7f15f1600640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15d406c920 0x7f15d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:21.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.985+0000 7f15f1600640 1 -- 172.21.15.71:0/3790918675 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f15e008c7a0 con 0x7f15f40cc5e0 2024-04-20T21:20:21.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.985+0000 7f15f9a00640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15d406c920 0x7f15d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.986+0000 7f15f9a00640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15d406c920 0x7f15d406ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f15e8007930 tx=0x7f15e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:21.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:21.989+0000 7f15f1600640 1 -- 172.21.15.71:0/3790918675 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f15e0018030 con 0x7f15f40cc5e0 2024-04-20T21:20:22.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.189+0000 7f15fae00640 1 -- 172.21.15.71:0/3790918675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f15f406ba80 con 0x7f15f40cc5e0 2024-04-20T21:20:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.190+0000 7f15f1600640 1 -- 172.21.15.71:0/3790918675 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f15e005a710 con 0x7f15f40cc5e0 2024-04-20T21:20:22.189 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:22.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.193+0000 7f15fae00640 1 -- 172.21.15.71:0/3790918675 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15d406c920 msgr2=0x7f15d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:22.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.193+0000 7f15fae00640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15d406c920 0x7f15d406ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f15e8007930 tx=0x7f15e8009040 comp rx=0 tx=0).stop 2024-04-20T21:20:22.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.193+0000 7f15fae00640 1 -- 172.21.15.71:0/3790918675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f40cc5e0 msgr2=0x7f15f40cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:22.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.193+0000 7f15fae00640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f40cc5e0 0x7f15f40cca60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f15e00108e0 tx=0x7f15e0010da0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.193+0000 7f15fae00640 1 -- 172.21.15.71:0/3790918675 shutdown_connections 2024-04-20T21:20:22.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.193+0000 7f15fae00640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f15d406c920 0x7f15d406ede0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.193+0000 7f15fae00640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15f40ceb00 0x7f15f40cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.193+0000 7f15fae00640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f40cc5e0 0x7f15f40cca60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.193+0000 7f15fae00640 1 --2- 172.21.15.71:0/3790918675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15dc005180 0x7f15f414f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.193+0000 7f15fae00640 1 -- 172.21.15.71:0/3790918675 >> 172.21.15.71:0/3790918675 conn(0x7f15f40d0ed0 msgr2=0x7f15f40c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:22.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.194+0000 7f15fae00640 1 -- 172.21.15.71:0/3790918675 shutdown_connections 2024-04-20T21:20:22.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.194+0000 7f15fae00640 1 -- 172.21.15.71:0/3790918675 wait complete. 2024-04-20T21:20:22.211 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.418+0000 7fc0b6a00640 1 Processor -- start 2024-04-20T21:20:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.419+0000 7fc0b6a00640 1 -- start start 2024-04-20T21:20:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.420+0000 7fc0b6a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0b015b3b0 0x7fc0b006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.420+0000 7fc0b6a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc0b006dcb0 0x7fc0b0071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.420+0000 7fc0b6a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b0072090 0x7fc0b00d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.420+0000 7fc0b6a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b00ade40 con 0x7fc0b015b3b0 2024-04-20T21:20:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.420+0000 7fc0b6a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b00ae0e0 con 0x7fc0b006dcb0 2024-04-20T21:20:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.420+0000 7fc0b6a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b015b790 con 0x7fc0b0072090 2024-04-20T21:20:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.420+0000 7fc0afe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0b015b3b0 0x7fc0b006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.421+0000 7fc0afe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0b015b3b0 0x7fc0b006eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38158/0 (socket says 172.21.15.71:38158) 2024-04-20T21:20:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.421+0000 7fc0afe00640 1 -- 172.21.15.71:0/3001598614 learned_addr learned my addr 172.21.15.71:0/3001598614 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.421+0000 7fc0b4a00640 1 --2- 172.21.15.71:0/3001598614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b0072090 0x7fc0b00d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.421+0000 7fc0af400640 1 --2- 172.21.15.71:0/3001598614 >> v2:172.21.15.137:3300/0 conn(0x7fc0b006dcb0 0x7fc0b0071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.421+0000 7fc0afe00640 1 -- 172.21.15.71:0/3001598614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b0072090 msgr2=0x7fc0b00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.421+0000 7fc0afe00640 1 --2- 172.21.15.71:0/3001598614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b0072090 0x7fc0b00d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.421+0000 7fc0afe00640 1 -- 172.21.15.71:0/3001598614 >> v2:172.21.15.137:3300/0 conn(0x7fc0b006dcb0 msgr2=0x7fc0b0071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.421+0000 7fc0afe00640 1 --2- 172.21.15.71:0/3001598614 >> v2:172.21.15.137:3300/0 conn(0x7fc0b006dcb0 0x7fc0b0071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.421+0000 7fc0afe00640 1 -- 172.21.15.71:0/3001598614 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b00ae380 con 0x7fc0b015b3b0 2024-04-20T21:20:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.421+0000 7fc0af400640 1 --2- 172.21.15.71:0/3001598614 >> v2:172.21.15.137:3300/0 conn(0x7fc0b006dcb0 0x7fc0b0071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.421+0000 7fc0b4a00640 1 --2- 172.21.15.71:0/3001598614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b0072090 0x7fc0b00d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.422+0000 7fc0afe00640 1 --2- 172.21.15.71:0/3001598614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b015b3b0 0x7fc0b006eaa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00ad8d0 tx=0x7fc0a002e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912567c198ea62dc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.423+0000 7fc0aea00640 1 -- 172.21.15.71:0/3001598614 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a003b070 con 0x7fc0b015b3b0 2024-04-20T21:20:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.423+0000 7fc0aea00640 1 -- 172.21.15.71:0/3001598614 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a0036440 con 0x7fc0b015b3b0 2024-04-20T21:20:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.423+0000 7fc0aea00640 1 -- 172.21.15.71:0/3001598614 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0036810 con 0x7fc0b015b3b0 2024-04-20T21:20:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.423+0000 7fc0b6a00640 1 -- 172.21.15.71:0/3001598614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b015b3b0 msgr2=0x7fc0b006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.423+0000 7fc0b6a00640 1 --2- 172.21.15.71:0/3001598614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b015b3b0 0x7fc0b006eaa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00ad8d0 tx=0x7fc0a002e0d0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.423+0000 7fc0b6a00640 1 -- 172.21.15.71:0/3001598614 shutdown_connections 2024-04-20T21:20:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.423+0000 7fc0b6a00640 1 --2- 172.21.15.71:0/3001598614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b0072090 0x7fc0b00d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.423+0000 7fc0b6a00640 1 --2- 172.21.15.71:0/3001598614 >> v2:172.21.15.137:3300/0 conn(0x7fc0b006dcb0 0x7fc0b0071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.423+0000 7fc0b6a00640 1 --2- 172.21.15.71:0/3001598614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b015b3b0 0x7fc0b006eaa0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.423+0000 7fc0b6a00640 1 -- 172.21.15.71:0/3001598614 >> 172.21.15.71:0/3001598614 conn(0x7fc0b00b3350 msgr2=0x7fc0b00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.424+0000 7fc0b6a00640 1 -- 172.21.15.71:0/3001598614 shutdown_connections 2024-04-20T21:20:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.424+0000 7fc0b6a00640 1 -- 172.21.15.71:0/3001598614 wait complete. 2024-04-20T21:20:22.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.425+0000 7fc0b6a00640 1 Processor -- start 2024-04-20T21:20:22.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.425+0000 7fc0b6a00640 1 -- start start 2024-04-20T21:20:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.426+0000 7fc0b6a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b006dcb0 0x7fc0b014de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.426+0000 7fc0b6a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b015b3b0 0x7fc0b015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.426+0000 7fc0b6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0b015f5e0 0x7fc0b015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.426+0000 7fc0b6a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b00aec20 con 0x7fc0b015b3b0 2024-04-20T21:20:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.426+0000 7fc0b6a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b00ae940 con 0x7fc0b015f5e0 2024-04-20T21:20:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.426+0000 7fc0b6a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b006efe0 con 0x7fc0b006dcb0 2024-04-20T21:20:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0af400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b015b3b0 0x7fc0b015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0af400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b015b3b0 0x7fc0b015f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38174/0 (socket says 172.21.15.71:38174) 2024-04-20T21:20:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0af400640 1 -- 172.21.15.71:0/688106440 learned_addr learned my addr 172.21.15.71:0/688106440 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0af400640 1 -- 172.21.15.71:0/688106440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b006dcb0 msgr2=0x7fc0b014de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0afe00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b006dcb0 0x7fc0b014de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0b4a00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0b015f5e0 0x7fc0b015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0af400640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b006dcb0 0x7fc0b014de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0af400640 1 -- 172.21.15.71:0/688106440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0b015f5e0 msgr2=0x7fc0b015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0af400640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0b015f5e0 0x7fc0b015ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0af400640 1 -- 172.21.15.71:0/688106440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b015d770 con 0x7fc0b015b3b0 2024-04-20T21:20:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0b4a00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0b015f5e0 0x7fc0b015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.427+0000 7fc0af400640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b015b3b0 0x7fc0b015f0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc09800c7c0 tx=0x7fc09800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.428+0000 7fc0a7e00640 1 -- 172.21.15.71:0/688106440 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098015070 con 0x7fc0b015b3b0 2024-04-20T21:20:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.428+0000 7fc0a7e00640 1 -- 172.21.15.71:0/688106440 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc098007a30 con 0x7fc0b015b3b0 2024-04-20T21:20:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.428+0000 7fc0a7e00640 1 -- 172.21.15.71:0/688106440 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098007e00 con 0x7fc0b015b3b0 2024-04-20T21:20:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.428+0000 7fc0b6a00640 1 -- 172.21.15.71:0/688106440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b015da50 con 0x7fc0b015b3b0 2024-04-20T21:20:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.428+0000 7fc0b6a00640 1 -- 172.21.15.71:0/688106440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b015e010 con 0x7fc0b015b3b0 2024-04-20T21:20:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.429+0000 7fc0b6a00640 1 -- 172.21.15.71:0/688106440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b0068980 con 0x7fc0b015b3b0 2024-04-20T21:20:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.430+0000 7fc0a7e00640 1 -- 172.21.15.71:0/688106440 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc098018070 con 0x7fc0b015b3b0 2024-04-20T21:20:22.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.431+0000 7fc0a7e00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc08c06c8f0 0x7fc08c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.431+0000 7fc0a7e00640 1 -- 172.21.15.71:0/688106440 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fc09808bee0 con 0x7fc0b015b3b0 2024-04-20T21:20:22.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.431+0000 7fc0afe00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc08c06c8f0 0x7fc08c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.432+0000 7fc0afe00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc08c06c8f0 0x7fc08c06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0038000 tx=0x7fc0a0032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:22.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.435+0000 7fc0a7e00640 1 -- 172.21.15.71:0/688106440 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc098059ee0 con 0x7fc0b015b3b0 2024-04-20T21:20:22.578 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:20:22.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.635+0000 7fc0b6a00640 1 -- 172.21.15.71:0/688106440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc0b015f9c0 con 0x7fc0b015b3b0 2024-04-20T21:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.635+0000 7fc0a7e00640 1 -- 172.21.15.71:0/688106440 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fc0980597e0 con 0x7fc0b015b3b0 2024-04-20T21:20:22.634 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 -- 172.21.15.71:0/688106440 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc08c06c8f0 msgr2=0x7fc08c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc08c06c8f0 0x7fc08c06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0038000 tx=0x7fc0a0032000 comp rx=0 tx=0).stop 2024-04-20T21:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 -- 172.21.15.71:0/688106440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b015b3b0 msgr2=0x7fc0b015f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b015b3b0 0x7fc0b015f0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc09800c7c0 tx=0x7fc09800cc80 comp rx=0 tx=0).stop 2024-04-20T21:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 -- 172.21.15.71:0/688106440 shutdown_connections 2024-04-20T21:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc08c06c8f0 0x7fc08c06edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0b015f5e0 0x7fc0b015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b015b3b0 0x7fc0b015f0a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 --2- 172.21.15.71:0/688106440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b006dcb0 0x7fc0b014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 -- 172.21.15.71:0/688106440 >> 172.21.15.71:0/688106440 conn(0x7fc0b00b3350 msgr2=0x7fc0b0150120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 -- 172.21.15.71:0/688106440 shutdown_connections 2024-04-20T21:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.638+0000 7fc0b6a00640 1 -- 172.21.15.71:0/688106440 wait complete. 2024-04-20T21:20:22.655 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:22.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.843+0000 7f75d3400640 1 Processor -- start 2024-04-20T21:20:22.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.844+0000 7f75d3400640 1 -- start start 2024-04-20T21:20:22.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.845+0000 7f75d3400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc162c00 0x7f75cc0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.845+0000 7f75d3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f75cc06f090 0x7f75cc0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.845+0000 7f75d3400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75cc06df70 con 0x7f75cc06fc30 2024-04-20T21:20:22.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.845+0000 7f75d3400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f75cc162fe0 con 0x7f75cc06f090 2024-04-20T21:20:22.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.845+0000 7f75d3400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f75cc06ec00 con 0x7f75cc162c00 2024-04-20T21:20:22.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.846+0000 7f75cbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f75cc06f090 0x7f75cc0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.846+0000 7f75cbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f75cc06f090 0x7f75cc0d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:54646/0 (socket says 172.21.15.71:54646) 2024-04-20T21:20:22.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.846+0000 7f75cbe00640 1 -- 172.21.15.71:0/1162952808 learned_addr learned my addr 172.21.15.71:0/1162952808 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:22.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.846+0000 7f75d0a00640 1 --2- 172.21.15.71:0/1162952808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc162c00 0x7f75cc0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.847+0000 7f75d0a00640 1 -- 172.21.15.71:0/1162952808 >> v2:172.21.15.137:3300/0 conn(0x7f75cc06f090 msgr2=0x7f75cc0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:22.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.847+0000 7f75d0a00640 1 --2- 172.21.15.71:0/1162952808 >> v2:172.21.15.137:3300/0 conn(0x7f75cc06f090 0x7f75cc0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.847+0000 7f75d0a00640 1 -- 172.21.15.71:0/1162952808 >> v1:172.21.15.137:6789/0 conn(0x7f75cc06fc30 legacy=0x7f75cc06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:22.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.847+0000 7f75d0a00640 1 -- 172.21.15.71:0/1162952808 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc06e310 con 0x7f75cc162c00 2024-04-20T21:20:22.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.848+0000 7f75d0a00640 1 --2- 172.21.15.71:0/1162952808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc162c00 0x7f75cc0d0360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f75c00097a0 tx=0x7f75c002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed33cc1d926fde79 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:22.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.849+0000 7f75cb400640 1 -- 172.21.15.71:0/1162952808 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0031780 con 0x7f75cc162c00 2024-04-20T21:20:22.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.849+0000 7f75cb400640 1 -- 172.21.15.71:0/1162952808 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c0037070 con 0x7f75cc162c00 2024-04-20T21:20:22.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.849+0000 7f75cb400640 1 -- 172.21.15.71:0/1162952808 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0031b40 con 0x7f75cc162c00 2024-04-20T21:20:22.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.849+0000 7f75d3400640 1 -- 172.21.15.71:0/1162952808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc162c00 msgr2=0x7f75cc0d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:22.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.849+0000 7f75d3400640 1 --2- 172.21.15.71:0/1162952808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc162c00 0x7f75cc0d0360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f75c00097a0 tx=0x7f75c002b820 comp rx=0 tx=0).stop 2024-04-20T21:20:22.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.850+0000 7f75d3400640 1 -- 172.21.15.71:0/1162952808 shutdown_connections 2024-04-20T21:20:22.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.850+0000 7f75d3400640 1 --2- 172.21.15.71:0/1162952808 >> v2:172.21.15.137:3300/0 conn(0x7f75cc06f090 0x7f75cc0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.850+0000 7f75d3400640 1 --2- 172.21.15.71:0/1162952808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc162c00 0x7f75cc0d0360 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.850+0000 7f75d3400640 1 -- 172.21.15.71:0/1162952808 >> 172.21.15.71:0/1162952808 conn(0x7f75cc0b3350 msgr2=0x7f75cc0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:22.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.850+0000 7f75d3400640 1 -- 172.21.15.71:0/1162952808 shutdown_connections 2024-04-20T21:20:22.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.850+0000 7f75d3400640 1 -- 172.21.15.71:0/1162952808 wait complete. 2024-04-20T21:20:22.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.852+0000 7f75d3400640 1 Processor -- start 2024-04-20T21:20:22.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.852+0000 7f75d3400640 1 -- start start 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.854+0000 7f75d3400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc06f090 0x7f75cc06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.854+0000 7f75d3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75cc06fc30 0x7f75cc165800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.854+0000 7f75d3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75cc162c00 0x7f75cc0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.854+0000 7f75d3400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc06dbb0 con 0x7f75cc162c00 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.854+0000 7f75d3400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc06e890 con 0x7f75cc06fc30 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.854+0000 7f75d3400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f75cc06dd30 con 0x7f75cc06f090 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.854+0000 7f75d1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75cc162c00 0x7f75cc0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.854+0000 7f75d1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75cc162c00 0x7f75cc0cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38176/0 (socket says 172.21.15.71:38176) 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.854+0000 7f75d1400640 1 -- 172.21.15.71:0/3549418287 learned_addr learned my addr 172.21.15.71:0/3549418287 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.854+0000 7f75d0a00640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc06f090 0x7f75cc06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.854+0000 7f75cbe00640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75cc06fc30 0x7f75cc165800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.855+0000 7f75d1400640 1 -- 172.21.15.71:0/3549418287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc06f090 msgr2=0x7f75cc06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:22.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.855+0000 7f75d1400640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc06f090 0x7f75cc06bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.855+0000 7f75d1400640 1 -- 172.21.15.71:0/3549418287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75cc06fc30 msgr2=0x7f75cc165800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:22.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.855+0000 7f75d1400640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75cc06fc30 0x7f75cc165800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:22.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.855+0000 7f75d1400640 1 -- 172.21.15.71:0/3549418287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc1641c0 con 0x7f75cc162c00 2024-04-20T21:20:22.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.855+0000 7f75cbe00640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75cc06fc30 0x7f75cc165800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:20:22.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.855+0000 7f75d1400640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75cc162c00 0x7f75cc0cc370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c730 tx=0x7f75c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:22.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.856+0000 7f75c8c00640 1 -- 172.21.15.71:0/3549418287 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4003b70 con 0x7f75cc162c00 2024-04-20T21:20:22.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.856+0000 7f75c8c00640 1 -- 172.21.15.71:0/3549418287 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c4003d10 con 0x7f75cc162c00 2024-04-20T21:20:22.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.856+0000 7f75c8c00640 1 -- 172.21.15.71:0/3549418287 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4005310 con 0x7f75cc162c00 2024-04-20T21:20:22.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.856+0000 7f75d3400640 1 -- 172.21.15.71:0/3549418287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75cc1644a0 con 0x7f75cc162c00 2024-04-20T21:20:22.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.856+0000 7f75d3400640 1 -- 172.21.15.71:0/3549418287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75cc164a60 con 0x7f75cc162c00 2024-04-20T21:20:22.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.857+0000 7f75d3400640 1 -- 172.21.15.71:0/3549418287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75cc068980 con 0x7f75cc162c00 2024-04-20T21:20:22.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.858+0000 7f75c8c00640 1 -- 172.21.15.71:0/3549418287 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f75c40056c0 con 0x7f75cc162c00 2024-04-20T21:20:22.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.859+0000 7f75c8c00640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f75b006c8f0 0x7f75b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:22.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.859+0000 7f75c8c00640 1 -- 172.21.15.71:0/3549418287 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f75c408bef0 con 0x7f75cc162c00 2024-04-20T21:20:22.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.859+0000 7f75d0a00640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f75b006c8f0 0x7f75b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:22.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.860+0000 7f75d0a00640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f75b006c8f0 0x7f75b006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f75c0036000 tx=0x7f75c003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:22.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:22.863+0000 7f75c8c00640 1 -- 172.21.15.71:0/3549418287 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f75c4059f00 con 0x7f75cc162c00 2024-04-20T21:20:23.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.064+0000 7f75d3400640 1 -- 172.21.15.71:0/3549418287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f75cc0d09a0 con 0x7f75cc162c00 2024-04-20T21:20:23.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.065+0000 7f75c8c00640 1 -- 172.21.15.71:0/3549418287 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f75c4059800 con 0x7f75cc162c00 2024-04-20T21:20:23.063 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:23.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.067+0000 7f75d3400640 1 -- 172.21.15.71:0/3549418287 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f75b006c8f0 msgr2=0x7f75b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.067+0000 7f75d3400640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f75b006c8f0 0x7f75b006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f75c0036000 tx=0x7f75c003d040 comp rx=0 tx=0).stop 2024-04-20T21:20:23.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.067+0000 7f75d3400640 1 -- 172.21.15.71:0/3549418287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75cc162c00 msgr2=0x7f75cc0cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.067+0000 7f75d3400640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75cc162c00 0x7f75cc0cc370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c730 tx=0x7f75c400cbf0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.068+0000 7f75d3400640 1 -- 172.21.15.71:0/3549418287 shutdown_connections 2024-04-20T21:20:23.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.068+0000 7f75d3400640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f75b006c8f0 0x7f75b006edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.068+0000 7f75d3400640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75cc162c00 0x7f75cc0cc370 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.068+0000 7f75d3400640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75cc06fc30 0x7f75cc165800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.068+0000 7f75d3400640 1 --2- 172.21.15.71:0/3549418287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75cc06f090 0x7f75cc06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.068+0000 7f75d3400640 1 -- 172.21.15.71:0/3549418287 >> 172.21.15.71:0/3549418287 conn(0x7f75cc0b3350 msgr2=0x7f75cc0af230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:23.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.068+0000 7f75d3400640 1 -- 172.21.15.71:0/3549418287 shutdown_connections 2024-04-20T21:20:23.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.068+0000 7f75d3400640 1 -- 172.21.15.71:0/3549418287 wait complete. 2024-04-20T21:20:23.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.290+0000 7fafaa000640 1 Processor -- start 2024-04-20T21:20:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.291+0000 7fafaa000640 1 -- start start 2024-04-20T21:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.292+0000 7fafaa000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fafa415e960 0x7fafa40d4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.292+0000 7fafaa000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa40b6830 0x7fafa40d4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.292+0000 7fafaa000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa415ed40 con 0x7fafa40d1c10 2024-04-20T21:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.292+0000 7fafaa000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fafa40b6e90 con 0x7fafa415e960 2024-04-20T21:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.292+0000 7fafaa000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fafa40d0e50 con 0x7fafa40b6830 2024-04-20T21:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.292+0000 7fafa3400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fafa415e960 0x7fafa40d4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.292+0000 7fafa3400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fafa415e960 0x7fafa40d4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56814/0 (socket says 172.21.15.71:56814) 2024-04-20T21:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.292+0000 7fafa3400640 1 -- 172.21.15.71:0/3781734832 learned_addr learned my addr 172.21.15.71:0/3781734832 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.293+0000 7fafa3e00640 1 --2- 172.21.15.71:0/3781734832 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa40b6830 0x7fafa40d4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.293+0000 7fafa3400640 1 -- 172.21.15.71:0/3781734832 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa40b6830 msgr2=0x7fafa40d4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.293+0000 7fafa3400640 1 --2- 172.21.15.71:0/3781734832 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa40b6830 0x7fafa40d4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.293+0000 7fafa3400640 1 -- 172.21.15.71:0/3781734832 >> v1:172.21.15.137:6789/0 conn(0x7fafa40d1c10 legacy=0x7fafa40b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.293+0000 7fafa3400640 1 -- 172.21.15.71:0/3781734832 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa40d1130 con 0x7fafa415e960 2024-04-20T21:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.294+0000 7fafa3400640 1 --2- 172.21.15.71:0/3781734832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa415e960 0x7fafa40d4aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faf94009e50 tx=0x7faf9402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b643264a8c03f92e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.294+0000 7fafa2a00640 1 -- 172.21.15.71:0/3781734832 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9402ca70 con 0x7fafa415e960 2024-04-20T21:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.294+0000 7fafa2a00640 1 -- 172.21.15.71:0/3781734832 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf9402cc10 con 0x7fafa415e960 2024-04-20T21:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.294+0000 7fafa2a00640 1 -- 172.21.15.71:0/3781734832 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf940343f0 con 0x7fafa415e960 2024-04-20T21:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.295+0000 7fafaa000640 1 -- 172.21.15.71:0/3781734832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa415e960 msgr2=0x7fafa40d4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.295+0000 7fafaa000640 1 --2- 172.21.15.71:0/3781734832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa415e960 0x7fafa40d4aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faf94009e50 tx=0x7faf9402bed0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.295+0000 7fafaa000640 1 -- 172.21.15.71:0/3781734832 shutdown_connections 2024-04-20T21:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.295+0000 7fafaa000640 1 --2- 172.21.15.71:0/3781734832 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa40b6830 0x7fafa40d4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.295+0000 7fafaa000640 1 --2- 172.21.15.71:0/3781734832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa415e960 0x7fafa40d4aa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.295+0000 7fafaa000640 1 -- 172.21.15.71:0/3781734832 >> 172.21.15.71:0/3781734832 conn(0x7fafa40b96f0 msgr2=0x7fafa40b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.295+0000 7fafaa000640 1 -- 172.21.15.71:0/3781734832 shutdown_connections 2024-04-20T21:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.295+0000 7fafaa000640 1 -- 172.21.15.71:0/3781734832 wait complete. 2024-04-20T21:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.297+0000 7fafaa000640 1 Processor -- start 2024-04-20T21:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.297+0000 7fafaa000640 1 -- start start 2024-04-20T21:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.298+0000 7fafaa000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40b6830 0x7fafa41f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.298+0000 7fafaa000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa40d1c10 0x7fafa4158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.298+0000 7fafaa000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa415e960 0x7fafa414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.298+0000 7fafaa000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fafa40d3160 con 0x7fafa40b6830 2024-04-20T21:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.298+0000 7fafaa000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafa40d16f0 con 0x7fafa40d1c10 2024-04-20T21:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.298+0000 7fafaa000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fafa40d32e0 con 0x7fafa415e960 2024-04-20T21:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.298+0000 7fafa3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40b6830 0x7fafa41f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.299+0000 7fafa3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40b6830 0x7fafa41f4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56826/0 (socket says 172.21.15.71:56826) 2024-04-20T21:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.299+0000 7fafa3400640 1 -- 172.21.15.71:0/214436331 learned_addr learned my addr 172.21.15.71:0/214436331 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.299+0000 7fafa3400640 1 -- 172.21.15.71:0/214436331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa415e960 msgr2=0x7fafa414a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.299+0000 7fafa3400640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa415e960 0x7fafa414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.299+0000 7fafa3400640 1 -- 172.21.15.71:0/214436331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa40d1c10 msgr2=0x7fafa4158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.299+0000 7fafa3400640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa40d1c10 0x7fafa4158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.299+0000 7fafa3400640 1 -- 172.21.15.71:0/214436331 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa4160a30 con 0x7fafa40b6830 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.299+0000 7fafa3400640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40b6830 0x7fafa41f4580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faf94009e50 tx=0x7faf94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.299+0000 7faf9be00640 1 -- 172.21.15.71:0/214436331 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94043020 con 0x7fafa40b6830 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.300+0000 7faf9be00640 1 -- 172.21.15.71:0/214436331 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf9403e450 con 0x7fafa40b6830 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.300+0000 7faf9be00640 1 -- 172.21.15.71:0/214436331 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94009510 con 0x7fafa40b6830 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.300+0000 7fafaa000640 1 -- 172.21.15.71:0/214436331 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa4160d10 con 0x7fafa40b6830 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.300+0000 7fafaa000640 1 -- 172.21.15.71:0/214436331 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa41612d0 con 0x7fafa40b6830 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.301+0000 7fafaa000640 1 -- 172.21.15.71:0/214436331 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa4068980 con 0x7fafa40b6830 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.302+0000 7faf9be00640 1 -- 172.21.15.71:0/214436331 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf94046020 con 0x7fafa40b6830 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.302+0000 7faf9be00640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8006c8f0 0x7faf8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.303+0000 7faf9be00640 1 -- 172.21.15.71:0/214436331 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7faf940ae7b0 con 0x7fafa40b6830 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.303+0000 7faf9aa00640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8006c8f0 0x7faf8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.304+0000 7faf9aa00640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8006c8f0 0x7faf8006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fafa41f80d0 tx=0x7faf8c0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:23.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.307+0000 7faf9be00640 1 -- 172.21.15.71:0/214436331 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7faf9404d030 con 0x7fafa40b6830 2024-04-20T21:20:23.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.507+0000 7fafaa000640 1 -- 172.21.15.71:0/214436331 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafa40b39b0 con 0x7fafa40b6830 2024-04-20T21:20:23.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.509+0000 7faf9be00640 1 -- 172.21.15.71:0/214436331 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7faf9407c850 con 0x7fafa40b6830 2024-04-20T21:20:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:23.508 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.511+0000 7fafaa000640 1 -- 172.21.15.71:0/214436331 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8006c8f0 msgr2=0x7faf8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.511+0000 7fafaa000640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8006c8f0 0x7faf8006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fafa41f80d0 tx=0x7faf8c0079b0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.511+0000 7fafaa000640 1 -- 172.21.15.71:0/214436331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40b6830 msgr2=0x7fafa41f4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.511+0000 7fafaa000640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40b6830 0x7fafa41f4580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faf94009e50 tx=0x7faf94004a40 comp rx=0 tx=0).stop 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.512+0000 7fafaa000640 1 -- 172.21.15.71:0/214436331 shutdown_connections 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.512+0000 7fafaa000640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8006c8f0 0x7faf8006edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.512+0000 7fafaa000640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa415e960 0x7fafa414a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.512+0000 7fafaa000640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa40d1c10 0x7fafa4158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.512+0000 7fafaa000640 1 --2- 172.21.15.71:0/214436331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40b6830 0x7fafa41f4580 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.512+0000 7fafaa000640 1 -- 172.21.15.71:0/214436331 >> 172.21.15.71:0/214436331 conn(0x7fafa40b96f0 msgr2=0x7fafa40b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.512+0000 7fafaa000640 1 -- 172.21.15.71:0/214436331 shutdown_connections 2024-04-20T21:20:23.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.512+0000 7fafaa000640 1 -- 172.21.15.71:0/214436331 wait complete. 2024-04-20T21:20:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:23.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:23.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.722+0000 7fb25a600640 1 Processor -- start 2024-04-20T21:20:23.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.722+0000 7fb25a600640 1 -- start start 2024-04-20T21:20:23.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb25a600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb25415b3b0 0x7fb25406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb25a600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb25406dcb0 0x7fb254071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb25a600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb254072090 0x7fb2540d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb25a600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb2540ade40 con 0x7fb254072090 2024-04-20T21:20:23.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb25a600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb2540ae0e0 con 0x7fb25406dcb0 2024-04-20T21:20:23.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb25a600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb25415b790 con 0x7fb25415b3b0 2024-04-20T21:20:23.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb253e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb254072090 0x7fb2540d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:23.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb253e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb254072090 0x7fb2540d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56832/0 (socket says 172.21.15.71:56832) 2024-04-20T21:20:23.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb253e00640 1 -- 172.21.15.71:0/831601106 learned_addr learned my addr 172.21.15.71:0/831601106 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:23.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb252a00640 1 --2- 172.21.15.71:0/831601106 >> v2:172.21.15.137:3300/0 conn(0x7fb25406dcb0 0x7fb254071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:23.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb253e00640 1 -- 172.21.15.71:0/831601106 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb25415b3b0 msgr2=0x7fb25406eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:23.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb253e00640 1 --2- 172.21.15.71:0/831601106 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb25415b3b0 0x7fb25406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.724+0000 7fb253e00640 1 -- 172.21.15.71:0/831601106 >> v2:172.21.15.137:3300/0 conn(0x7fb25406dcb0 msgr2=0x7fb254071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:23.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.725+0000 7fb253e00640 1 --2- 172.21.15.71:0/831601106 >> v2:172.21.15.137:3300/0 conn(0x7fb25406dcb0 0x7fb254071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.725+0000 7fb253e00640 1 -- 172.21.15.71:0/831601106 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2540ae380 con 0x7fb254072090 2024-04-20T21:20:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.726+0000 7fb253e00640 1 --2- 172.21.15.71:0/831601106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb254072090 0x7fb2540d0360 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb25406d920 tx=0x7fb24c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562378ee8d245f65 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.726+0000 7fb252000640 1 -- 172.21.15.71:0/831601106 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c02ec80 con 0x7fb254072090 2024-04-20T21:20:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.726+0000 7fb252000640 1 -- 172.21.15.71:0/831601106 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c02ee20 con 0x7fb254072090 2024-04-20T21:20:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.726+0000 7fb252000640 1 -- 172.21.15.71:0/831601106 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c036610 con 0x7fb254072090 2024-04-20T21:20:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.726+0000 7fb25a600640 1 -- 172.21.15.71:0/831601106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb254072090 msgr2=0x7fb2540d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.726+0000 7fb25a600640 1 --2- 172.21.15.71:0/831601106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb254072090 0x7fb2540d0360 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb25406d920 tx=0x7fb24c02e0e0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.727+0000 7fb25a600640 1 -- 172.21.15.71:0/831601106 shutdown_connections 2024-04-20T21:20:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.727+0000 7fb25a600640 1 --2- 172.21.15.71:0/831601106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb254072090 0x7fb2540d0360 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.727+0000 7fb25a600640 1 --2- 172.21.15.71:0/831601106 >> v2:172.21.15.137:3300/0 conn(0x7fb25406dcb0 0x7fb254071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.727+0000 7fb25a600640 1 --2- 172.21.15.71:0/831601106 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb25415b3b0 0x7fb25406eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.727+0000 7fb25a600640 1 -- 172.21.15.71:0/831601106 >> 172.21.15.71:0/831601106 conn(0x7fb2540b3350 msgr2=0x7fb2540b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.727+0000 7fb25a600640 1 -- 172.21.15.71:0/831601106 shutdown_connections 2024-04-20T21:20:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.727+0000 7fb25a600640 1 -- 172.21.15.71:0/831601106 wait complete. 2024-04-20T21:20:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.728+0000 7fb25a600640 1 Processor -- start 2024-04-20T21:20:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.728+0000 7fb25a600640 1 -- start start 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.729+0000 7fb25a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb25406dcb0 0x7fb254150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.729+0000 7fb25a600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb25415b3b0 0x7fb2541ef0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.729+0000 7fb25a600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb25415e2a0 0x7fb2541ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.729+0000 7fb25a600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb2540aec20 con 0x7fb25415b3b0 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.729+0000 7fb25a600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb2540ae940 con 0x7fb25406dcb0 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.729+0000 7fb25a600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb25406efe0 con 0x7fb25415e2a0 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.730+0000 7fb252a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb25415b3b0 0x7fb2541ef0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.730+0000 7fb252a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb25415b3b0 0x7fb2541ef0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56834/0 (socket says 172.21.15.71:56834) 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.730+0000 7fb252a00640 1 -- 172.21.15.71:0/269864255 learned_addr learned my addr 172.21.15.71:0/269864255 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.730+0000 7fb253e00640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb25415e2a0 0x7fb2541ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.730+0000 7fb253400640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb25406dcb0 0x7fb254150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.730+0000 7fb252a00640 1 -- 172.21.15.71:0/269864255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb25415e2a0 msgr2=0x7fb2541ef610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.730+0000 7fb252a00640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb25415e2a0 0x7fb2541ef610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.730+0000 7fb252a00640 1 -- 172.21.15.71:0/269864255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb25406dcb0 msgr2=0x7fb254150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.730+0000 7fb252a00640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb25406dcb0 0x7fb254150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.730+0000 7fb252a00640 1 -- 172.21.15.71:0/269864255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2541f0180 con 0x7fb25415b3b0 2024-04-20T21:20:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.730+0000 7fb252a00640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb25415b3b0 0x7fb2541ef0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c7f0 tx=0x7fb24000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.731+0000 7fb24b400640 1 -- 172.21.15.71:0/269864255 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240015070 con 0x7fb25415b3b0 2024-04-20T21:20:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.731+0000 7fb24b400640 1 -- 172.21.15.71:0/269864255 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb240004240 con 0x7fb25415b3b0 2024-04-20T21:20:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.731+0000 7fb25a600640 1 -- 172.21.15.71:0/269864255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2541f0460 con 0x7fb25415b3b0 2024-04-20T21:20:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.731+0000 7fb24b400640 1 -- 172.21.15.71:0/269864255 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240007620 con 0x7fb25415b3b0 2024-04-20T21:20:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.731+0000 7fb25a600640 1 -- 172.21.15.71:0/269864255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2541f0d00 con 0x7fb25415b3b0 2024-04-20T21:20:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.732+0000 7fb25a600640 1 -- 172.21.15.71:0/269864255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2541f0630 con 0x7fb25415b3b0 2024-04-20T21:20:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.733+0000 7fb24b400640 1 -- 172.21.15.71:0/269864255 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2400079d0 con 0x7fb25415b3b0 2024-04-20T21:20:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.734+0000 7fb24b400640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb23406c8f0 0x7fb23406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.734+0000 7fb24b400640 1 -- 172.21.15.71:0/269864255 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fb24008c060 con 0x7fb25415b3b0 2024-04-20T21:20:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.734+0000 7fb253400640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb23406c8f0 0x7fb23406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.735+0000 7fb253400640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb23406c8f0 0x7fb23406edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb24400b810 tx=0x7fb244008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.738+0000 7fb24b400640 1 -- 172.21.15.71:0/269864255 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb240059980 con 0x7fb25415b3b0 2024-04-20T21:20:23.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.942+0000 7fb25a600640 1 -- 172.21.15.71:0/269864255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb254068980 con 0x7fb25415b3b0 2024-04-20T21:20:23.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.947+0000 7fb24b400640 1 -- 172.21.15.71:0/269864255 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fb24005dc80 con 0x7fb25415b3b0 2024-04-20T21:20:23.945 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:23.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.949+0000 7fb25a600640 1 -- 172.21.15.71:0/269864255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb23406c8f0 msgr2=0x7fb23406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.949+0000 7fb25a600640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb23406c8f0 0x7fb23406edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb24400b810 tx=0x7fb244008040 comp rx=0 tx=0).stop 2024-04-20T21:20:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.949+0000 7fb25a600640 1 -- 172.21.15.71:0/269864255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb25415b3b0 msgr2=0x7fb2541ef0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.949+0000 7fb25a600640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb25415b3b0 0x7fb2541ef0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c7f0 tx=0x7fb24000ccb0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.950+0000 7fb25a600640 1 -- 172.21.15.71:0/269864255 shutdown_connections 2024-04-20T21:20:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.950+0000 7fb25a600640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb23406c8f0 0x7fb23406edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.950+0000 7fb25a600640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb25415e2a0 0x7fb2541ef610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.950+0000 7fb25a600640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb25415b3b0 0x7fb2541ef0d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.950+0000 7fb25a600640 1 --2- 172.21.15.71:0/269864255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb25406dcb0 0x7fb254150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.950+0000 7fb25a600640 1 -- 172.21.15.71:0/269864255 >> 172.21.15.71:0/269864255 conn(0x7fb2540b3350 msgr2=0x7fb2540d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.950+0000 7fb25a600640 1 -- 172.21.15.71:0/269864255 shutdown_connections 2024-04-20T21:20:23.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:23.950+0000 7fb25a600640 1 -- 172.21.15.71:0/269864255 wait complete. 2024-04-20T21:20:23.968 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:24.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.174+0000 7f84cb200640 1 Processor -- start 2024-04-20T21:20:24.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.175+0000 7f84cb200640 1 -- start start 2024-04-20T21:20:24.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.176+0000 7f84cb200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f84c406dcb0 0x7f84c4071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.176+0000 7f84cb200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84c4072090 0x7f84c40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.176+0000 7f84cb200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c40ade40 con 0x7f84c415b3b0 2024-04-20T21:20:24.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.176+0000 7f84cb200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f84c406f1b0 con 0x7f84c406dcb0 2024-04-20T21:20:24.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.176+0000 7f84cb200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f84c40ae0e0 con 0x7f84c4072090 2024-04-20T21:20:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.177+0000 7f84c3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f84c406dcb0 0x7f84c4071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.177+0000 7f84c9200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84c4072090 0x7f84c40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.177+0000 7f84c3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f84c406dcb0 0x7f84c4071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:55540/0 (socket says 172.21.15.71:55540) 2024-04-20T21:20:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.177+0000 7f84c3400640 1 -- 172.21.15.71:0/3296771795 learned_addr learned my addr 172.21.15.71:0/3296771795 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.178+0000 7f84c9200640 1 -- 172.21.15.71:0/3296771795 >> v2:172.21.15.137:3300/0 conn(0x7f84c406dcb0 msgr2=0x7f84c4071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.178+0000 7f84c9200640 1 --2- 172.21.15.71:0/3296771795 >> v2:172.21.15.137:3300/0 conn(0x7f84c406dcb0 0x7f84c4071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.178+0000 7f84c9200640 1 -- 172.21.15.71:0/3296771795 >> v1:172.21.15.137:6789/0 conn(0x7f84c415b3b0 legacy=0x7f84c406eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.178+0000 7f84c9200640 1 -- 172.21.15.71:0/3296771795 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c415b790 con 0x7f84c4072090 2024-04-20T21:20:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.179+0000 7f84c9200640 1 --2- 172.21.15.71:0/3296771795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84c4072090 0x7f84c40d0360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0097a0 tx=0x7f84bc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5e94996361ab4ea server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.180+0000 7f84c2a00640 1 -- 172.21.15.71:0/3296771795 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc035020 con 0x7f84c4072090 2024-04-20T21:20:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.180+0000 7f84c2a00640 1 -- 172.21.15.71:0/3296771795 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc031810 con 0x7f84c4072090 2024-04-20T21:20:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.180+0000 7f84c2a00640 1 -- 172.21.15.71:0/3296771795 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc031be0 con 0x7f84c4072090 2024-04-20T21:20:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.180+0000 7f84cb200640 1 -- 172.21.15.71:0/3296771795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84c4072090 msgr2=0x7f84c40d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.180+0000 7f84cb200640 1 --2- 172.21.15.71:0/3296771795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84c4072090 0x7f84c40d0360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0097a0 tx=0x7f84bc02b8b0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.180+0000 7f84cb200640 1 -- 172.21.15.71:0/3296771795 shutdown_connections 2024-04-20T21:20:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.180+0000 7f84cb200640 1 --2- 172.21.15.71:0/3296771795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84c4072090 0x7f84c40d0360 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.180+0000 7f84cb200640 1 --2- 172.21.15.71:0/3296771795 >> v2:172.21.15.137:3300/0 conn(0x7f84c406dcb0 0x7f84c4071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.180+0000 7f84cb200640 1 -- 172.21.15.71:0/3296771795 >> 172.21.15.71:0/3296771795 conn(0x7f84c40b3350 msgr2=0x7f84c40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.181+0000 7f84cb200640 1 -- 172.21.15.71:0/3296771795 shutdown_connections 2024-04-20T21:20:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.181+0000 7f84cb200640 1 -- 172.21.15.71:0/3296771795 wait complete. 2024-04-20T21:20:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.182+0000 7f84cb200640 1 Processor -- start 2024-04-20T21:20:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.182+0000 7f84cb200640 1 -- start start 2024-04-20T21:20:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.183+0000 7f84cb200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84c406dcb0 0x7f84c4151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.183+0000 7f84cb200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84c415b3b0 0x7f84c415c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.183+0000 7f84cb200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84c4151960 0x7f84c415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.183+0000 7f84cb200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f84c40ae940 con 0x7f84c406dcb0 2024-04-20T21:20:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.183+0000 7f84cb200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84c40ae660 con 0x7f84c415b3b0 2024-04-20T21:20:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.183+0000 7f84cb200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f84c40aec20 con 0x7f84c4151960 2024-04-20T21:20:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.184+0000 7f84c3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84c406dcb0 0x7f84c4151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.184+0000 7f84c3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84c406dcb0 0x7f84c4151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56848/0 (socket says 172.21.15.71:56848) 2024-04-20T21:20:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.184+0000 7f84c3e00640 1 -- 172.21.15.71:0/686401178 learned_addr learned my addr 172.21.15.71:0/686401178 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.184+0000 7f84c3400640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84c415b3b0 0x7f84c415c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.184+0000 7f84c9200640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84c4151960 0x7f84c415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.184+0000 7f84c3e00640 1 -- 172.21.15.71:0/686401178 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84c4151960 msgr2=0x7f84c415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.184+0000 7f84c3e00640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84c4151960 0x7f84c415cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.184+0000 7f84c3e00640 1 -- 172.21.15.71:0/686401178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84c415b3b0 msgr2=0x7f84c415c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.184+0000 7f84c3e00640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84c415b3b0 0x7f84c415c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.184+0000 7f84c3e00640 1 -- 172.21.15.71:0/686401178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c415d290 con 0x7f84c406dcb0 2024-04-20T21:20:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.185+0000 7f84c3e00640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84c406dcb0 0x7f84c4151420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f84b400c3f0 tx=0x7f84b400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.185+0000 7f84bbe00640 1 -- 172.21.15.71:0/686401178 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b40052d0 con 0x7f84c406dcb0 2024-04-20T21:20:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.185+0000 7f84bbe00640 1 -- 172.21.15.71:0/686401178 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b4005490 con 0x7f84c406dcb0 2024-04-20T21:20:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.185+0000 7f84bbe00640 1 -- 172.21.15.71:0/686401178 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4007260 con 0x7f84c406dcb0 2024-04-20T21:20:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.185+0000 7f84cb200640 1 -- 172.21.15.71:0/686401178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c415d570 con 0x7f84c406dcb0 2024-04-20T21:20:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.185+0000 7f84cb200640 1 -- 172.21.15.71:0/686401178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c415db30 con 0x7f84c406dcb0 2024-04-20T21:20:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.186+0000 7f84cb200640 1 -- 172.21.15.71:0/686401178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c4068980 con 0x7f84c406dcb0 2024-04-20T21:20:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.187+0000 7f84bbe00640 1 -- 172.21.15.71:0/686401178 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84b4007400 con 0x7f84c406dcb0 2024-04-20T21:20:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.188+0000 7f84bbe00640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f84a006c8f0 0x7f84a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.188+0000 7f84bbe00640 1 -- 172.21.15.71:0/686401178 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f84b408b510 con 0x7f84c406dcb0 2024-04-20T21:20:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.188+0000 7f84c3400640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f84a006c8f0 0x7f84a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.189+0000 7f84c3400640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f84a006c8f0 0x7f84a006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f84c4157400 tx=0x7f84ac00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.192+0000 7f84bbe00640 1 -- 172.21.15.71:0/686401178 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f84b4059480 con 0x7f84c406dcb0 2024-04-20T21:20:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.392+0000 7f84cb200640 1 -- 172.21.15.71:0/686401178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f84c40d0580 con 0x7f84c406dcb0 2024-04-20T21:20:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.393+0000 7f84bbe00640 1 -- 172.21.15.71:0/686401178 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f84b4058d80 con 0x7f84c406dcb0 2024-04-20T21:20:24.392 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 -- 172.21.15.71:0/686401178 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f84a006c8f0 msgr2=0x7f84a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f84a006c8f0 0x7f84a006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f84c4157400 tx=0x7f84ac00b040 comp rx=0 tx=0).stop 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 -- 172.21.15.71:0/686401178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84c406dcb0 msgr2=0x7f84c4151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84c406dcb0 0x7f84c4151420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f84b400c3f0 tx=0x7f84b400c8b0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 -- 172.21.15.71:0/686401178 shutdown_connections 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f84a006c8f0 0x7f84a006edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84c4151960 0x7f84c415cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84c415b3b0 0x7f84c415c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 --2- 172.21.15.71:0/686401178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84c406dcb0 0x7f84c4151420 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 -- 172.21.15.71:0/686401178 >> 172.21.15.71:0/686401178 conn(0x7f84c40b3350 msgr2=0x7f84c40b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 -- 172.21.15.71:0/686401178 shutdown_connections 2024-04-20T21:20:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.396+0000 7f84cb200640 1 -- 172.21.15.71:0/686401178 wait complete. 2024-04-20T21:20:24.414 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:24.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.613+0000 7f2fe5600640 1 Processor -- start 2024-04-20T21:20:24.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.613+0000 7f2fe5600640 1 -- start start 2024-04-20T21:20:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.615+0000 7f2fe5600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2fe015ca40 0x7f2fe00ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.615+0000 7f2fe5600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe00ad8e0 0x7f2fe00d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.615+0000 7f2fe5600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe0141c60 con 0x7f2fe0156c20 2024-04-20T21:20:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.615+0000 7f2fe5600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe006c010 con 0x7f2fe015ca40 2024-04-20T21:20:24.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.615+0000 7f2fe5600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe015cf90 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.615+0000 7f2fdf400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe00ad8e0 0x7f2fe00d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.615+0000 7f2fde000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2fe015ca40 0x7f2fe00ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.615+0000 7f2fdf400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe00ad8e0 0x7f2fe00d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:38568/0 (socket says 172.21.15.71:38568) 2024-04-20T21:20:24.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.615+0000 7f2fdf400640 1 -- 172.21.15.71:0/3968549569 learned_addr learned my addr 172.21.15.71:0/3968549569 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:24.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.616+0000 7f2fdf400640 1 -- 172.21.15.71:0/3968549569 >> v2:172.21.15.137:3300/0 conn(0x7f2fe015ca40 msgr2=0x7f2fe00ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:24.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.616+0000 7f2fdf400640 1 --2- 172.21.15.71:0/3968549569 >> v2:172.21.15.137:3300/0 conn(0x7f2fe015ca40 0x7f2fe00ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.616+0000 7f2fdf400640 1 -- 172.21.15.71:0/3968549569 >> v1:172.21.15.137:6789/0 conn(0x7f2fe0156c20 legacy=0x7f2fe006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.616+0000 7f2fdf400640 1 -- 172.21.15.71:0/3968549569 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe015d270 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.616+0000 7f2fde000640 1 --2- 172.21.15.71:0/3968549569 >> v2:172.21.15.137:3300/0 conn(0x7f2fe015ca40 0x7f2fe00ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:20:24.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.618+0000 7f2fdf400640 1 --2- 172.21.15.71:0/3968549569 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe00ad8e0 0x7f2fe00d0360 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009870 tx=0x7f2fd802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31e024b71d94f85b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:24.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.618+0000 7f2fdd600640 1 -- 172.21.15.71:0/3968549569 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8034070 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.618+0000 7f2fdd600640 1 -- 172.21.15.71:0/3968549569 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd8030840 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.618+0000 7f2fdd600640 1 -- 172.21.15.71:0/3968549569 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8030c10 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.619+0000 7f2fe5600640 1 -- 172.21.15.71:0/3968549569 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe00ad8e0 msgr2=0x7f2fe00d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.619+0000 7f2fe5600640 1 --2- 172.21.15.71:0/3968549569 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe00ad8e0 0x7f2fe00d0360 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009870 tx=0x7f2fd802b980 comp rx=0 tx=0).stop 2024-04-20T21:20:24.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.619+0000 7f2fe5600640 1 -- 172.21.15.71:0/3968549569 shutdown_connections 2024-04-20T21:20:24.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.619+0000 7f2fe5600640 1 --2- 172.21.15.71:0/3968549569 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe00ad8e0 0x7f2fe00d0360 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.619+0000 7f2fe5600640 1 --2- 172.21.15.71:0/3968549569 >> v2:172.21.15.137:3300/0 conn(0x7f2fe015ca40 0x7f2fe00ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.619+0000 7f2fe5600640 1 -- 172.21.15.71:0/3968549569 >> 172.21.15.71:0/3968549569 conn(0x7f2fe00b3350 msgr2=0x7f2fe00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:24.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.619+0000 7f2fe5600640 1 -- 172.21.15.71:0/3968549569 shutdown_connections 2024-04-20T21:20:24.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.619+0000 7f2fe5600640 1 -- 172.21.15.71:0/3968549569 wait complete. 2024-04-20T21:20:24.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.621+0000 7f2fe5600640 1 Processor -- start 2024-04-20T21:20:24.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.621+0000 7f2fe5600640 1 -- start start 2024-04-20T21:20:24.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.622+0000 7f2fe5600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fe00ad8e0 0x7f2fe00cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.622+0000 7f2fe5600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe0156c20 0x7f2fe01f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.622+0000 7f2fe5600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe015ca40 0x7f2fe00992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.622+0000 7f2fe5600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe00d08a0 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.622+0000 7f2fe5600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe015d830 con 0x7f2fe015ca40 2024-04-20T21:20:24.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.622+0000 7f2fe5600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe00d0a20 con 0x7f2fe0156c20 2024-04-20T21:20:24.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.622+0000 7f2fdea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fe00ad8e0 0x7f2fe00cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.623+0000 7f2fde000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe0156c20 0x7f2fe01f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.623+0000 7f2fdea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fe00ad8e0 0x7f2fe00cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56852/0 (socket says 172.21.15.71:56852) 2024-04-20T21:20:24.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.623+0000 7f2fdea00640 1 -- 172.21.15.71:0/3000303985 learned_addr learned my addr 172.21.15.71:0/3000303985 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:24.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.623+0000 7f2fdf400640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe015ca40 0x7f2fe00992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.623+0000 7f2fdea00640 1 -- 172.21.15.71:0/3000303985 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe0156c20 msgr2=0x7f2fe01f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.623+0000 7f2fdea00640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe0156c20 0x7f2fe01f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.623+0000 7f2fdea00640 1 -- 172.21.15.71:0/3000303985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe015ca40 msgr2=0x7f2fe00992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.623+0000 7f2fdea00640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe015ca40 0x7f2fe00992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.623+0000 7f2fdea00640 1 -- 172.21.15.71:0/3000303985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe01f2bb0 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.623+0000 7f2fdf400640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe015ca40 0x7f2fe00992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:20:24.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.623+0000 7f2fdea00640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fe00ad8e0 0x7f2fe00cda20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000c7c0 tx=0x7f2fd000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:24.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.624+0000 7f2fd6a00640 1 -- 172.21.15.71:0/3000303985 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0016020 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.624+0000 7f2fd6a00640 1 -- 172.21.15.71:0/3000303985 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd0006d50 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.624+0000 7f2fd6a00640 1 -- 172.21.15.71:0/3000303985 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0003bb0 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.624+0000 7f2fe5600640 1 -- 172.21.15.71:0/3000303985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe00ce400 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.624+0000 7f2fe5600640 1 -- 172.21.15.71:0/3000303985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe00ce9c0 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.625+0000 7f2fe5600640 1 -- 172.21.15.71:0/3000303985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe0068980 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.626+0000 7f2fd6a00640 1 -- 172.21.15.71:0/3000303985 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fd000a850 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.627+0000 7f2fd6a00640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2fbc06c8f0 0x7f2fbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:24.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.627+0000 7f2fd6a00640 1 -- 172.21.15.71:0/3000303985 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f2fd008bc60 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.627+0000 7f2fde000640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2fbc06c8f0 0x7f2fbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:24.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.628+0000 7f2fde000640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2fbc06c8f0 0x7f2fbc06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009560 tx=0x7f2fc8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:24.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.632+0000 7f2fd6a00640 1 -- 172.21.15.71:0/3000303985 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2fd0020020 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.828+0000 7f2fe5600640 1 -- 172.21.15.71:0/3000303985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2fe00cfd90 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.829+0000 7f2fd6a00640 1 -- 172.21.15.71:0/3000303985 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f2fd0059bd0 con 0x7f2fe00ad8e0 2024-04-20T21:20:24.828 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 -- 172.21.15.71:0/3000303985 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2fbc06c8f0 msgr2=0x7f2fbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2fbc06c8f0 0x7f2fbc06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009560 tx=0x7f2fc8009190 comp rx=0 tx=0).stop 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 -- 172.21.15.71:0/3000303985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fe00ad8e0 msgr2=0x7f2fe00cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fe00ad8e0 0x7f2fe00cda20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000c7c0 tx=0x7f2fd000cc80 comp rx=0 tx=0).stop 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 -- 172.21.15.71:0/3000303985 shutdown_connections 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2fbc06c8f0 0x7f2fbc06edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe015ca40 0x7f2fe00992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe0156c20 0x7f2fe01f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 --2- 172.21.15.71:0/3000303985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fe00ad8e0 0x7f2fe00cda20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 -- 172.21.15.71:0/3000303985 >> 172.21.15.71:0/3000303985 conn(0x7f2fe00b3350 msgr2=0x7f2fe0154e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 -- 172.21.15.71:0/3000303985 shutdown_connections 2024-04-20T21:20:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:24.832+0000 7f2fe5600640 1 -- 172.21.15.71:0/3000303985 wait complete. 2024-04-20T21:20:24.850 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.045+0000 7f81d4600640 1 Processor -- start 2024-04-20T21:20:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.045+0000 7f81d4600640 1 -- start start 2024-04-20T21:20:25.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.047+0000 7f81d4600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f81cc06f090 0x7f81cc0ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.047+0000 7f81d4600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81cc06df70 con 0x7f81cc162c00 2024-04-20T21:20:25.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.047+0000 7f81d4600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81cc06e310 con 0x7f81cc0d0a70 2024-04-20T21:20:25.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.047+0000 7f81d4600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f81cc162fe0 con 0x7f81cc06f090 2024-04-20T21:20:25.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.047+0000 7f81d1c00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f81cc162c00 0x7f81cc0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51952/0 (socket says 172.21.15.71:51952) 2024-04-20T21:20:25.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.047+0000 7f81d1c00640 1 -- 172.21.15.71:0/914595804 learned_addr learned my addr 172.21.15.71:0/914595804 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:25.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.048+0000 7f81d2600640 1 --2- 172.21.15.71:0/914595804 >> v2:172.21.15.137:3300/0 conn(0x7f81cc06f090 0x7f81cc0ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.048+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056625154 0 0) 0x7f81cc06df70 con 0x7f81cc162c00 2024-04-20T21:20:25.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.048+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81b4003520 con 0x7f81cc162c00 2024-04-20T21:20:25.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.048+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2296095698 0 0) 0x7f81b4003520 con 0x7f81cc162c00 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.048+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 >> v2:172.21.15.137:3300/0 conn(0x7f81cc06f090 msgr2=0x7f81cc0ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.048+0000 7f81cbe00640 1 --2- 172.21.15.71:0/914595804 >> v2:172.21.15.137:3300/0 conn(0x7f81cc06f090 0x7f81cc0ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.048+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 >> v1:172.21.15.137:6789/0 conn(0x7f81cc0d0a70 legacy=0x7f81cc0ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.048+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81cc06e5b0 con 0x7f81cc162c00 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.048+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f81c0001670 con 0x7f81cc162c00 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.048+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 >> v1:172.21.15.71:6789/0 conn(0x7f81cc162c00 legacy=0x7f81cc0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.048+0000 7f81cbe00640 1 --2- 172.21.15.71:0/914595804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 0x7f81b4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81cbe00640 1 --2- 172.21.15.71:0/914595804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81b4004800 0x7f81b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81cbe00640 1 --2- 172.21.15.71:0/914595804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81b4005210 0x7f81b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81b400c110 con 0x7f81b40039b0 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81b400c2c0 con 0x7f81b4005210 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f81b400c4c0 con 0x7f81b4004800 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81d1c00640 1 --2- 172.21.15.71:0/914595804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 0x7f81b4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81d1c00640 1 -- 172.21.15.71:0/914595804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81b4004800 msgr2=0x7f81b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:25.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81d1c00640 1 --2- 172.21.15.71:0/914595804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81b4004800 0x7f81b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81d2600640 1 --2- 172.21.15.71:0/914595804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81b4005210 0x7f81b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81d1c00640 1 -- 172.21.15.71:0/914595804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81b4005210 msgr2=0x7f81b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:25.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81d1c00640 1 --2- 172.21.15.71:0/914595804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81b4005210 0x7f81b400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81d2600640 1 -- 172.21.15.71:0/914595804 reap_dead start 2024-04-20T21:20:25.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.049+0000 7f81d1c00640 1 -- 172.21.15.71:0/914595804 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b4003520 con 0x7f81b40039b0 2024-04-20T21:20:25.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.050+0000 7f81d1c00640 1 --2- 172.21.15.71:0/914595804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 0x7f81b4003df0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f81c000c240 tx=0x7f81b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f33ce39c7a5727 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:25.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.051+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0007cf0 con 0x7f81b40039b0 2024-04-20T21:20:25.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.051+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c0030070 con 0x7f81b40039b0 2024-04-20T21:20:25.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.051+0000 7f81cbe00640 1 -- 172.21.15.71:0/914595804 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0005d70 con 0x7f81b40039b0 2024-04-20T21:20:25.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.051+0000 7f81d4600640 1 -- 172.21.15.71:0/914595804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 msgr2=0x7f81b4003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.051+0000 7f81d4600640 1 --2- 172.21.15.71:0/914595804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 0x7f81b4003df0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f81c000c240 tx=0x7f81b4005830 comp rx=0 tx=0).stop 2024-04-20T21:20:25.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.051+0000 7f81d4600640 1 -- 172.21.15.71:0/914595804 shutdown_connections 2024-04-20T21:20:25.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.051+0000 7f81d4600640 1 --2- 172.21.15.71:0/914595804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 0x7f81b4003df0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.051+0000 7f81d4600640 1 -- 172.21.15.71:0/914595804 >> 172.21.15.71:0/914595804 conn(0x7f81cc0b3350 msgr2=0x7f81cc0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:25.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.051+0000 7f81d4600640 1 -- 172.21.15.71:0/914595804 shutdown_connections 2024-04-20T21:20:25.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.051+0000 7f81d4600640 1 -- 172.21.15.71:0/914595804 wait complete. 2024-04-20T21:20:25.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.053+0000 7f81d4600640 1 Processor -- start 2024-04-20T21:20:25.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.053+0000 7f81d4600640 1 -- start start 2024-04-20T21:20:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.054+0000 7f81d4600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 0x7f81cc1fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.054+0000 7f81d4600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81cc1657d0 0x7f81cc15dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.054+0000 7f81d4600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81cc09d470 0x7f81cc155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.054+0000 7f81d4600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc06dbb0 con 0x7f81b40039b0 2024-04-20T21:20:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.054+0000 7f81d4600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc06ec00 con 0x7f81cc09d470 2024-04-20T21:20:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.054+0000 7f81d4600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f81cc06dd30 con 0x7f81cc1657d0 2024-04-20T21:20:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.054+0000 7f81d1c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 0x7f81cc1fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d1c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 0x7f81cc1fc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56860/0 (socket says 172.21.15.71:56860) 2024-04-20T21:20:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d1c00640 1 -- 172.21.15.71:0/3539986815 learned_addr learned my addr 172.21.15.71:0/3539986815 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d2600640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81cc09d470 0x7f81cc155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d1200640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81cc1657d0 0x7f81cc15dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d1c00640 1 -- 172.21.15.71:0/3539986815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81cc1657d0 msgr2=0x7f81cc15dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d1c00640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81cc1657d0 0x7f81cc15dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d1c00640 1 -- 172.21.15.71:0/3539986815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81cc09d470 msgr2=0x7f81cc155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d1c00640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81cc09d470 0x7f81cc155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d1c00640 1 -- 172.21.15.71:0/3539986815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81cc09de70 con 0x7f81b40039b0 2024-04-20T21:20:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d1200640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81cc1657d0 0x7f81cc15dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d2600640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81cc09d470 0x7f81cc155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:25.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.055+0000 7f81d1c00640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 0x7f81cc1fc7e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f81c0001970 tx=0x7f81cc06d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.056+0000 7f81c9600640 1 -- 172.21.15.71:0/3539986815 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0045070 con 0x7f81b40039b0 2024-04-20T21:20:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.056+0000 7f81c9600640 1 -- 172.21.15.71:0/3539986815 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c0004bf0 con 0x7f81b40039b0 2024-04-20T21:20:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.056+0000 7f81c9600640 1 -- 172.21.15.71:0/3539986815 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0001c30 con 0x7f81b40039b0 2024-04-20T21:20:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.056+0000 7f81d4600640 1 -- 172.21.15.71:0/3539986815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81cc1fbd00 con 0x7f81b40039b0 2024-04-20T21:20:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.056+0000 7f81d4600640 1 -- 172.21.15.71:0/3539986815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81cc09e150 con 0x7f81b40039b0 2024-04-20T21:20:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.057+0000 7f81d4600640 1 -- 172.21.15.71:0/3539986815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81cc068980 con 0x7f81b40039b0 2024-04-20T21:20:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.058+0000 7f81c9600640 1 -- 172.21.15.71:0/3539986815 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f81c0007070 con 0x7f81b40039b0 2024-04-20T21:20:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.059+0000 7f81c9600640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f81ac06c920 0x7f81ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.059+0000 7f81c9600640 1 -- 172.21.15.71:0/3539986815 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f81c00acee0 con 0x7f81b40039b0 2024-04-20T21:20:25.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.059+0000 7f81d1200640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f81ac06c920 0x7f81ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.060+0000 7f81d1200640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f81ac06c920 0x7f81ac06ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f81cc15cc60 tx=0x7f81b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:25.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.064+0000 7f81c9600640 1 -- 172.21.15.71:0/3539986815 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f81c007ae50 con 0x7f81b40039b0 2024-04-20T21:20:25.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.262+0000 7f81d4600640 1 -- 172.21.15.71:0/3539986815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f81cc166080 con 0x7f81b40039b0 2024-04-20T21:20:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.262+0000 7f81c9600640 1 -- 172.21.15.71:0/3539986815 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f81c007a750 con 0x7f81b40039b0 2024-04-20T21:20:25.261 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 -- 172.21.15.71:0/3539986815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f81ac06c920 msgr2=0x7f81ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f81ac06c920 0x7f81ac06ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f81cc15cc60 tx=0x7f81b8009040 comp rx=0 tx=0).stop 2024-04-20T21:20:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 -- 172.21.15.71:0/3539986815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 msgr2=0x7f81cc1fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 0x7f81cc1fc7e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f81c0001970 tx=0x7f81cc06d380 comp rx=0 tx=0).stop 2024-04-20T21:20:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 -- 172.21.15.71:0/3539986815 shutdown_connections 2024-04-20T21:20:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f81ac06c920 0x7f81ac06ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81cc09d470 0x7f81cc155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81cc1657d0 0x7f81cc15dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 --2- 172.21.15.71:0/3539986815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b40039b0 0x7f81cc1fc7e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 -- 172.21.15.71:0/3539986815 >> 172.21.15.71:0/3539986815 conn(0x7f81cc0b3350 msgr2=0x7f81cc160070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 -- 172.21.15.71:0/3539986815 shutdown_connections 2024-04-20T21:20:25.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.265+0000 7f81d4600640 1 -- 172.21.15.71:0/3539986815 wait complete. 2024-04-20T21:20:25.284 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:25.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.482+0000 7f3e14000640 1 Processor -- start 2024-04-20T21:20:25.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.482+0000 7f3e14000640 1 -- start start 2024-04-20T21:20:25.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.483+0000 7f3e14000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3e0c15ca40 0x7f3e0c0ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.483+0000 7f3e14000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e0c0ad8e0 0x7f3e0c0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.484+0000 7f3e14000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0c141c60 con 0x7f3e0c156c20 2024-04-20T21:20:25.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.484+0000 7f3e14000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3e0c06c010 con 0x7f3e0c15ca40 2024-04-20T21:20:25.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.484+0000 7f3e14000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0c15cf90 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.484+0000 7f3e10c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3e0c15ca40 0x7f3e0c0ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.484+0000 7f3e10c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3e0c15ca40 0x7f3e0c0ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56874/0 (socket says 172.21.15.71:56874) 2024-04-20T21:20:25.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.484+0000 7f3e10c00640 1 -- 172.21.15.71:0/3197692567 learned_addr learned my addr 172.21.15.71:0/3197692567 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:25.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.484+0000 7f3e12000640 1 --2- 172.21.15.71:0/3197692567 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e0c0ad8e0 0x7f3e0c0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.484+0000 7f3e10c00640 1 -- 172.21.15.71:0/3197692567 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e0c0ad8e0 msgr2=0x7f3e0c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:25.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.485+0000 7f3e10c00640 1 --2- 172.21.15.71:0/3197692567 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e0c0ad8e0 0x7f3e0c0d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.485+0000 7f3e10c00640 1 -- 172.21.15.71:0/3197692567 >> v1:172.21.15.137:6789/0 conn(0x7f3e0c156c20 legacy=0x7f3e0c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:25.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.485+0000 7f3e10c00640 1 -- 172.21.15.71:0/3197692567 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c15d270 con 0x7f3e0c15ca40 2024-04-20T21:20:25.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.486+0000 7f3e10c00640 1 --2- 172.21.15.71:0/3197692567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e0c15ca40 0x7f3e0c0ad3a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3df8009870 tx=0x7f3df802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5a9ac67b64ad90 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:25.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.486+0000 7f3e0be00640 1 -- 172.21.15.71:0/3197692567 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8035020 con 0x7f3e0c15ca40 2024-04-20T21:20:25.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.486+0000 7f3e0be00640 1 -- 172.21.15.71:0/3197692567 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df8031640 con 0x7f3e0c15ca40 2024-04-20T21:20:25.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.486+0000 7f3e0be00640 1 -- 172.21.15.71:0/3197692567 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df802d040 con 0x7f3e0c15ca40 2024-04-20T21:20:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.487+0000 7f3e14000640 1 -- 172.21.15.71:0/3197692567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e0c15ca40 msgr2=0x7f3e0c0ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.487+0000 7f3e14000640 1 --2- 172.21.15.71:0/3197692567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e0c15ca40 0x7f3e0c0ad3a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3df8009870 tx=0x7f3df802b8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.487+0000 7f3e14000640 1 -- 172.21.15.71:0/3197692567 shutdown_connections 2024-04-20T21:20:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.487+0000 7f3e14000640 1 --2- 172.21.15.71:0/3197692567 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e0c0ad8e0 0x7f3e0c0d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.487+0000 7f3e14000640 1 --2- 172.21.15.71:0/3197692567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e0c15ca40 0x7f3e0c0ad3a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.487+0000 7f3e14000640 1 -- 172.21.15.71:0/3197692567 >> 172.21.15.71:0/3197692567 conn(0x7f3e0c0b3350 msgr2=0x7f3e0c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.487+0000 7f3e14000640 1 -- 172.21.15.71:0/3197692567 shutdown_connections 2024-04-20T21:20:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.487+0000 7f3e14000640 1 -- 172.21.15.71:0/3197692567 wait complete. 2024-04-20T21:20:25.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.489+0000 7f3e14000640 1 Processor -- start 2024-04-20T21:20:25.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.489+0000 7f3e14000640 1 -- start start 2024-04-20T21:20:25.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.491+0000 7f3e14000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e0c0ad8e0 0x7f3e0c1f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.491+0000 7f3e14000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e0c156c20 0x7f3e0c06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.491+0000 7f3e14000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e0c15ca40 0x7f3e0c0b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.491+0000 7f3e14000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c0d08a0 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.491+0000 7f3e14000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c15d830 con 0x7f3e0c15ca40 2024-04-20T21:20:25.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.491+0000 7f3e14000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0c0d0a20 con 0x7f3e0c156c20 2024-04-20T21:20:25.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.491+0000 7f3e11600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e0c0ad8e0 0x7f3e0c1f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.491+0000 7f3e11600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e0c0ad8e0 0x7f3e0c1f4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56886/0 (socket says 172.21.15.71:56886) 2024-04-20T21:20:25.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.491+0000 7f3e11600640 1 -- 172.21.15.71:0/2842957618 learned_addr learned my addr 172.21.15.71:0/2842957618 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.491+0000 7f3e10c00640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e0c156c20 0x7f3e0c06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.491+0000 7f3e12000640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e0c15ca40 0x7f3e0c0b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.492+0000 7f3e11600640 1 -- 172.21.15.71:0/2842957618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e0c156c20 msgr2=0x7f3e0c06e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.492+0000 7f3e11600640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e0c156c20 0x7f3e0c06e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.492+0000 7f3e11600640 1 -- 172.21.15.71:0/2842957618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e0c15ca40 msgr2=0x7f3e0c0b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.492+0000 7f3e11600640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e0c15ca40 0x7f3e0c0b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.492+0000 7f3e11600640 1 -- 172.21.15.71:0/2842957618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c0ccbd0 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.492+0000 7f3e12000640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e0c15ca40 0x7f3e0c0b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.492+0000 7f3e11600640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e0c0ad8e0 0x7f3e0c1f4380 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c430 tx=0x7f3e0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.492+0000 7f3e09600640 1 -- 172.21.15.71:0/2842957618 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00011790 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.492+0000 7f3e09600640 1 -- 172.21.15.71:0/2842957618 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e00017070 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.492+0000 7f3e09600640 1 -- 172.21.15.71:0/2842957618 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00011b70 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.492+0000 7f3e14000640 1 -- 172.21.15.71:0/2842957618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c0cce40 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.493+0000 7f3e14000640 1 -- 172.21.15.71:0/2842957618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c151c40 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.494+0000 7f3e14000640 1 -- 172.21.15.71:0/2842957618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0c068980 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.495+0000 7f3e09600640 1 -- 172.21.15.71:0/2842957618 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e00011d10 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.496+0000 7f3e09600640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3dec06c8f0 0x7f3dec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.496+0000 7f3e09600640 1 -- 172.21.15.71:0/2842957618 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f3e0008bdd0 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.496+0000 7f3e10c00640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3dec06c8f0 0x7f3dec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.497+0000 7f3e10c00640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3dec06c8f0 0x7f3dec06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3df8036000 tx=0x7f3df803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:25.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.500+0000 7f3e09600640 1 -- 172.21.15.71:0/2842957618 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3e00059dd0 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.703+0000 7f3e14000640 1 -- 172.21.15.71:0/2842957618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e0c0cfd90 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.706+0000 7f3e09600640 1 -- 172.21.15.71:0/2842957618 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7f3e000596d0 con 0x7f3e0c0ad8e0 2024-04-20T21:20:25.705 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:25.705 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:25.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.708+0000 7f3e14000640 1 -- 172.21.15.71:0/2842957618 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3dec06c8f0 msgr2=0x7f3dec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.708+0000 7f3e14000640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3dec06c8f0 0x7f3dec06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3df8036000 tx=0x7f3df803c040 comp rx=0 tx=0).stop 2024-04-20T21:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.708+0000 7f3e14000640 1 -- 172.21.15.71:0/2842957618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e0c0ad8e0 msgr2=0x7f3e0c1f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.708+0000 7f3e14000640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e0c0ad8e0 0x7f3e0c1f4380 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c430 tx=0x7f3e0000c8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.708+0000 7f3e14000640 1 -- 172.21.15.71:0/2842957618 shutdown_connections 2024-04-20T21:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.708+0000 7f3e14000640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3dec06c8f0 0x7f3dec06edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.708+0000 7f3e14000640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e0c15ca40 0x7f3e0c0b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.708+0000 7f3e14000640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e0c156c20 0x7f3e0c06e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.708+0000 7f3e14000640 1 --2- 172.21.15.71:0/2842957618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e0c0ad8e0 0x7f3e0c1f4380 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.708+0000 7f3e14000640 1 -- 172.21.15.71:0/2842957618 >> 172.21.15.71:0/2842957618 conn(0x7f3e0c0b3350 msgr2=0x7f3e0c150ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.709+0000 7f3e14000640 1 -- 172.21.15.71:0/2842957618 shutdown_connections 2024-04-20T21:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.709+0000 7f3e14000640 1 -- 172.21.15.71:0/2842957618 wait complete. 2024-04-20T21:20:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:25.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:25.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.929+0000 7f378ce00640 1 Processor -- start 2024-04-20T21:20:25.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.929+0000 7f378ce00640 1 -- start start 2024-04-20T21:20:25.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.930+0000 7f378ce00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3788071a60 0x7f3788167390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.931+0000 7f378ce00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378815cc20 con 0x7f378815a130 2024-04-20T21:20:25.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.931+0000 7f378ce00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378815cec0 con 0x7f3788073b80 2024-04-20T21:20:25.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.931+0000 7f378ce00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f378815d7f0 con 0x7f3788071a60 2024-04-20T21:20:25.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.931+0000 7f3787e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3788071a60 0x7f3788167390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.931+0000 7f3787400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f378815a130 0x7f3788073470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51958/0 (socket says 172.21.15.71:51958) 2024-04-20T21:20:25.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.931+0000 7f3787400640 1 -- 172.21.15.71:0/406078591 learned_addr learned my addr 172.21.15.71:0/406078591 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.931+0000 7f3787e00640 1 -- 172.21.15.71:0/406078591 >> v1:172.21.15.137:6789/0 conn(0x7f3788073b80 legacy=0x7f378806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.931+0000 7f3787e00640 1 -- 172.21.15.71:0/406078591 >> v1:172.21.15.71:6789/0 conn(0x7f378815a130 legacy=0x7f3788073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.932+0000 7f3787e00640 1 -- 172.21.15.71:0/406078591 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378815d1a0 con 0x7f3788071a60 2024-04-20T21:20:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.932+0000 7f3786a00640 1 -- 172.21.15.71:0/406078591 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615262782 0 0) 0x7f378815cc20 con 0x7f378815a130 2024-04-20T21:20:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.933+0000 7f3787e00640 1 --2- 172.21.15.71:0/406078591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3788071a60 0x7f3788167390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3780009d90 tx=0x7f378002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dd539991c577de server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.933+0000 7f3786a00640 1 -- 172.21.15.71:0/406078591 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780039070 con 0x7f3788071a60 2024-04-20T21:20:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.933+0000 7f3786a00640 1 -- 172.21.15.71:0/406078591 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378002cbd0 con 0x7f3788071a60 2024-04-20T21:20:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.933+0000 7f3786a00640 1 -- 172.21.15.71:0/406078591 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780034440 con 0x7f3788071a60 2024-04-20T21:20:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.934+0000 7f378ce00640 1 -- 172.21.15.71:0/406078591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3788071a60 msgr2=0x7f3788167390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.934+0000 7f378ce00640 1 --2- 172.21.15.71:0/406078591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3788071a60 0x7f3788167390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3780009d90 tx=0x7f378002be20 comp rx=0 tx=0).stop 2024-04-20T21:20:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.934+0000 7f378ce00640 1 -- 172.21.15.71:0/406078591 shutdown_connections 2024-04-20T21:20:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.934+0000 7f378ce00640 1 --2- 172.21.15.71:0/406078591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3788071a60 0x7f3788167390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.934+0000 7f378ce00640 1 -- 172.21.15.71:0/406078591 >> 172.21.15.71:0/406078591 conn(0x7f37880cffa0 msgr2=0x7f37880d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.934+0000 7f378ce00640 1 -- 172.21.15.71:0/406078591 shutdown_connections 2024-04-20T21:20:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.934+0000 7f378ce00640 1 -- 172.21.15.71:0/406078591 wait complete. 2024-04-20T21:20:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.936+0000 7f378ce00640 1 Processor -- start 2024-04-20T21:20:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.936+0000 7f378ce00640 1 -- start start 2024-04-20T21:20:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.937+0000 7f378ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3788071a60 0x7f3788147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.937+0000 7f378ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3788073b80 0x7f37880b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.937+0000 7f378ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f378815a130 0x7f3788153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.937+0000 7f378ce00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f378806f9f0 con 0x7f3788071a60 2024-04-20T21:20:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.937+0000 7f378ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f378806f870 con 0x7f3788073b80 2024-04-20T21:20:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.937+0000 7f378ce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f378806fb70 con 0x7f378815a130 2024-04-20T21:20:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.937+0000 7f3787400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3788071a60 0x7f3788147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.937+0000 7f3787400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3788071a60 0x7f3788147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56902/0 (socket says 172.21.15.71:56902) 2024-04-20T21:20:25.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.937+0000 7f3787400640 1 -- 172.21.15.71:0/70881775 learned_addr learned my addr 172.21.15.71:0/70881775 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f377ea00640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3788073b80 0x7f37880b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f3787e00640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f378815a130 0x7f3788153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f3787400640 1 -- 172.21.15.71:0/70881775 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f378815a130 msgr2=0x7f3788153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f3787400640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f378815a130 0x7f3788153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f3787400640 1 -- 172.21.15.71:0/70881775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3788073b80 msgr2=0x7f37880b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f3787400640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3788073b80 0x7f37880b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f3787400640 1 -- 172.21.15.71:0/70881775 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3788147f70 con 0x7f3788071a60 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f3787400640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3788071a60 0x7f3788147a30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f377800c460 tx=0x7f377800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f377fe00640 1 -- 172.21.15.71:0/70881775 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778018070 con 0x7f3788071a60 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f377fe00640 1 -- 172.21.15.71:0/70881775 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3778007500 con 0x7f3788071a60 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f377fe00640 1 -- 172.21.15.71:0/70881775 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778004a20 con 0x7f3788071a60 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.938+0000 7f378ce00640 1 -- 172.21.15.71:0/70881775 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37880b57e0 con 0x7f3788071a60 2024-04-20T21:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.939+0000 7f378ce00640 1 -- 172.21.15.71:0/70881775 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37880afd30 con 0x7f3788071a60 2024-04-20T21:20:25.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.940+0000 7f378ce00640 1 -- 172.21.15.71:0/70881775 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3788075b30 con 0x7f3788071a60 2024-04-20T21:20:25.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.940+0000 7f377fe00640 1 -- 172.21.15.71:0/70881775 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3778004bc0 con 0x7f3788071a60 2024-04-20T21:20:25.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.941+0000 7f377fe00640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f376406c8f0 0x7f376406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:25.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.942+0000 7f377fe00640 1 -- 172.21.15.71:0/70881775 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f377808b310 con 0x7f3788071a60 2024-04-20T21:20:25.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.942+0000 7f377ea00640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f376406c8f0 0x7f376406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:25.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.942+0000 7f377ea00640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f376406c8f0 0x7f376406edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3788159b00 tx=0x7f3770008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:25.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:25.946+0000 7f377fe00640 1 -- 172.21.15.71:0/70881775 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3788147f70 con 0x7f3788071a60 2024-04-20T21:20:26.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.145+0000 7f378ce00640 1 -- 172.21.15.71:0/70881775 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f37880ad7e0 con 0x7f3788071a60 2024-04-20T21:20:26.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.146+0000 7f377fe00640 1 -- 172.21.15.71:0/70881775 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f3778059290 con 0x7f3788071a60 2024-04-20T21:20:26.145 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:26.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.148+0000 7f378ce00640 1 -- 172.21.15.71:0/70881775 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f376406c8f0 msgr2=0x7f376406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.148+0000 7f378ce00640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f376406c8f0 0x7f376406edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3788159b00 tx=0x7f3770008040 comp rx=0 tx=0).stop 2024-04-20T21:20:26.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.148+0000 7f378ce00640 1 -- 172.21.15.71:0/70881775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3788071a60 msgr2=0x7f3788147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.148+0000 7f378ce00640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3788071a60 0x7f3788147a30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f377800c460 tx=0x7f377800c920 comp rx=0 tx=0).stop 2024-04-20T21:20:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.148+0000 7f378ce00640 1 -- 172.21.15.71:0/70881775 shutdown_connections 2024-04-20T21:20:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.148+0000 7f378ce00640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f376406c8f0 0x7f376406edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.148+0000 7f378ce00640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f378815a130 0x7f3788153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.148+0000 7f378ce00640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3788073b80 0x7f37880b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.148+0000 7f378ce00640 1 --2- 172.21.15.71:0/70881775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3788071a60 0x7f3788147a30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.149+0000 7f378ce00640 1 -- 172.21.15.71:0/70881775 >> 172.21.15.71:0/70881775 conn(0x7f37880cffa0 msgr2=0x7f378815ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.149+0000 7f378ce00640 1 -- 172.21.15.71:0/70881775 shutdown_connections 2024-04-20T21:20:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.149+0000 7f378ce00640 1 -- 172.21.15.71:0/70881775 wait complete. 2024-04-20T21:20:26.167 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:26.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.367+0000 7fd539200640 1 Processor -- start 2024-04-20T21:20:26.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.368+0000 7fd539200640 1 -- start start 2024-04-20T21:20:26.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.369+0000 7fd539200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd53415b1f0 0x7fd53415f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.369+0000 7fd539200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5340d0010 0x7fd5340adc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.369+0000 7fd539200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd53415b5d0 con 0x7fd5340ae140 2024-04-20T21:20:26.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.369+0000 7fd539200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd53406e730 con 0x7fd5340d0010 2024-04-20T21:20:26.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.369+0000 7fd539200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd5340d05d0 con 0x7fd53415b1f0 2024-04-20T21:20:26.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.369+0000 7fd532a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5340d0010 0x7fd5340adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.370+0000 7fd532a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5340d0010 0x7fd5340adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56904/0 (socket says 172.21.15.71:56904) 2024-04-20T21:20:26.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.370+0000 7fd532a00640 1 -- 172.21.15.71:0/1755353270 learned_addr learned my addr 172.21.15.71:0/1755353270 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:26.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.370+0000 7fd533400640 1 --2- 172.21.15.71:0/1755353270 >> v2:172.21.15.137:3300/0 conn(0x7fd53415b1f0 0x7fd53415f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.370+0000 7fd532a00640 1 -- 172.21.15.71:0/1755353270 >> v2:172.21.15.137:3300/0 conn(0x7fd53415b1f0 msgr2=0x7fd53415f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:26.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.370+0000 7fd532a00640 1 --2- 172.21.15.71:0/1755353270 >> v2:172.21.15.137:3300/0 conn(0x7fd53415b1f0 0x7fd53415f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.370+0000 7fd532a00640 1 -- 172.21.15.71:0/1755353270 >> v1:172.21.15.71:6789/0 conn(0x7fd5340ae140 legacy=0x7fd53406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.370+0000 7fd532a00640 1 -- 172.21.15.71:0/1755353270 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53415fc70 con 0x7fd5340d0010 2024-04-20T21:20:26.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.370+0000 7fd532000640 1 -- 172.21.15.71:0/1755353270 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503935501 0 0) 0x7fd53415b5d0 con 0x7fd5340ae140 2024-04-20T21:20:26.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.372+0000 7fd532a00640 1 --2- 172.21.15.71:0/1755353270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5340d0010 0x7fd5340adc00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00bb10 tx=0x7fd51c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94739ff014466f31 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:26.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.372+0000 7fd532000640 1 -- 172.21.15.71:0/1755353270 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c03b070 con 0x7fd5340d0010 2024-04-20T21:20:26.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.372+0000 7fd532000640 1 -- 172.21.15.71:0/1755353270 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51c036440 con 0x7fd5340d0010 2024-04-20T21:20:26.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.372+0000 7fd532000640 1 -- 172.21.15.71:0/1755353270 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c036810 con 0x7fd5340d0010 2024-04-20T21:20:26.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.373+0000 7fd539200640 1 -- 172.21.15.71:0/1755353270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5340d0010 msgr2=0x7fd5340adc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.373+0000 7fd539200640 1 --2- 172.21.15.71:0/1755353270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5340d0010 0x7fd5340adc00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00bb10 tx=0x7fd51c02e0e0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.373+0000 7fd539200640 1 -- 172.21.15.71:0/1755353270 shutdown_connections 2024-04-20T21:20:26.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.373+0000 7fd539200640 1 --2- 172.21.15.71:0/1755353270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5340d0010 0x7fd5340adc00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.373+0000 7fd539200640 1 --2- 172.21.15.71:0/1755353270 >> v2:172.21.15.137:3300/0 conn(0x7fd53415b1f0 0x7fd53415f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.373+0000 7fd539200640 1 -- 172.21.15.71:0/1755353270 >> 172.21.15.71:0/1755353270 conn(0x7fd5340b5270 msgr2=0x7fd5340b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:26.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.373+0000 7fd539200640 1 -- 172.21.15.71:0/1755353270 shutdown_connections 2024-04-20T21:20:26.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.373+0000 7fd539200640 1 -- 172.21.15.71:0/1755353270 wait complete. 2024-04-20T21:20:26.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.375+0000 7fd539200640 1 Processor -- start 2024-04-20T21:20:26.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.375+0000 7fd539200640 1 -- start start 2024-04-20T21:20:26.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.376+0000 7fd539200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5340ae140 0x7fd5340b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.376+0000 7fd539200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5340d0010 0x7fd534150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.376+0000 7fd539200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd53415b1f0 0x7fd53414dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.376+0000 7fd539200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd5340d0e70 con 0x7fd53415b1f0 2024-04-20T21:20:26.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.376+0000 7fd539200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5340d0b90 con 0x7fd5340ae140 2024-04-20T21:20:26.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.376+0000 7fd539200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd53406d120 con 0x7fd5340d0010 2024-04-20T21:20:26.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.376+0000 7fd533e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd53415b1f0 0x7fd53414dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.377+0000 7fd533e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd53415b1f0 0x7fd53414dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56906/0 (socket says 172.21.15.71:56906) 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.377+0000 7fd533e00640 1 -- 172.21.15.71:0/1884715811 learned_addr learned my addr 172.21.15.71:0/1884715811 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.377+0000 7fd533400640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5340ae140 0x7fd5340b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.377+0000 7fd532a00640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5340d0010 0x7fd534150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.377+0000 7fd533e00640 1 -- 172.21.15.71:0/1884715811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5340d0010 msgr2=0x7fd534150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.377+0000 7fd533e00640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5340d0010 0x7fd534150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.377+0000 7fd533e00640 1 -- 172.21.15.71:0/1884715811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5340ae140 msgr2=0x7fd5340b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.377+0000 7fd533e00640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5340ae140 0x7fd5340b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.377+0000 7fd533e00640 1 -- 172.21.15.71:0/1884715811 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53414e860 con 0x7fd53415b1f0 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.377+0000 7fd533e00640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd53415b1f0 0x7fd53414dec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c480 tx=0x7fd52c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.378+0000 7fd52b400640 1 -- 172.21.15.71:0/1884715811 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c005480 con 0x7fd53415b1f0 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.378+0000 7fd52b400640 1 -- 172.21.15.71:0/1884715811 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd52c0035f0 con 0x7fd53415b1f0 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.378+0000 7fd52b400640 1 -- 172.21.15.71:0/1884715811 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c003a00 con 0x7fd53415b1f0 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.378+0000 7fd539200640 1 -- 172.21.15.71:0/1884715811 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53414eb20 con 0x7fd53415b1f0 2024-04-20T21:20:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.378+0000 7fd539200640 1 -- 172.21.15.71:0/1884715811 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5340afe90 con 0x7fd53415b1f0 2024-04-20T21:20:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.379+0000 7fd539200640 1 -- 172.21.15.71:0/1884715811 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd53414f040 con 0x7fd53415b1f0 2024-04-20T21:20:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.380+0000 7fd52b400640 1 -- 172.21.15.71:0/1884715811 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd52c003ba0 con 0x7fd53415b1f0 2024-04-20T21:20:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.381+0000 7fd52b400640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd51006ca90 0x7fd51006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.381+0000 7fd52b400640 1 -- 172.21.15.71:0/1884715811 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fd52c08bb10 con 0x7fd53415b1f0 2024-04-20T21:20:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.382+0000 7fd533400640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd51006ca90 0x7fd51006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.382+0000 7fd533400640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd51006ca90 0x7fd51006ef50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5240099c0 tx=0x7fd524003990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.387+0000 7fd52b400640 1 -- 172.21.15.71:0/1884715811 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd52c0182b0 con 0x7fd53415b1f0 2024-04-20T21:20:26.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.587+0000 7fd539200640 1 -- 172.21.15.71:0/1884715811 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd534157310 con 0x7fd53415b1f0 2024-04-20T21:20:26.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.588+0000 7fd52b400640 1 -- 172.21.15.71:0/1884715811 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fd52c059b90 con 0x7fd53415b1f0 2024-04-20T21:20:26.587 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:26.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.590+0000 7fd539200640 1 -- 172.21.15.71:0/1884715811 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd51006ca90 msgr2=0x7fd51006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.590+0000 7fd539200640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd51006ca90 0x7fd51006ef50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5240099c0 tx=0x7fd524003990 comp rx=0 tx=0).stop 2024-04-20T21:20:26.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.590+0000 7fd539200640 1 -- 172.21.15.71:0/1884715811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd53415b1f0 msgr2=0x7fd53414dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.590+0000 7fd539200640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd53415b1f0 0x7fd53414dec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c480 tx=0x7fd52c00c940 comp rx=0 tx=0).stop 2024-04-20T21:20:26.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.590+0000 7fd539200640 1 -- 172.21.15.71:0/1884715811 shutdown_connections 2024-04-20T21:20:26.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.590+0000 7fd539200640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd51006ca90 0x7fd51006ef50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.590+0000 7fd539200640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd53415b1f0 0x7fd53414dec0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.590+0000 7fd539200640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5340d0010 0x7fd534150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.590+0000 7fd539200640 1 --2- 172.21.15.71:0/1884715811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5340ae140 0x7fd5340b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.590+0000 7fd539200640 1 -- 172.21.15.71:0/1884715811 >> 172.21.15.71:0/1884715811 conn(0x7fd5340b5270 msgr2=0x7fd5340b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:26.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.591+0000 7fd539200640 1 -- 172.21.15.71:0/1884715811 shutdown_connections 2024-04-20T21:20:26.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.591+0000 7fd539200640 1 -- 172.21.15.71:0/1884715811 wait complete. 2024-04-20T21:20:26.608 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:26.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.805+0000 7f9eb6c00640 1 Processor -- start 2024-04-20T21:20:26.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.805+0000 7f9eb6c00640 1 -- start start 2024-04-20T21:20:26.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.807+0000 7f9eb6c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9eb0156c20 0x7f9eb006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.807+0000 7f9eb6c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9eb00d0360 0x7f9eb00d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.807+0000 7f9eb6c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eb0141c60 con 0x7f9eb015ca40 2024-04-20T21:20:26.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.807+0000 7f9eb6c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb00adab0 con 0x7f9eb00d0360 2024-04-20T21:20:26.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.807+0000 7f9eb6c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb015cf90 con 0x7f9eb0156c20 2024-04-20T21:20:26.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.807+0000 7f9ea7e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9eb015ca40 0x7f9eb00ad3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51978/0 (socket says 172.21.15.71:51978) 2024-04-20T21:20:26.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.807+0000 7f9ea7e00640 1 -- 172.21.15.71:0/1287135078 learned_addr learned my addr 172.21.15.71:0/1287135078 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:26.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.807+0000 7f9eb4c00640 1 --2- 172.21.15.71:0/1287135078 >> v2:172.21.15.137:3300/0 conn(0x7f9eb00d0360 0x7f9eb00d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eafe00640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9eb0156c20 0x7f9eb006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3974131172 0 0) 0x7f9eb0141c60 con 0x7f9eb015ca40 2024-04-20T21:20:26.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e94003520 con 0x7f9eb015ca40 2024-04-20T21:20:26.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2982866023 0 0) 0x7f9e94003520 con 0x7f9eb015ca40 2024-04-20T21:20:26.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9eb0156c20 msgr2=0x7f9eb006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:26.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9eb0156c20 0x7f9eb006b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 >> v2:172.21.15.137:3300/0 conn(0x7f9eb00d0360 msgr2=0x7f9eb00d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 --2- 172.21.15.71:0/1287135078 >> v2:172.21.15.137:3300/0 conn(0x7f9eb00d0360 0x7f9eb00d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb015d270 con 0x7f9eb015ca40 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f9e98001670 con 0x7f9eb015ca40 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 >> v1:172.21.15.71:6789/0 conn(0x7f9eb015ca40 legacy=0x7f9eb00ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e940039b0 0x7f9e94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e94004800 0x7f9e94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9eb0156c20 0x7f9e940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb00adab0 con 0x7f9e940039b0 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb015cf90 con 0x7f9e94004800 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.808+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9400b9c0 con 0x7f9eb0156c20 2024-04-20T21:20:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.809+0000 7f9eafe00640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e940039b0 0x7f9e94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.809+0000 7f9ea7e00640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e94004800 0x7f9e94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.809+0000 7f9eb4c00640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9eb0156c20 0x7f9e940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.809+0000 7f9eafe00640 1 -- 172.21.15.71:0/1287135078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9eb0156c20 msgr2=0x7f9e940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:26.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.809+0000 7f9eafe00640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9eb0156c20 0x7f9e940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.809+0000 7f9eafe00640 1 -- 172.21.15.71:0/1287135078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e94004800 msgr2=0x7f9e94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:26.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.809+0000 7f9eafe00640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e94004800 0x7f9e94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.809+0000 7f9eafe00640 1 -- 172.21.15.71:0/1287135078 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e94003520 con 0x7f9e940039b0 2024-04-20T21:20:26.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.810+0000 7f9eafe00640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e940039b0 0x7f9e94003dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009ac0 tx=0x7f9e94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833f70a066fac06b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:26.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.810+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0039070 con 0x7f9e940039b0 2024-04-20T21:20:26.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.810+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea002c6b0 con 0x7f9e940039b0 2024-04-20T21:20:26.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.810+0000 7f9eaf400640 1 -- 172.21.15.71:0/1287135078 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0009690 con 0x7f9e940039b0 2024-04-20T21:20:26.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.811+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1287135078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e940039b0 msgr2=0x7f9e94003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.811+0000 7f9eb6c00640 1 --2- 172.21.15.71:0/1287135078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e940039b0 0x7f9e94003dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009ac0 tx=0x7f9e94005830 comp rx=0 tx=0).stop 2024-04-20T21:20:26.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.811+0000 7f9eb4c00640 1 -- 172.21.15.71:0/1287135078 reap_dead start 2024-04-20T21:20:26.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.811+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1287135078 shutdown_connections 2024-04-20T21:20:26.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.811+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1287135078 >> 172.21.15.71:0/1287135078 conn(0x7f9eb00b3350 msgr2=0x7f9eb00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:26.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.811+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1287135078 shutdown_connections 2024-04-20T21:20:26.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.811+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1287135078 wait complete. 2024-04-20T21:20:26.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.813+0000 7f9eb6c00640 1 Processor -- start 2024-04-20T21:20:26.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.813+0000 7f9eb6c00640 1 -- start start 2024-04-20T21:20:26.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.814+0000 7f9eb6c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e940039b0 0x7f9eb01f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.814+0000 7f9eb6c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9eb014f9d0 0x7f9eb00ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.814+0000 7f9eb6c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eb00cd070 0x7f9eb015db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.814+0000 7f9eb6c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb006b900 con 0x7f9eb00cd070 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.814+0000 7f9eb6c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb015d830 con 0x7f9eb014f9d0 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.814+0000 7f9eb6c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb006ba80 con 0x7f9e940039b0 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9eb4c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eb00cd070 0x7f9eb015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9eb4c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eb00cd070 0x7f9eb015db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56928/0 (socket says 172.21.15.71:56928) 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9eb4c00640 1 -- 172.21.15.71:0/1069124812 learned_addr learned my addr 172.21.15.71:0/1069124812 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9ea7e00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9eb014f9d0 0x7f9eb00ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9eafe00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e940039b0 0x7f9eb01f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9eb4c00640 1 -- 172.21.15.71:0/1069124812 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e940039b0 msgr2=0x7f9eb01f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9eb4c00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e940039b0 0x7f9eb01f7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9eb4c00640 1 -- 172.21.15.71:0/1069124812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9eb014f9d0 msgr2=0x7f9eb00ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:26.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9eb4c00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9eb014f9d0 0x7f9eb00ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:26.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9eb4c00640 1 -- 172.21.15.71:0/1069124812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb0073c90 con 0x7f9eb00cd070 2024-04-20T21:20:26.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9eb4c00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eb00cd070 0x7f9eb015db70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00b4180 tx=0x7f9ea80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:26.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.815+0000 7f9eacc00640 1 -- 172.21.15.71:0/1069124812 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8003990 con 0x7f9eb00cd070 2024-04-20T21:20:26.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.816+0000 7f9eacc00640 1 -- 172.21.15.71:0/1069124812 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea801b070 con 0x7f9eb00cd070 2024-04-20T21:20:26.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.816+0000 7f9eacc00640 1 -- 172.21.15.71:0/1069124812 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8003b70 con 0x7f9eb00cd070 2024-04-20T21:20:26.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.816+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1069124812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb00cd640 con 0x7f9eb00cd070 2024-04-20T21:20:26.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.816+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1069124812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb00cdc00 con 0x7f9eb00cd070 2024-04-20T21:20:26.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.817+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1069124812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb0068980 con 0x7f9eb00cd070 2024-04-20T21:20:26.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.818+0000 7f9eacc00640 1 -- 172.21.15.71:0/1069124812 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ea8005d10 con 0x7f9eb00cd070 2024-04-20T21:20:26.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.819+0000 7f9eacc00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9e8c06c920 0x7f9e8c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:26.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.819+0000 7f9eacc00640 1 -- 172.21.15.71:0/1069124812 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f9ea808c310 con 0x7f9eb00cd070 2024-04-20T21:20:26.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.819+0000 7f9eafe00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9e8c06c920 0x7f9e8c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:26.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.820+0000 7f9eafe00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9e8c06c920 0x7f9e8c06ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0036000 tx=0x7f9ea0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:26.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:26.823+0000 7f9eacc00640 1 -- 172.21.15.71:0/1069124812 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9ea8014350 con 0x7f9eb00cd070 2024-04-20T21:20:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.027+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1069124812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9eb01527e0 con 0x7f9eb00cd070 2024-04-20T21:20:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.028+0000 7f9eacc00640 1 -- 172.21.15.71:0/1069124812 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f9ea805a320 con 0x7f9eb00cd070 2024-04-20T21:20:27.027 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:27.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.030+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1069124812 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9e8c06c920 msgr2=0x7f9e8c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.030+0000 7f9eb6c00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9e8c06c920 0x7f9e8c06ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0036000 tx=0x7f9ea0030000 comp rx=0 tx=0).stop 2024-04-20T21:20:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.030+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1069124812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eb00cd070 msgr2=0x7f9eb015db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.030+0000 7f9eb6c00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eb00cd070 0x7f9eb015db70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00b4180 tx=0x7f9ea80115a0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.031+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1069124812 shutdown_connections 2024-04-20T21:20:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.031+0000 7f9eb6c00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9e8c06c920 0x7f9e8c06ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.031+0000 7f9eb6c00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eb00cd070 0x7f9eb015db70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.031+0000 7f9eb6c00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9eb014f9d0 0x7f9eb00ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.031+0000 7f9eb6c00640 1 --2- 172.21.15.71:0/1069124812 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e940039b0 0x7f9eb01f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.031+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1069124812 >> 172.21.15.71:0/1069124812 conn(0x7f9eb00b3350 msgr2=0x7f9eb00afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.031+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1069124812 shutdown_connections 2024-04-20T21:20:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.031+0000 7f9eb6c00640 1 -- 172.21.15.71:0/1069124812 wait complete. 2024-04-20T21:20:27.048 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.246+0000 7fb958000640 1 Processor -- start 2024-04-20T21:20:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.246+0000 7fb958000640 1 -- start start 2024-04-20T21:20:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.247+0000 7fb958000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb950162700 0x7fb950162ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.248+0000 7fb958000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb95006f2b0 con 0x7fb95015ead0 2024-04-20T21:20:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.248+0000 7fb958000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9500b6160 con 0x7fb9500b6c20 2024-04-20T21:20:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.248+0000 7fb958000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb9500b6900 con 0x7fb950162700 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.248+0000 7fb956000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb95015ead0 0x7fb9500cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51984/0 (socket says 172.21.15.71:51984) 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.248+0000 7fb956000640 1 -- 172.21.15.71:0/4186200883 learned_addr learned my addr 172.21.15.71:0/4186200883 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.248+0000 7fb955600640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb950162700 0x7fb950162ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475207087 0 0) 0x7fb95006f2b0 con 0x7fb95015ead0 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb938003520 con 0x7fb95015ead0 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3414182464 0 0) 0x7fb938003520 con 0x7fb95015ead0 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb950162700 msgr2=0x7fb950162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb950162700 0x7fb950162ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 >> v1:172.21.15.137:6789/0 conn(0x7fb9500b6c20 legacy=0x7fb95015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb950163210 con 0x7fb95015ead0 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fb948001670 con 0x7fb95015ead0 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 >> v1:172.21.15.71:6789/0 conn(0x7fb95015ead0 legacy=0x7fb9500cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb950162700 0x7fb9380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 0x7fb938004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb938004d40 0x7fb9380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb93800bbd0 con 0x7fb938003f60 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb93800bd80 con 0x7fb938004d40 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.249+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb93800bf80 con 0x7fb950162700 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.250+0000 7fb954c00640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 0x7fb938004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.250+0000 7fb955600640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb950162700 0x7fb9380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.250+0000 7fb954c00640 1 -- 172.21.15.71:0/4186200883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb950162700 msgr2=0x7fb9380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.250+0000 7fb954c00640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb950162700 0x7fb9380039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.250+0000 7fb956000640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb938004d40 0x7fb9380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.250+0000 7fb954c00640 1 -- 172.21.15.71:0/4186200883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb938004d40 msgr2=0x7fb9380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.250+0000 7fb954c00640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb938004d40 0x7fb9380051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.250+0000 7fb954c00640 1 -- 172.21.15.71:0/4186200883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb938003520 con 0x7fb938003f60 2024-04-20T21:20:27.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.251+0000 7fb954c00640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 0x7fb938004800 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb940001e50 tx=0x7fb938005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb806a478984b066 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:27.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.251+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940001a70 con 0x7fb938003f60 2024-04-20T21:20:27.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.251+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb940003b70 con 0x7fb938003f60 2024-04-20T21:20:27.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.251+0000 7fb94fe00640 1 -- 172.21.15.71:0/4186200883 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9400050d0 con 0x7fb938003f60 2024-04-20T21:20:27.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.252+0000 7fb958000640 1 -- 172.21.15.71:0/4186200883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 msgr2=0x7fb938004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.252+0000 7fb958000640 1 --2- 172.21.15.71:0/4186200883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 0x7fb938004800 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb940001e50 tx=0x7fb938005830 comp rx=0 tx=0).stop 2024-04-20T21:20:27.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.252+0000 7fb956000640 1 -- 172.21.15.71:0/4186200883 reap_dead start 2024-04-20T21:20:27.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.252+0000 7fb958000640 1 -- 172.21.15.71:0/4186200883 shutdown_connections 2024-04-20T21:20:27.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.252+0000 7fb958000640 1 -- 172.21.15.71:0/4186200883 >> 172.21.15.71:0/4186200883 conn(0x7fb95009d910 msgr2=0x7fb9500b9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:27.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.252+0000 7fb958000640 1 -- 172.21.15.71:0/4186200883 shutdown_connections 2024-04-20T21:20:27.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.252+0000 7fb958000640 1 -- 172.21.15.71:0/4186200883 wait complete. 2024-04-20T21:20:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.254+0000 7fb958000640 1 Processor -- start 2024-04-20T21:20:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.254+0000 7fb958000640 1 -- start start 2024-04-20T21:20:27.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.255+0000 7fb958000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 0x7fb95015d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.255+0000 7fb958000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb95006e840 0x7fb95006ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.255+0000 7fb958000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9500cd0b0 0x7fb9500cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.255+0000 7fb958000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500b38a0 con 0x7fb938003f60 2024-04-20T21:20:27.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.255+0000 7fb958000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500b3720 con 0x7fb95006e840 2024-04-20T21:20:27.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.255+0000 7fb958000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb9500b6620 con 0x7fb9500cd0b0 2024-04-20T21:20:27.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.255+0000 7fb955600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 0x7fb95015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.255+0000 7fb955600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 0x7fb95015d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56946/0 (socket says 172.21.15.71:56946) 2024-04-20T21:20:27.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.255+0000 7fb955600640 1 -- 172.21.15.71:0/2039951213 learned_addr learned my addr 172.21.15.71:0/2039951213 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:27.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.256+0000 7fb955600640 1 -- 172.21.15.71:0/2039951213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9500cd0b0 msgr2=0x7fb9500cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.256+0000 7fb955600640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9500cd0b0 0x7fb9500cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.256+0000 7fb955600640 1 -- 172.21.15.71:0/2039951213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb95006e840 msgr2=0x7fb95006ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.256+0000 7fb955600640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb95006e840 0x7fb95006ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.256+0000 7fb955600640 1 -- 172.21.15.71:0/2039951213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95006bc10 con 0x7fb938003f60 2024-04-20T21:20:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.256+0000 7fb955600640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 0x7fb95015d590 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb944010890 tx=0x7fb944010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.256+0000 7fb94d600640 1 -- 172.21.15.71:0/2039951213 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94400f040 con 0x7fb938003f60 2024-04-20T21:20:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.256+0000 7fb94d600640 1 -- 172.21.15.71:0/2039951213 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94400eb60 con 0x7fb938003f60 2024-04-20T21:20:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.256+0000 7fb958000640 1 -- 172.21.15.71:0/2039951213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95006bef0 con 0x7fb938003f60 2024-04-20T21:20:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.256+0000 7fb94d600640 1 -- 172.21.15.71:0/2039951213 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94401c400 con 0x7fb938003f60 2024-04-20T21:20:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.256+0000 7fb958000640 1 -- 172.21.15.71:0/2039951213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95006c4b0 con 0x7fb938003f60 2024-04-20T21:20:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.257+0000 7fb958000640 1 -- 172.21.15.71:0/2039951213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb950068980 con 0x7fb938003f60 2024-04-20T21:20:27.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.259+0000 7fb94d600640 1 -- 172.21.15.71:0/2039951213 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb94401c5a0 con 0x7fb938003f60 2024-04-20T21:20:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.260+0000 7fb94d600640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb93406c8f0 0x7fb93406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.260+0000 7fb94d600640 1 -- 172.21.15.71:0/2039951213 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fb94408c690 con 0x7fb938003f60 2024-04-20T21:20:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.260+0000 7fb954c00640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb93406c8f0 0x7fb93406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.260+0000 7fb954c00640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb93406c8f0 0x7fb93406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb940034000 tx=0x7fb940030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:27.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.264+0000 7fb94d600640 1 -- 172.21.15.71:0/2039951213 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb944018030 con 0x7fb938003f60 2024-04-20T21:20:27.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.446+0000 7fb958000640 1 -- 172.21.15.71:0/2039951213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb9500d51b0 con 0x7fb938003f60 2024-04-20T21:20:27.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.446+0000 7fb94d600640 1 -- 172.21.15.71:0/2039951213 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fb94405a640 con 0x7fb938003f60 2024-04-20T21:20:27.446 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:27.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 -- 172.21.15.71:0/2039951213 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb93406c8f0 msgr2=0x7fb93406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb93406c8f0 0x7fb93406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb940034000 tx=0x7fb940030000 comp rx=0 tx=0).stop 2024-04-20T21:20:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 -- 172.21.15.71:0/2039951213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 msgr2=0x7fb95015d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 0x7fb95015d590 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb944010890 tx=0x7fb944010d50 comp rx=0 tx=0).stop 2024-04-20T21:20:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 -- 172.21.15.71:0/2039951213 shutdown_connections 2024-04-20T21:20:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb93406c8f0 0x7fb93406edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9500cd0b0 0x7fb9500cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb95006e840 0x7fb95006ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 --2- 172.21.15.71:0/2039951213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb938003f60 0x7fb95015d590 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 -- 172.21.15.71:0/2039951213 >> 172.21.15.71:0/2039951213 conn(0x7fb95009d910 msgr2=0x7fb9500b7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:27.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 -- 172.21.15.71:0/2039951213 shutdown_connections 2024-04-20T21:20:27.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.449+0000 7fb958000640 1 -- 172.21.15.71:0/2039951213 wait complete. 2024-04-20T21:20:27.467 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:27.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.664+0000 7f215be00640 1 Processor -- start 2024-04-20T21:20:27.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.664+0000 7f215be00640 1 -- start start 2024-04-20T21:20:27.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.665+0000 7f215be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f215c15b400 0x7f215c072d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.665+0000 7f215be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f215c15eec0 0x7f215c15f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.665+0000 7f215be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f215c15f870 0x7f215c15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.665+0000 7f215be00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f215c06d280 con 0x7f215c15b400 2024-04-20T21:20:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.665+0000 7f215be00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f215c06ccc0 con 0x7f215c15f870 2024-04-20T21:20:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.665+0000 7f215be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f215c06cfa0 con 0x7f215c15eec0 2024-04-20T21:20:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.666+0000 7f215aa00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f215c15b400 0x7f215c072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.666+0000 7f215aa00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f215c15b400 0x7f215c072d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56948/0 (socket says 172.21.15.71:56948) 2024-04-20T21:20:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.666+0000 7f215aa00640 1 -- 172.21.15.71:0/3592825817 learned_addr learned my addr 172.21.15.71:0/3592825817 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.666+0000 7f215aa00640 1 -- 172.21.15.71:0/3592825817 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f215c15eec0 msgr2=0x7f215c15f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.666+0000 7f2152000640 1 --2- 172.21.15.71:0/3592825817 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f215c15eec0 0x7f215c15f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.666+0000 7f215b400640 1 --2- 172.21.15.71:0/3592825817 >> v2:172.21.15.137:3300/0 conn(0x7f215c15f870 0x7f215c15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.666+0000 7f215aa00640 1 --2- 172.21.15.71:0/3592825817 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f215c15eec0 0x7f215c15f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.666+0000 7f215aa00640 1 -- 172.21.15.71:0/3592825817 >> v2:172.21.15.137:3300/0 conn(0x7f215c15f870 msgr2=0x7f215c15b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.666+0000 7f215aa00640 1 --2- 172.21.15.71:0/3592825817 >> v2:172.21.15.137:3300/0 conn(0x7f215c15f870 0x7f215c15b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.666+0000 7f215aa00640 1 -- 172.21.15.71:0/3592825817 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c06e440 con 0x7f215c15b400 2024-04-20T21:20:27.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.666+0000 7f215b400640 1 --2- 172.21.15.71:0/3592825817 >> v2:172.21.15.137:3300/0 conn(0x7f215c15f870 0x7f215c15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:27.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.667+0000 7f215aa00640 1 --2- 172.21.15.71:0/3592825817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f215c15b400 0x7f215c072d00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f215c074a10 tx=0x7f214c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d693b6b91d36e911 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:27.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.668+0000 7f215a000640 1 -- 172.21.15.71:0/3592825817 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c035020 con 0x7f215c15b400 2024-04-20T21:20:27.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.668+0000 7f215a000640 1 -- 172.21.15.71:0/3592825817 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f214c031640 con 0x7f215c15b400 2024-04-20T21:20:27.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.668+0000 7f215a000640 1 -- 172.21.15.71:0/3592825817 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c02d040 con 0x7f215c15b400 2024-04-20T21:20:27.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.668+0000 7f215be00640 1 -- 172.21.15.71:0/3592825817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f215c15b400 msgr2=0x7f215c072d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.668+0000 7f215be00640 1 --2- 172.21.15.71:0/3592825817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f215c15b400 0x7f215c072d00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f215c074a10 tx=0x7f214c02b8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.668+0000 7f215be00640 1 -- 172.21.15.71:0/3592825817 shutdown_connections 2024-04-20T21:20:27.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.668+0000 7f215be00640 1 --2- 172.21.15.71:0/3592825817 >> v2:172.21.15.137:3300/0 conn(0x7f215c15f870 0x7f215c15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.668+0000 7f215be00640 1 --2- 172.21.15.71:0/3592825817 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f215c15eec0 0x7f215c15f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.668+0000 7f215be00640 1 --2- 172.21.15.71:0/3592825817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f215c15b400 0x7f215c072d00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.668+0000 7f215be00640 1 -- 172.21.15.71:0/3592825817 >> 172.21.15.71:0/3592825817 conn(0x7f215c0d0040 msgr2=0x7f215c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:27.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.669+0000 7f215be00640 1 -- 172.21.15.71:0/3592825817 shutdown_connections 2024-04-20T21:20:27.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.669+0000 7f215be00640 1 -- 172.21.15.71:0/3592825817 wait complete. 2024-04-20T21:20:27.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.670+0000 7f215be00640 1 Processor -- start 2024-04-20T21:20:27.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.670+0000 7f215be00640 1 -- start start 2024-04-20T21:20:27.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.671+0000 7f215be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f215c15b400 0x7f215c1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.671+0000 7f215be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f215c15eec0 0x7f215c155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.671+0000 7f215be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f215c15f870 0x7f215c0b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.671+0000 7f215be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f215c073240 con 0x7f215c15f870 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.671+0000 7f215be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f215c15fc90 con 0x7f215c15b400 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.671+0000 7f215be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f215c15bd20 con 0x7f215c15eec0 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f215b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f215c15f870 0x7f215c0b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f215b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f215c15f870 0x7f215c0b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56964/0 (socket says 172.21.15.71:56964) 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f215b400640 1 -- 172.21.15.71:0/1670962454 learned_addr learned my addr 172.21.15.71:0/1670962454 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f215aa00640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f215c15b400 0x7f215c1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f2152000640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f215c15eec0 0x7f215c155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f215b400640 1 -- 172.21.15.71:0/1670962454 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f215c15eec0 msgr2=0x7f215c155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f215b400640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f215c15eec0 0x7f215c155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f215b400640 1 -- 172.21.15.71:0/1670962454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f215c15b400 msgr2=0x7f215c1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f215b400640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f215c15b400 0x7f215c1461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f215b400640 1 -- 172.21.15.71:0/1670962454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c0ceaa0 con 0x7f215c15f870 2024-04-20T21:20:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f215aa00640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f215c15b400 0x7f215c1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.672+0000 7f215b400640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f215c15f870 0x7f215c0b3010 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f215400cd80 tx=0x7f215400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.673+0000 7f2153e00640 1 -- 172.21.15.71:0/1670962454 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215400f680 con 0x7f215c15f870 2024-04-20T21:20:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.673+0000 7f2153e00640 1 -- 172.21.15.71:0/1670962454 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215400f840 con 0x7f215c15f870 2024-04-20T21:20:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.673+0000 7f2153e00640 1 -- 172.21.15.71:0/1670962454 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215400fc30 con 0x7f215c15f870 2024-04-20T21:20:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.673+0000 7f215be00640 1 -- 172.21.15.71:0/1670962454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c0ced80 con 0x7f215c15f870 2024-04-20T21:20:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.673+0000 7f215be00640 1 -- 172.21.15.71:0/1670962454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c146710 con 0x7f215c15f870 2024-04-20T21:20:27.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.674+0000 7f215be00640 1 -- 172.21.15.71:0/1670962454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c075b60 con 0x7f215c15f870 2024-04-20T21:20:27.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.675+0000 7f2153e00640 1 -- 172.21.15.71:0/1670962454 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f215400e3e0 con 0x7f215c15f870 2024-04-20T21:20:27.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.676+0000 7f2153e00640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f213806c8f0 0x7f213806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.676+0000 7f2153e00640 1 -- 172.21.15.71:0/1670962454 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f215408cd30 con 0x7f215c15f870 2024-04-20T21:20:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.676+0000 7f215aa00640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f213806c8f0 0x7f213806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.677+0000 7f215aa00640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f213806c8f0 0x7f213806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f214c036000 tx=0x7f214c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:27.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.680+0000 7f2153e00640 1 -- 172.21.15.71:0/1670962454 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2154014030 con 0x7f215c15f870 2024-04-20T21:20:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.884+0000 7f215be00640 1 -- 172.21.15.71:0/1670962454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f215c166030 con 0x7f215c15f870 2024-04-20T21:20:27.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.886+0000 7f2153e00640 1 -- 172.21.15.71:0/1670962454 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7f215405ad30 con 0x7f215c15f870 2024-04-20T21:20:27.886 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:27.886 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:27.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 -- 172.21.15.71:0/1670962454 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f213806c8f0 msgr2=0x7f213806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f213806c8f0 0x7f213806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f214c036000 tx=0x7f214c008030 comp rx=0 tx=0).stop 2024-04-20T21:20:27.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 -- 172.21.15.71:0/1670962454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f215c15f870 msgr2=0x7f215c0b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:27.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f215c15f870 0x7f215c0b3010 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f215400cd80 tx=0x7f215400a650 comp rx=0 tx=0).stop 2024-04-20T21:20:27.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 -- 172.21.15.71:0/1670962454 shutdown_connections 2024-04-20T21:20:27.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f213806c8f0 0x7f213806edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f215c15f870 0x7f215c0b3010 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f215c15eec0 0x7f215c155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 --2- 172.21.15.71:0/1670962454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f215c15b400 0x7f215c1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:27.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 -- 172.21.15.71:0/1670962454 >> 172.21.15.71:0/1670962454 conn(0x7f215c0d0040 msgr2=0x7f215c0afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:27.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 -- 172.21.15.71:0/1670962454 shutdown_connections 2024-04-20T21:20:27.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:27.889+0000 7f215be00640 1 -- 172.21.15.71:0/1670962454 wait complete. 2024-04-20T21:20:27.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:27.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:28.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.092+0000 7fddef000640 1 Processor -- start 2024-04-20T21:20:28.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.092+0000 7fddef000640 1 -- start start 2024-04-20T21:20:28.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.094+0000 7fddef000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdde80cb570 0x7fdde8071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.094+0000 7fddef000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdde806f3b0 con 0x7fdde815af80 2024-04-20T21:20:28.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.094+0000 7fddef000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdde806f690 con 0x7fdde815b360 2024-04-20T21:20:28.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.094+0000 7fddef000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fdde809e150 con 0x7fdde80cb570 2024-04-20T21:20:28.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.094+0000 7fdded200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdde80cb570 0x7fdde8071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.094+0000 7fdded200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdde80cb570 0x7fdde8071a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56980/0 (socket says 172.21.15.71:56980) 2024-04-20T21:20:28.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.094+0000 7fdded200640 1 -- 172.21.15.71:0/1541066616 learned_addr learned my addr 172.21.15.71:0/1541066616 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:28.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.094+0000 7fddedc00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdde815af80 0x7fdde80cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51986/0 (socket says 172.21.15.71:51986) 2024-04-20T21:20:28.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.095+0000 7fdded200640 1 -- 172.21.15.71:0/1541066616 >> v1:172.21.15.137:6789/0 conn(0x7fdde815b360 legacy=0x7fdde80ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:28.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.095+0000 7fdded200640 1 -- 172.21.15.71:0/1541066616 >> v1:172.21.15.71:6789/0 conn(0x7fdde815af80 legacy=0x7fdde80cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.095+0000 7fdded200640 1 -- 172.21.15.71:0/1541066616 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde80ad1a0 con 0x7fdde80cb570 2024-04-20T21:20:28.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.095+0000 7fdde7e00640 1 -- 172.21.15.71:0/1541066616 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 637249597 0 0) 0x7fdde806f3b0 con 0x7fdde815af80 2024-04-20T21:20:28.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.096+0000 7fdded200640 1 --2- 172.21.15.71:0/1541066616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde80cb570 0x7fdde8071a60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009870 tx=0x7fddd402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff04d36e2f9a812a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:28.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.096+0000 7fdde7e00640 1 -- 172.21.15.71:0/1541066616 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4035020 con 0x7fdde80cb570 2024-04-20T21:20:28.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.096+0000 7fdde7e00640 1 -- 172.21.15.71:0/1541066616 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd402d040 con 0x7fdde80cb570 2024-04-20T21:20:28.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.096+0000 7fdde7e00640 1 -- 172.21.15.71:0/1541066616 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4031a80 con 0x7fdde80cb570 2024-04-20T21:20:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.097+0000 7fddef000640 1 -- 172.21.15.71:0/1541066616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde80cb570 msgr2=0x7fdde8071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.097+0000 7fddef000640 1 --2- 172.21.15.71:0/1541066616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde80cb570 0x7fdde8071a60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009870 tx=0x7fddd402b900 comp rx=0 tx=0).stop 2024-04-20T21:20:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.097+0000 7fddef000640 1 -- 172.21.15.71:0/1541066616 shutdown_connections 2024-04-20T21:20:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.097+0000 7fddef000640 1 --2- 172.21.15.71:0/1541066616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde80cb570 0x7fdde8071a60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.097+0000 7fddef000640 1 -- 172.21.15.71:0/1541066616 >> 172.21.15.71:0/1541066616 conn(0x7fdde80cffa0 msgr2=0x7fdde80d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.097+0000 7fddef000640 1 -- 172.21.15.71:0/1541066616 shutdown_connections 2024-04-20T21:20:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.097+0000 7fddef000640 1 -- 172.21.15.71:0/1541066616 wait complete. 2024-04-20T21:20:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.098+0000 7fddef000640 1 Processor -- start 2024-04-20T21:20:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.099+0000 7fddef000640 1 -- start start 2024-04-20T21:20:28.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.099+0000 7fddef000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdde80cb570 0x7fdde81f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.099+0000 7fddef000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde815af80 0x7fdde81537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fddef000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdde815b360 0x7fdde80b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fddef000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdde80ca910 con 0x7fdde815af80 2024-04-20T21:20:28.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fddef000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdde80acf50 con 0x7fdde815b360 2024-04-20T21:20:28.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fddef000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdde80caa90 con 0x7fdde80cb570 2024-04-20T21:20:28.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fdded200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde815af80 0x7fdde81537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fdded200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde815af80 0x7fdde81537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56996/0 (socket says 172.21.15.71:56996) 2024-04-20T21:20:28.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fdded200640 1 -- 172.21.15.71:0/849284483 learned_addr learned my addr 172.21.15.71:0/849284483 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:28.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fddedc00640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdde80cb570 0x7fdde81f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fddee600640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdde815b360 0x7fdde80b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fdded200640 1 -- 172.21.15.71:0/849284483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdde80cb570 msgr2=0x7fdde81f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fdded200640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdde80cb570 0x7fdde81f51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fdded200640 1 -- 172.21.15.71:0/849284483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdde815b360 msgr2=0x7fdde80b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fdded200640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdde815b360 0x7fdde80b4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.100+0000 7fdded200640 1 -- 172.21.15.71:0/849284483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde81f56f0 con 0x7fdde815af80 2024-04-20T21:20:28.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.101+0000 7fdded200640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde815af80 0x7fdde81537c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009870 tx=0x7fddd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:28.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.101+0000 7fdde5600640 1 -- 172.21.15.71:0/849284483 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4004230 con 0x7fdde815af80 2024-04-20T21:20:28.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.101+0000 7fdde5600640 1 -- 172.21.15.71:0/849284483 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd40043f0 con 0x7fdde815af80 2024-04-20T21:20:28.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.101+0000 7fdde5600640 1 -- 172.21.15.71:0/849284483 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd403baa0 con 0x7fdde815af80 2024-04-20T21:20:28.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.101+0000 7fddef000640 1 -- 172.21.15.71:0/849284483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde8153d00 con 0x7fdde815af80 2024-04-20T21:20:28.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.101+0000 7fddef000640 1 -- 172.21.15.71:0/849284483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde80b3e50 con 0x7fdde815af80 2024-04-20T21:20:28.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.102+0000 7fddef000640 1 -- 172.21.15.71:0/849284483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde8075b30 con 0x7fdde815af80 2024-04-20T21:20:28.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.103+0000 7fdde5600640 1 -- 172.21.15.71:0/849284483 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fddd404c060 con 0x7fdde815af80 2024-04-20T21:20:28.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.104+0000 7fdde5600640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fddc806c920 0x7fddc806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.104+0000 7fdde5600640 1 -- 172.21.15.71:0/849284483 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fddd40adda0 con 0x7fdde815af80 2024-04-20T21:20:28.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.104+0000 7fddedc00640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fddc806c920 0x7fddc806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.105+0000 7fddedc00640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fddc806c920 0x7fddc806ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdddc007fd0 tx=0x7fdddc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:28.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.109+0000 7fdde5600640 1 -- 172.21.15.71:0/849284483 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fdde81f56f0 con 0x7fdde815af80 2024-04-20T21:20:28.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.308+0000 7fddef000640 1 -- 172.21.15.71:0/849284483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdde80b5070 con 0x7fdde815af80 2024-04-20T21:20:28.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.309+0000 7fdde5600640 1 -- 172.21.15.71:0/849284483 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fddd4040070 con 0x7fdde815af80 2024-04-20T21:20:28.308 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.311+0000 7fddef000640 1 -- 172.21.15.71:0/849284483 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fddc806c920 msgr2=0x7fddc806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.311+0000 7fddef000640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fddc806c920 0x7fddc806ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdddc007fd0 tx=0x7fdddc009040 comp rx=0 tx=0).stop 2024-04-20T21:20:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.311+0000 7fddef000640 1 -- 172.21.15.71:0/849284483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde815af80 msgr2=0x7fdde81537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.311+0000 7fddef000640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde815af80 0x7fdde81537c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009870 tx=0x7fddd40046c0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.311+0000 7fddef000640 1 -- 172.21.15.71:0/849284483 shutdown_connections 2024-04-20T21:20:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.311+0000 7fddef000640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fddc806c920 0x7fddc806ede0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.311+0000 7fddef000640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdde815b360 0x7fdde80b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.311+0000 7fddef000640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde815af80 0x7fdde81537c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.312+0000 7fddef000640 1 --2- 172.21.15.71:0/849284483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdde80cb570 0x7fdde81f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.312+0000 7fddef000640 1 -- 172.21.15.71:0/849284483 >> 172.21.15.71:0/849284483 conn(0x7fdde80cffa0 msgr2=0x7fdde8157a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.312+0000 7fddef000640 1 -- 172.21.15.71:0/849284483 shutdown_connections 2024-04-20T21:20:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.312+0000 7fddef000640 1 -- 172.21.15.71:0/849284483 wait complete. 2024-04-20T21:20:28.330 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:28.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.528+0000 7ff3a9000640 1 Processor -- start 2024-04-20T21:20:28.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.528+0000 7ff3a9000640 1 -- start start 2024-04-20T21:20:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.530+0000 7ff3a9000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3a4165190 0x7ff3a4167580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.530+0000 7ff3a9000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a406b900 con 0x7ff3a40aee60 2024-04-20T21:20:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.530+0000 7ff3a9000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a406bbe0 con 0x7ff3a415d4f0 2024-04-20T21:20:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.530+0000 7ff3a9000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff3a406c510 con 0x7ff3a4165190 2024-04-20T21:20:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.530+0000 7ff3a3e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3a4165190 0x7ff3a4167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.530+0000 7ff3a3400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff3a40aee60 0x7ff3a40af240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51992/0 (socket says 172.21.15.71:51992) 2024-04-20T21:20:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.530+0000 7ff3a3400640 1 -- 172.21.15.71:0/1369885810 learned_addr learned my addr 172.21.15.71:0/1369885810 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:28.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.530+0000 7ff3a3e00640 1 -- 172.21.15.71:0/1369885810 >> v1:172.21.15.137:6789/0 conn(0x7ff3a415d4f0 legacy=0x7ff3a40ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:28.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.531+0000 7ff3a3e00640 1 -- 172.21.15.71:0/1369885810 >> v1:172.21.15.71:6789/0 conn(0x7ff3a40aee60 legacy=0x7ff3a40af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.531+0000 7ff3a3e00640 1 -- 172.21.15.71:0/1369885810 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a406bec0 con 0x7ff3a4165190 2024-04-20T21:20:28.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.532+0000 7ff3a3e00640 1 --2- 172.21.15.71:0/1369885810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3a4165190 0x7ff3a4167580 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff39c009d90 tx=0x7ff39c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c36a0dd7c1d2d4d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:28.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.532+0000 7ff3a2000640 1 -- 172.21.15.71:0/1369885810 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c039070 con 0x7ff3a4165190 2024-04-20T21:20:28.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.532+0000 7ff3a2000640 1 -- 172.21.15.71:0/1369885810 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39c02cc60 con 0x7ff3a4165190 2024-04-20T21:20:28.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.532+0000 7ff3a2000640 1 -- 172.21.15.71:0/1369885810 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c034660 con 0x7ff3a4165190 2024-04-20T21:20:28.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.532+0000 7ff3a9000640 1 -- 172.21.15.71:0/1369885810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3a4165190 msgr2=0x7ff3a4167580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.532+0000 7ff3a9000640 1 --2- 172.21.15.71:0/1369885810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3a4165190 0x7ff3a4167580 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff39c009d90 tx=0x7ff39c02beb0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.533+0000 7ff3a9000640 1 -- 172.21.15.71:0/1369885810 shutdown_connections 2024-04-20T21:20:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.533+0000 7ff3a9000640 1 --2- 172.21.15.71:0/1369885810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3a4165190 0x7ff3a4167580 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.533+0000 7ff3a9000640 1 -- 172.21.15.71:0/1369885810 >> 172.21.15.71:0/1369885810 conn(0x7ff3a40b5270 msgr2=0x7ff3a40b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.533+0000 7ff3a9000640 1 -- 172.21.15.71:0/1369885810 shutdown_connections 2024-04-20T21:20:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.533+0000 7ff3a9000640 1 -- 172.21.15.71:0/1369885810 wait complete. 2024-04-20T21:20:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.534+0000 7ff3a9000640 1 Processor -- start 2024-04-20T21:20:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.534+0000 7ff3a9000640 1 -- start start 2024-04-20T21:20:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.535+0000 7ff3a9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3a40aee60 0x7ff3a415ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.535+0000 7ff3a9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3a415d4f0 0x7ff3a414c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.535+0000 7ff3a9000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3a4165190 0x7ff3a414c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.535+0000 7ff3a9000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a406c9a0 con 0x7ff3a415d4f0 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.535+0000 7ff3a9000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a406f070 con 0x7ff3a40aee60 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.535+0000 7ff3a9000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a4167ac0 con 0x7ff3a4165190 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.535+0000 7ff3a2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3a415d4f0 0x7ff3a414c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff3a2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3a415d4f0 0x7ff3a414c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57024/0 (socket says 172.21.15.71:57024) 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff3a2a00640 1 -- 172.21.15.71:0/1172991684 learned_addr learned my addr 172.21.15.71:0/1172991684 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff3a2a00640 1 -- 172.21.15.71:0/1172991684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3a4165190 msgr2=0x7ff3a414c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff3a2a00640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3a4165190 0x7ff3a414c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff3a2a00640 1 -- 172.21.15.71:0/1172991684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3a40aee60 msgr2=0x7ff3a415ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff3a2a00640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3a40aee60 0x7ff3a415ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff3a2a00640 1 -- 172.21.15.71:0/1172991684 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a4166fd0 con 0x7ff3a415d4f0 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff3a2a00640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3a415d4f0 0x7ff3a414c220 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff39000c460 tx=0x7ff39000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff39b400640 1 -- 172.21.15.71:0/1172991684 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390016020 con 0x7ff3a415d4f0 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff39b400640 1 -- 172.21.15.71:0/1172991684 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff390012870 con 0x7ff3a415d4f0 2024-04-20T21:20:28.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff39b400640 1 -- 172.21.15.71:0/1172991684 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390012c60 con 0x7ff3a415d4f0 2024-04-20T21:20:28.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.536+0000 7ff3a9000640 1 -- 172.21.15.71:0/1172991684 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a414e6c0 con 0x7ff3a415d4f0 2024-04-20T21:20:28.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.537+0000 7ff3a9000640 1 -- 172.21.15.71:0/1172991684 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a414ec80 con 0x7ff3a415d4f0 2024-04-20T21:20:28.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.538+0000 7ff3a9000640 1 -- 172.21.15.71:0/1172991684 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a414f0b0 con 0x7ff3a415d4f0 2024-04-20T21:20:28.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.539+0000 7ff39b400640 1 -- 172.21.15.71:0/1172991684 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff390019020 con 0x7ff3a415d4f0 2024-04-20T21:20:28.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.539+0000 7ff39b400640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff38406c920 0x7ff38406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.540+0000 7ff39b400640 1 -- 172.21.15.71:0/1172991684 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ff39008bee0 con 0x7ff3a415d4f0 2024-04-20T21:20:28.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.540+0000 7ff3a3400640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff38406c920 0x7ff38406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.541+0000 7ff3a3400640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff38406c920 0x7ff38406ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff394000f60 tx=0x7ff394007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.544+0000 7ff39b400640 1 -- 172.21.15.71:0/1172991684 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff390020020 con 0x7ff3a415d4f0 2024-04-20T21:20:28.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.729+0000 7ff3a9000640 1 -- 172.21.15.71:0/1172991684 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff3a406de40 con 0x7ff3a415d4f0 2024-04-20T21:20:28.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.731+0000 7ff39b400640 1 -- 172.21.15.71:0/1172991684 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7ff3900182c0 con 0x7ff3a415d4f0 2024-04-20T21:20:28.730 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 -- 172.21.15.71:0/1172991684 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff38406c920 msgr2=0x7ff38406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff38406c920 0x7ff38406ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff394000f60 tx=0x7ff394007a80 comp rx=0 tx=0).stop 2024-04-20T21:20:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 -- 172.21.15.71:0/1172991684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3a415d4f0 msgr2=0x7ff3a414c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3a415d4f0 0x7ff3a414c220 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff39000c460 tx=0x7ff39000c920 comp rx=0 tx=0).stop 2024-04-20T21:20:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 -- 172.21.15.71:0/1172991684 shutdown_connections 2024-04-20T21:20:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff38406c920 0x7ff38406ede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3a4165190 0x7ff3a414c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3a415d4f0 0x7ff3a414c220 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 --2- 172.21.15.71:0/1172991684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3a40aee60 0x7ff3a415ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 -- 172.21.15.71:0/1172991684 >> 172.21.15.71:0/1172991684 conn(0x7ff3a40b5270 msgr2=0x7ff3a414d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 -- 172.21.15.71:0/1172991684 shutdown_connections 2024-04-20T21:20:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.733+0000 7ff3a9000640 1 -- 172.21.15.71:0/1172991684 wait complete. 2024-04-20T21:20:28.750 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:28.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.950+0000 7f5a6a400640 1 Processor -- start 2024-04-20T21:20:28.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.950+0000 7f5a6a400640 1 -- start start 2024-04-20T21:20:28.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.952+0000 7f5a6a400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5a64156c20 0x7f5a6406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.952+0000 7f5a6a400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5a6415ca40 0x7f5a640ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.952+0000 7f5a6a400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a64141c60 con 0x7f5a640ad8e0 2024-04-20T21:20:28.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.952+0000 7f5a6a400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5a6415cf90 con 0x7f5a64156c20 2024-04-20T21:20:28.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.952+0000 7f5a6a400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5a6415d270 con 0x7f5a6415ca40 2024-04-20T21:20:28.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.952+0000 7f5a63400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5a64156c20 0x7f5a6406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.952+0000 7f5a63e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5a640ad8e0 0x7f5a640d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51996/0 (socket says 172.21.15.71:51996) 2024-04-20T21:20:28.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.952+0000 7f5a63e00640 1 -- 172.21.15.71:0/5924897 learned_addr learned my addr 172.21.15.71:0/5924897 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:28.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.953+0000 7f5a5be00640 1 --2- 172.21.15.71:0/5924897 >> v2:172.21.15.137:3300/0 conn(0x7f5a6415ca40 0x7f5a640ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.953+0000 7f5a63400640 1 -- 172.21.15.71:0/5924897 >> v2:172.21.15.137:3300/0 conn(0x7f5a6415ca40 msgr2=0x7f5a640ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:28.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.953+0000 7f5a63400640 1 --2- 172.21.15.71:0/5924897 >> v2:172.21.15.137:3300/0 conn(0x7f5a6415ca40 0x7f5a640ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.953+0000 7f5a63400640 1 -- 172.21.15.71:0/5924897 >> v1:172.21.15.71:6789/0 conn(0x7f5a640ad8e0 legacy=0x7f5a640d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.953+0000 7f5a63400640 1 -- 172.21.15.71:0/5924897 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6415d550 con 0x7f5a64156c20 2024-04-20T21:20:28.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.953+0000 7f5a62a00640 1 -- 172.21.15.71:0/5924897 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406302538 0 0) 0x7f5a64141c60 con 0x7f5a640ad8e0 2024-04-20T21:20:28.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.954+0000 7f5a63400640 1 --2- 172.21.15.71:0/5924897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a64156c20 0x7f5a6406b900 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5a6406fe40 tx=0x7f5a5402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0f447da278b105 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:28.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.954+0000 7f5a62a00640 1 -- 172.21.15.71:0/5924897 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a54035020 con 0x7f5a64156c20 2024-04-20T21:20:28.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.954+0000 7f5a62a00640 1 -- 172.21.15.71:0/5924897 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a54031830 con 0x7f5a64156c20 2024-04-20T21:20:28.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.954+0000 7f5a62a00640 1 -- 172.21.15.71:0/5924897 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a54031c00 con 0x7f5a64156c20 2024-04-20T21:20:28.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.955+0000 7f5a6a400640 1 -- 172.21.15.71:0/5924897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a64156c20 msgr2=0x7f5a6406b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.955+0000 7f5a6a400640 1 --2- 172.21.15.71:0/5924897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a64156c20 0x7f5a6406b900 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5a6406fe40 tx=0x7f5a5402b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.955+0000 7f5a6a400640 1 -- 172.21.15.71:0/5924897 shutdown_connections 2024-04-20T21:20:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.955+0000 7f5a6a400640 1 --2- 172.21.15.71:0/5924897 >> v2:172.21.15.137:3300/0 conn(0x7f5a6415ca40 0x7f5a640ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.955+0000 7f5a6a400640 1 --2- 172.21.15.71:0/5924897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a64156c20 0x7f5a6406b900 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.955+0000 7f5a6a400640 1 -- 172.21.15.71:0/5924897 >> 172.21.15.71:0/5924897 conn(0x7f5a640b3350 msgr2=0x7f5a640b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.955+0000 7f5a6a400640 1 -- 172.21.15.71:0/5924897 shutdown_connections 2024-04-20T21:20:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.955+0000 7f5a6a400640 1 -- 172.21.15.71:0/5924897 wait complete. 2024-04-20T21:20:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.957+0000 7f5a6a400640 1 Processor -- start 2024-04-20T21:20:28.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.957+0000 7f5a6a400640 1 -- start start 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a6a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640ad8e0 0x7f5a64096d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a6a400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a64156c20 0x7f5a64153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a6a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a6415ca40 0x7f5a64153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a6a400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6406bfc0 con 0x7f5a640ad8e0 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a6a400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6406be40 con 0x7f5a6415ca40 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a6a400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5a640d0a70 con 0x7f5a64156c20 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a63400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640ad8e0 0x7f5a64096d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a63400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640ad8e0 0x7f5a64096d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57040/0 (socket says 172.21.15.71:57040) 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a63400640 1 -- 172.21.15.71:0/371569339 learned_addr learned my addr 172.21.15.71:0/371569339 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a63400640 1 -- 172.21.15.71:0/371569339 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a64156c20 msgr2=0x7f5a64153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a5be00640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a64156c20 0x7f5a64153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a63400640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a64156c20 0x7f5a64153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a63400640 1 -- 172.21.15.71:0/371569339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a6415ca40 msgr2=0x7f5a64153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:28.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a63400640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a6415ca40 0x7f5a64153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:28.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.958+0000 7f5a63400640 1 -- 172.21.15.71:0/371569339 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a64097280 con 0x7f5a640ad8e0 2024-04-20T21:20:28.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.959+0000 7f5a63400640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640ad8e0 0x7f5a64096d40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009890 tx=0x7f5a540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:28.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.959+0000 7f5a5b400640 1 -- 172.21.15.71:0/371569339 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a54041070 con 0x7f5a640ad8e0 2024-04-20T21:20:28.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.959+0000 7f5a5b400640 1 -- 172.21.15.71:0/371569339 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5403a950 con 0x7f5a640ad8e0 2024-04-20T21:20:28.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.959+0000 7f5a6a400640 1 -- 172.21.15.71:0/371569339 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a640ce5b0 con 0x7f5a640ad8e0 2024-04-20T21:20:28.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.959+0000 7f5a5b400640 1 -- 172.21.15.71:0/371569339 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a54035040 con 0x7f5a640ad8e0 2024-04-20T21:20:28.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.959+0000 7f5a6a400640 1 -- 172.21.15.71:0/371569339 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a640ceb70 con 0x7f5a640ad8e0 2024-04-20T21:20:28.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.960+0000 7f5a6a400640 1 -- 172.21.15.71:0/371569339 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a640cca20 con 0x7f5a640ad8e0 2024-04-20T21:20:28.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.961+0000 7f5a5b400640 1 -- 172.21.15.71:0/371569339 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a54038020 con 0x7f5a640ad8e0 2024-04-20T21:20:28.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.962+0000 7f5a5b400640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4006c920 0x7f5a4006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:28.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.962+0000 7f5a5b400640 1 -- 172.21.15.71:0/371569339 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f5a540ad980 con 0x7f5a640ad8e0 2024-04-20T21:20:28.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.962+0000 7f5a5be00640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4006c920 0x7f5a4006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:28.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.963+0000 7f5a5be00640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4006c920 0x7f5a4006ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c006fd0 tx=0x7f5a4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:28.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:28.967+0000 7f5a5b400640 1 -- 172.21.15.71:0/371569339 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5a64097280 con 0x7f5a640ad8e0 2024-04-20T21:20:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.152+0000 7f5a6a400640 1 -- 172.21.15.71:0/371569339 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5a64068980 con 0x7f5a640ad8e0 2024-04-20T21:20:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.153+0000 7f5a5b400640 1 -- 172.21.15.71:0/371569339 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f5a5407b980 con 0x7f5a640ad8e0 2024-04-20T21:20:29.153 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:29.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 -- 172.21.15.71:0/371569339 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4006c920 msgr2=0x7f5a4006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4006c920 0x7f5a4006ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c006fd0 tx=0x7f5a4c008040 comp rx=0 tx=0).stop 2024-04-20T21:20:29.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 -- 172.21.15.71:0/371569339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640ad8e0 msgr2=0x7f5a64096d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640ad8e0 0x7f5a64096d40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009890 tx=0x7f5a540046c0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 -- 172.21.15.71:0/371569339 shutdown_connections 2024-04-20T21:20:29.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a4006c920 0x7f5a4006ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a6415ca40 0x7f5a64153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a64156c20 0x7f5a64153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 --2- 172.21.15.71:0/371569339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a640ad8e0 0x7f5a64096d40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 -- 172.21.15.71:0/371569339 >> 172.21.15.71:0/371569339 conn(0x7f5a640b3350 msgr2=0x7f5a64154ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:29.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 -- 172.21.15.71:0/371569339 shutdown_connections 2024-04-20T21:20:29.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.155+0000 7f5a6a400640 1 -- 172.21.15.71:0/371569339 wait complete. 2024-04-20T21:20:29.172 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:29.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.367+0000 7fafc7e00640 1 Processor -- start 2024-04-20T21:20:29.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.368+0000 7fafc7e00640 1 -- start start 2024-04-20T21:20:29.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.369+0000 7fafc7e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fafc8161a50 0x7fafc80b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.369+0000 7fafc7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafc80d3b20 0x7fafc806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.369+0000 7fafc7e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafc80d0980 con 0x7fafc80d0480 2024-04-20T21:20:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.369+0000 7fafc7e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fafc80d0c60 con 0x7fafc8161a50 2024-04-20T21:20:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.369+0000 7fafc7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fafc8162ae0 con 0x7fafc80d3b20 2024-04-20T21:20:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.369+0000 7fafc6a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fafc8161a50 0x7fafc80b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.369+0000 7fafc7400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fafc80d0480 0x7fafc806c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52006/0 (socket says 172.21.15.71:52006) 2024-04-20T21:20:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.369+0000 7fafc7400640 1 -- 172.21.15.71:0/2753014886 learned_addr learned my addr 172.21.15.71:0/2753014886 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.370+0000 7fafc6000640 1 --2- 172.21.15.71:0/2753014886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafc80d3b20 0x7fafc806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.370+0000 7fafc5600640 1 -- 172.21.15.71:0/2753014886 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1260668432 0 0) 0x7fafc80d0980 con 0x7fafc80d0480 2024-04-20T21:20:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.370+0000 7fafc5600640 1 -- 172.21.15.71:0/2753014886 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafac003520 con 0x7fafc80d0480 2024-04-20T21:20:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.370+0000 7fafc6a00640 1 -- 172.21.15.71:0/2753014886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafc80d3b20 msgr2=0x7fafc806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.370+0000 7fafc6a00640 1 --2- 172.21.15.71:0/2753014886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafc80d3b20 0x7fafc806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.370+0000 7fafc6a00640 1 -- 172.21.15.71:0/2753014886 >> v1:172.21.15.71:6789/0 conn(0x7fafc80d0480 legacy=0x7fafc806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.370+0000 7fafc6a00640 1 -- 172.21.15.71:0/2753014886 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc8162490 con 0x7fafc8161a50 2024-04-20T21:20:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.371+0000 7fafc6a00640 1 --2- 172.21.15.71:0/2753014886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafc8161a50 0x7fafc80b3180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fafb80097a0 tx=0x7fafb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ecda55c03489c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.371+0000 7fafc5600640 1 -- 172.21.15.71:0/2753014886 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8035020 con 0x7fafc8161a50 2024-04-20T21:20:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.371+0000 7fafc5600640 1 -- 172.21.15.71:0/2753014886 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb8031830 con 0x7fafc8161a50 2024-04-20T21:20:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.372+0000 7fafc5600640 1 -- 172.21.15.71:0/2753014886 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8031be0 con 0x7fafc8161a50 2024-04-20T21:20:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.372+0000 7fafc7e00640 1 -- 172.21.15.71:0/2753014886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafc8161a50 msgr2=0x7fafc80b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.372+0000 7fafc7e00640 1 --2- 172.21.15.71:0/2753014886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafc8161a50 0x7fafc80b3180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fafb80097a0 tx=0x7fafb802b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.372+0000 7fafc7e00640 1 -- 172.21.15.71:0/2753014886 shutdown_connections 2024-04-20T21:20:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.372+0000 7fafc7e00640 1 --2- 172.21.15.71:0/2753014886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafc80d3b20 0x7fafc806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.372+0000 7fafc7e00640 1 --2- 172.21.15.71:0/2753014886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafc8161a50 0x7fafc80b3180 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.372+0000 7fafc7e00640 1 -- 172.21.15.71:0/2753014886 >> 172.21.15.71:0/2753014886 conn(0x7fafc80d0ed0 msgr2=0x7fafc80d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.372+0000 7fafc7e00640 1 -- 172.21.15.71:0/2753014886 shutdown_connections 2024-04-20T21:20:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.372+0000 7fafc7e00640 1 -- 172.21.15.71:0/2753014886 wait complete. 2024-04-20T21:20:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.374+0000 7fafc7e00640 1 Processor -- start 2024-04-20T21:20:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.374+0000 7fafc7e00640 1 -- start start 2024-04-20T21:20:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.375+0000 7fafc7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafc80d0480 0x7fafc815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.375+0000 7fafc7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafc8161a50 0x7fafc80ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.375+0000 7fafc7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafc80cd300 0x7fafc80ac560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.375+0000 7fafc7e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fafc8161fb0 con 0x7fafc8161a50 2024-04-20T21:20:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.375+0000 7fafc7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafc8161e30 con 0x7fafc80cd300 2024-04-20T21:20:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.375+0000 7fafc7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fafc8162130 con 0x7fafc80d0480 2024-04-20T21:20:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.375+0000 7fafc6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafc8161a50 0x7fafc80ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.375+0000 7fafc6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafc8161a50 0x7fafc80ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57060/0 (socket says 172.21.15.71:57060) 2024-04-20T21:20:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.375+0000 7fafc6000640 1 -- 172.21.15.71:0/3802111789 learned_addr learned my addr 172.21.15.71:0/3802111789 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.376+0000 7fafc6000640 1 -- 172.21.15.71:0/3802111789 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafc80d0480 msgr2=0x7fafc815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.376+0000 7fafc6000640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafc80d0480 0x7fafc815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.376+0000 7fafc6000640 1 -- 172.21.15.71:0/3802111789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafc80cd300 msgr2=0x7fafc80ac560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.376+0000 7fafc7400640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafc80cd300 0x7fafc80ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.376+0000 7fafc6000640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafc80cd300 0x7fafc80ac560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.376+0000 7fafc6000640 1 -- 172.21.15.71:0/3802111789 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc80ad2d0 con 0x7fafc8161a50 2024-04-20T21:20:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.376+0000 7fafc7400640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafc80cd300 0x7fafc80ac560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.376+0000 7fafc6000640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafc8161a50 0x7fafc80ccdc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fafb000d830 tx=0x7fafb000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.376+0000 7fafbea00640 1 -- 172.21.15.71:0/3802111789 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb000b6c0 con 0x7fafc8161a50 2024-04-20T21:20:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.377+0000 7fafbea00640 1 -- 172.21.15.71:0/3802111789 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0019070 con 0x7fafc8161a50 2024-04-20T21:20:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.377+0000 7fafbea00640 1 -- 172.21.15.71:0/3802111789 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb000ba80 con 0x7fafc8161a50 2024-04-20T21:20:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.377+0000 7fafc7e00640 1 -- 172.21.15.71:0/3802111789 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc80ad5b0 con 0x7fafc8161a50 2024-04-20T21:20:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.377+0000 7fafc7e00640 1 -- 172.21.15.71:0/3802111789 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc80adb70 con 0x7fafc8161a50 2024-04-20T21:20:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.378+0000 7fafc7e00640 1 -- 172.21.15.71:0/3802111789 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc80cd710 con 0x7fafc8161a50 2024-04-20T21:20:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.379+0000 7fafbea00640 1 -- 172.21.15.71:0/3802111789 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fafb001e460 con 0x7fafc8161a50 2024-04-20T21:20:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.380+0000 7fafbea00640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fafa406c8f0 0x7fafa406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.380+0000 7fafbea00640 1 -- 172.21.15.71:0/3802111789 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fafb008c5f0 con 0x7fafc8161a50 2024-04-20T21:20:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.380+0000 7fafc6a00640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fafa406c8f0 0x7fafa406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.381+0000 7fafc6a00640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fafa406c8f0 0x7fafa406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fafb8036000 tx=0x7fafb8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:29.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.384+0000 7fafbea00640 1 -- 172.21.15.71:0/3802111789 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fafc80cd710 con 0x7fafc8161a50 2024-04-20T21:20:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.582+0000 7fafc7e00640 1 -- 172.21.15.71:0/3802111789 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fafc8075b30 con 0x7fafc8161a50 2024-04-20T21:20:29.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.583+0000 7fafbea00640 1 -- 172.21.15.71:0/3802111789 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fafb005a5f0 con 0x7fafc8161a50 2024-04-20T21:20:29.596 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:29.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.585+0000 7fafc7e00640 1 -- 172.21.15.71:0/3802111789 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fafa406c8f0 msgr2=0x7fafa406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.585+0000 7fafc7e00640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fafa406c8f0 0x7fafa406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fafb8036000 tx=0x7fafb8030000 comp rx=0 tx=0).stop 2024-04-20T21:20:29.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.585+0000 7fafc7e00640 1 -- 172.21.15.71:0/3802111789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafc8161a50 msgr2=0x7fafc80ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.585+0000 7fafc7e00640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafc8161a50 0x7fafc80ccdc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fafb000d830 tx=0x7fafb000dcf0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.586+0000 7fafc7e00640 1 -- 172.21.15.71:0/3802111789 shutdown_connections 2024-04-20T21:20:29.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.586+0000 7fafc7e00640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fafa406c8f0 0x7fafa406edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.586+0000 7fafc7e00640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafc80cd300 0x7fafc80ac560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.586+0000 7fafc7e00640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafc8161a50 0x7fafc80ccdc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.586+0000 7fafc7e00640 1 --2- 172.21.15.71:0/3802111789 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafc80d0480 0x7fafc815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.586+0000 7fafc7e00640 1 -- 172.21.15.71:0/3802111789 >> 172.21.15.71:0/3802111789 conn(0x7fafc80d0ed0 msgr2=0x7fafc80b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:29.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.586+0000 7fafc7e00640 1 -- 172.21.15.71:0/3802111789 shutdown_connections 2024-04-20T21:20:29.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.586+0000 7fafc7e00640 1 -- 172.21.15.71:0/3802111789 wait complete. 2024-04-20T21:20:29.651 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-20T21:20:29.651 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:29.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.852+0000 7f8de7400640 1 Processor -- start 2024-04-20T21:20:29.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.852+0000 7f8de7400640 1 -- start start 2024-04-20T21:20:29.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.854+0000 7f8de7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de006dcb0 0x7f8de0071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.854+0000 7f8de7400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8de00ade40 con 0x7f8de015b3b0 2024-04-20T21:20:29.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.854+0000 7f8de7400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8de00ae0e0 con 0x7f8de0072090 2024-04-20T21:20:29.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.854+0000 7f8de7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8de006f1b0 con 0x7f8de006dcb0 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.854+0000 7f8de4a00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8de015b3b0 0x7f8de006eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52020/0 (socket says 172.21.15.71:52020) 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.854+0000 7f8de4a00640 1 -- 172.21.15.71:0/746816218 learned_addr learned my addr 172.21.15.71:0/746816218 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877636556 0 0) 0x7f8de00ade40 con 0x7f8de015b3b0 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8dd7e00640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de006dcb0 0x7f8de0071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc4005730 con 0x7f8de015b3b0 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2660866012 0 0) 0x7f8dc4005730 con 0x7f8de015b3b0 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de006dcb0 msgr2=0x7f8de0071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de006dcb0 0x7f8de0071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 >> v1:172.21.15.137:6789/0 conn(0x7f8de0072090 legacy=0x7f8de00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de015b790 con 0x7f8de015b3b0 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f8dd0001690 con 0x7f8de015b3b0 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 >> v1:172.21.15.71:6789/0 conn(0x7f8de015b3b0 legacy=0x7f8de006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dc4005bf0 0x7f8dc4006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dc4006a10 0x7f8dc4006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de006dcb0 0x7f8dc4007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8de006f1b0 con 0x7f8dc4005bf0 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc400dd00 con 0x7f8dc4006a10 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc400df00 con 0x7f8de006dcb0 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.855+0000 7f8de4a00640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dc4005bf0 0x7f8dc4006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.856+0000 7f8de5400640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de006dcb0 0x7f8dc4007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.856+0000 7f8dd7e00640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dc4006a10 0x7f8dc4006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.856+0000 7f8de4a00640 1 -- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de006dcb0 msgr2=0x7f8dc4007410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.856+0000 7f8de4a00640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8de006dcb0 0x7f8dc4007410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.856+0000 7f8de4a00640 1 -- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dc4006a10 msgr2=0x7f8dc4006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.856+0000 7f8de4a00640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dc4006a10 0x7f8dc4006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.856+0000 7f8de4a00640 1 -- 172.21.15.71:0/746816218 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc4005730 con 0x7f8dc4005bf0 2024-04-20T21:20:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.856+0000 7f8dd7e00640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dc4006a10 0x7f8dc4006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.857+0000 7f8de4a00640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dc4005bf0 0x7f8dc4006010 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0007fd0 tx=0x7f8dc4007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d20bec90d1a5d68 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.857+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0007d50 con 0x7f8dc4005bf0 2024-04-20T21:20:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.857+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd0030070 con 0x7f8dc4005bf0 2024-04-20T21:20:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.857+0000 7f8ddfe00640 1 -- 172.21.15.71:0/746816218 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0005d30 con 0x7f8dc4005bf0 2024-04-20T21:20:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.858+0000 7f8de7400640 1 -- 172.21.15.71:0/746816218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dc4005bf0 msgr2=0x7f8dc4006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.858+0000 7f8de7400640 1 --2- 172.21.15.71:0/746816218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dc4005bf0 0x7f8dc4006010 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0007fd0 tx=0x7f8dc4007a40 comp rx=0 tx=0).stop 2024-04-20T21:20:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.858+0000 7f8de5400640 1 -- 172.21.15.71:0/746816218 reap_dead start 2024-04-20T21:20:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.858+0000 7f8de7400640 1 -- 172.21.15.71:0/746816218 shutdown_connections 2024-04-20T21:20:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.858+0000 7f8de7400640 1 -- 172.21.15.71:0/746816218 >> 172.21.15.71:0/746816218 conn(0x7f8de00b3350 msgr2=0x7f8de00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.858+0000 7f8de7400640 1 -- 172.21.15.71:0/746816218 shutdown_connections 2024-04-20T21:20:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.858+0000 7f8de7400640 1 -- 172.21.15.71:0/746816218 wait complete. 2024-04-20T21:20:29.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.860+0000 7f8de7400640 1 Processor -- start 2024-04-20T21:20:29.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.860+0000 7f8de7400640 1 -- start start 2024-04-20T21:20:29.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.861+0000 7f8de7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8dc4005bf0 0x7f8de00ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.861+0000 7f8de7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de00727f0 0x7f8de0072c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.861+0000 7f8de7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8de00aef90 0x7f8de00af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.861+0000 7f8de7400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8de00ae940 con 0x7f8de00727f0 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.861+0000 7f8de7400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8de00ae6e0 con 0x7f8de00aef90 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.861+0000 7f8de7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8de00aec20 con 0x7f8dc4005bf0 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.861+0000 7f8dd7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de00727f0 0x7f8de0072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.861+0000 7f8dd7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de00727f0 0x7f8de0072c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57080/0 (socket says 172.21.15.71:57080) 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.861+0000 7f8dd7e00640 1 -- 172.21.15.71:0/983600594 learned_addr learned my addr 172.21.15.71:0/983600594 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8de4a00640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8dc4005bf0 0x7f8de00ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8dd7e00640 1 -- 172.21.15.71:0/983600594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8dc4005bf0 msgr2=0x7f8de00ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8dd7e00640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8dc4005bf0 0x7f8de00ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8dd7e00640 1 -- 172.21.15.71:0/983600594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8de00aef90 msgr2=0x7f8de00af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8dd7e00640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8de00aef90 0x7f8de00af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:29.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8dd7e00640 1 -- 172.21.15.71:0/983600594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de015cc10 con 0x7f8de00727f0 2024-04-20T21:20:29.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8de4a00640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8dc4005bf0 0x7f8de00ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:29.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8dd7e00640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de00727f0 0x7f8de0072c70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800e7e0 tx=0x7f8dc800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:29.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8ddd600640 1 -- 172.21.15.71:0/983600594 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8017070 con 0x7f8de00727f0 2024-04-20T21:20:29.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8ddd600640 1 -- 172.21.15.71:0/983600594 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc800c6d0 con 0x7f8de00727f0 2024-04-20T21:20:29.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8ddd600640 1 -- 172.21.15.71:0/983600594 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800f040 con 0x7f8de00727f0 2024-04-20T21:20:29.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8de7400640 1 -- 172.21.15.71:0/983600594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de00af950 con 0x7f8de00727f0 2024-04-20T21:20:29.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.862+0000 7f8de7400640 1 -- 172.21.15.71:0/983600594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de00afef0 con 0x7f8de00727f0 2024-04-20T21:20:29.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.863+0000 7f8de7400640 1 -- 172.21.15.71:0/983600594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de00731b0 con 0x7f8de00727f0 2024-04-20T21:20:29.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.865+0000 7f8ddd600640 1 -- 172.21.15.71:0/983600594 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8dc801a070 con 0x7f8de00727f0 2024-04-20T21:20:29.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.866+0000 7f8ddd600640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dbc06c920 0x7f8dbc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:29.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.866+0000 7f8ddd600640 1 -- 172.21.15.71:0/983600594 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f8dc808bab0 con 0x7f8de00727f0 2024-04-20T21:20:29.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.866+0000 7f8de4a00640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dbc06c920 0x7f8dbc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:29.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.867+0000 7f8de4a00640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dbc06c920 0x7f8dbc06ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0034000 tx=0x7f8dd0039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:29.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:29.871+0000 7f8ddd600640 1 -- 172.21.15.71:0/983600594 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8dc8059a20 con 0x7f8de00727f0 2024-04-20T21:20:30.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.070+0000 7f8de7400640 1 -- 172.21.15.71:0/983600594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8de0068980 con 0x7f8de00727f0 2024-04-20T21:20:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.072+0000 7f8ddd600640 1 -- 172.21.15.71:0/983600594 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7f8dc8059320 con 0x7f8de00727f0 2024-04-20T21:20:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:30.073 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:30.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.075+0000 7f8de7400640 1 -- 172.21.15.71:0/983600594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dbc06c920 msgr2=0x7f8dbc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.075+0000 7f8de7400640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dbc06c920 0x7f8dbc06ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0034000 tx=0x7f8dd0039040 comp rx=0 tx=0).stop 2024-04-20T21:20:30.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.075+0000 7f8de7400640 1 -- 172.21.15.71:0/983600594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de00727f0 msgr2=0x7f8de0072c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.075+0000 7f8de7400640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de00727f0 0x7f8de0072c70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800e7e0 tx=0x7f8dc800eca0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.075+0000 7f8de7400640 1 -- 172.21.15.71:0/983600594 shutdown_connections 2024-04-20T21:20:30.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.075+0000 7f8de7400640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8dbc06c920 0x7f8dbc06ede0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.075+0000 7f8de7400640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8de00aef90 0x7f8de00af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.075+0000 7f8de7400640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8de00727f0 0x7f8de0072c70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.075+0000 7f8de7400640 1 --2- 172.21.15.71:0/983600594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8dc4005bf0 0x7f8de00ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.075+0000 7f8de7400640 1 -- 172.21.15.71:0/983600594 >> 172.21.15.71:0/983600594 conn(0x7f8de00b3350 msgr2=0x7f8de015ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:30.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.075+0000 7f8de7400640 1 -- 172.21.15.71:0/983600594 shutdown_connections 2024-04-20T21:20:30.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.076+0000 7f8de7400640 1 -- 172.21.15.71:0/983600594 wait complete. 2024-04-20T21:20:30.095 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:30.095 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.297+0000 7f55ddc00640 1 Processor -- start 2024-04-20T21:20:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.297+0000 7f55ddc00640 1 -- start start 2024-04-20T21:20:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.299+0000 7f55ddc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f55d815a130 0x7f55d8073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.299+0000 7f55ddc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d806f870 0x7f55d80739b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.299+0000 7f55ddc00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d815cc20 con 0x7f55d8071a60 2024-04-20T21:20:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.299+0000 7f55ddc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f55d815d7f0 con 0x7f55d815a130 2024-04-20T21:20:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.299+0000 7f55ddc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55d815cec0 con 0x7f55d806f870 2024-04-20T21:20:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.299+0000 7f55d7400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f55d8071a60 0x7f55d806f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52024/0 (socket says 172.21.15.71:52024) 2024-04-20T21:20:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.299+0000 7f55d7400640 1 -- 172.21.15.71:0/2160817921 learned_addr learned my addr 172.21.15.71:0/2160817921 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55dd200640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d806f870 0x7f55d80739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d7e00640 1 --2- 172.21.15.71:0/2160817921 >> v2:172.21.15.137:3300/0 conn(0x7f55d815a130 0x7f55d8073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616454982 0 0) 0x7f55d815cc20 con 0x7f55d8071a60 2024-04-20T21:20:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55bc003520 con 0x7f55d8071a60 2024-04-20T21:20:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 780234382 0 0) 0x7f55bc003520 con 0x7f55d8071a60 2024-04-20T21:20:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d806f870 msgr2=0x7f55d80739b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d806f870 0x7f55d80739b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 >> v2:172.21.15.137:3300/0 conn(0x7f55d815a130 msgr2=0x7f55d8073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 --2- 172.21.15.71:0/2160817921 >> v2:172.21.15.137:3300/0 conn(0x7f55d815a130 0x7f55d8073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d815d1a0 con 0x7f55d8071a60 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f55c4001670 con 0x7f55d8071a60 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 >> v1:172.21.15.71:6789/0 conn(0x7f55d8071a60 legacy=0x7f55d806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc0039b0 0x7f55bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc004800 0x7f55bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d806f870 0x7f55bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55d815d7f0 con 0x7f55bc0039b0 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55d815cec0 con 0x7f55bc004800 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.300+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55bc00ba70 con 0x7f55d806f870 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.301+0000 7f55d7e00640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc0039b0 0x7f55bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.301+0000 7f55d7400640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc004800 0x7f55bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.301+0000 7f55dd200640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d806f870 0x7f55bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.301+0000 7f55d7e00640 1 -- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d806f870 msgr2=0x7f55bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.301+0000 7f55d7e00640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d806f870 0x7f55bc0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.301+0000 7f55d7e00640 1 -- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc004800 msgr2=0x7f55bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.301+0000 7f55d7e00640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc004800 0x7f55bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.301+0000 7f55d7e00640 1 -- 172.21.15.71:0/2160817921 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc003520 con 0x7f55bc0039b0 2024-04-20T21:20:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.301+0000 7f55d7400640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc004800 0x7f55bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.302+0000 7f55d7e00640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc0039b0 0x7f55bc003dd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009ac0 tx=0x7f55bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9eee4905e07c55d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.302+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c8039070 con 0x7f55bc0039b0 2024-04-20T21:20:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.302+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c802c710 con 0x7f55bc0039b0 2024-04-20T21:20:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.302+0000 7f55d6a00640 1 -- 172.21.15.71:0/2160817921 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c8009690 con 0x7f55bc0039b0 2024-04-20T21:20:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.303+0000 7f55ddc00640 1 -- 172.21.15.71:0/2160817921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc0039b0 msgr2=0x7f55bc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.303+0000 7f55ddc00640 1 --2- 172.21.15.71:0/2160817921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc0039b0 0x7f55bc003dd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009ac0 tx=0x7f55bc005830 comp rx=0 tx=0).stop 2024-04-20T21:20:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.303+0000 7f55dd200640 1 -- 172.21.15.71:0/2160817921 reap_dead start 2024-04-20T21:20:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.303+0000 7f55ddc00640 1 -- 172.21.15.71:0/2160817921 shutdown_connections 2024-04-20T21:20:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.303+0000 7f55ddc00640 1 -- 172.21.15.71:0/2160817921 >> 172.21.15.71:0/2160817921 conn(0x7f55d80cffa0 msgr2=0x7f55d80d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.303+0000 7f55ddc00640 1 -- 172.21.15.71:0/2160817921 shutdown_connections 2024-04-20T21:20:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.303+0000 7f55ddc00640 1 -- 172.21.15.71:0/2160817921 wait complete. 2024-04-20T21:20:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.305+0000 7f55ddc00640 1 Processor -- start 2024-04-20T21:20:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.305+0000 7f55ddc00640 1 -- start start 2024-04-20T21:20:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.306+0000 7f55ddc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc0039b0 0x7f55d8153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.306+0000 7f55ddc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d8149a50 0x7f55d80b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.306+0000 7f55ddc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d809d630 0x7f55d809dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.306+0000 7f55ddc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55d8073b30 con 0x7f55d809d630 2024-04-20T21:20:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.306+0000 7f55ddc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55d80739b0 con 0x7f55bc0039b0 2024-04-20T21:20:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.306+0000 7f55ddc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55d8073cb0 con 0x7f55d8149a50 2024-04-20T21:20:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.306+0000 7f55dd200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d809d630 0x7f55d809dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.306+0000 7f55dd200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d809d630 0x7f55d809dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57092/0 (socket says 172.21.15.71:57092) 2024-04-20T21:20:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.306+0000 7f55dd200640 1 -- 172.21.15.71:0/2437803874 learned_addr learned my addr 172.21.15.71:0/2437803874 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.306+0000 7f55dd200640 1 -- 172.21.15.71:0/2437803874 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d8149a50 msgr2=0x7f55d80b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.306+0000 7f55dd200640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d8149a50 0x7f55d80b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.307+0000 7f55dd200640 1 -- 172.21.15.71:0/2437803874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc0039b0 msgr2=0x7f55d8153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.307+0000 7f55dd200640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc0039b0 0x7f55d8153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.307+0000 7f55dd200640 1 -- 172.21.15.71:0/2437803874 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d809c590 con 0x7f55d809d630 2024-04-20T21:20:30.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.307+0000 7f55dd200640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d809d630 0x7f55d809dab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f55d0009fd0 tx=0x7f55d000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:30.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.307+0000 7f55cfe00640 1 -- 172.21.15.71:0/2437803874 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d001c070 con 0x7f55d809d630 2024-04-20T21:20:30.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.307+0000 7f55cfe00640 1 -- 172.21.15.71:0/2437803874 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d0017400 con 0x7f55d809d630 2024-04-20T21:20:30.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.307+0000 7f55cfe00640 1 -- 172.21.15.71:0/2437803874 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d00177f0 con 0x7f55d809d630 2024-04-20T21:20:30.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.307+0000 7f55ddc00640 1 -- 172.21.15.71:0/2437803874 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d809c870 con 0x7f55d809d630 2024-04-20T21:20:30.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.307+0000 7f55ddc00640 1 -- 172.21.15.71:0/2437803874 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d809ce30 con 0x7f55d809d630 2024-04-20T21:20:30.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.308+0000 7f55ddc00640 1 -- 172.21.15.71:0/2437803874 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d806cd70 con 0x7f55d809d630 2024-04-20T21:20:30.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.309+0000 7f55cfe00640 1 -- 172.21.15.71:0/2437803874 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f55d0005d10 con 0x7f55d809d630 2024-04-20T21:20:30.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.310+0000 7f55cfe00640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55b806c920 0x7f55b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.310+0000 7f55cfe00640 1 -- 172.21.15.71:0/2437803874 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f55d008c0f0 con 0x7f55d809d630 2024-04-20T21:20:30.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.310+0000 7f55d7e00640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55b806c920 0x7f55b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.311+0000 7f55d7e00640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55b806c920 0x7f55b806ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f55c8036000 tx=0x7f55c802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.314+0000 7f55cfe00640 1 -- 172.21.15.71:0/2437803874 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f55d806cd70 con 0x7f55d809d630 2024-04-20T21:20:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.512+0000 7f55ddc00640 1 -- 172.21.15.71:0/2437803874 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f55d80cfd70 con 0x7f55d809d630 2024-04-20T21:20:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.513+0000 7f55cfe00640 1 -- 172.21.15.71:0/2437803874 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f55d80cfd70 con 0x7f55d809d630 2024-04-20T21:20:30.513 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.515+0000 7f55ddc00640 1 -- 172.21.15.71:0/2437803874 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55b806c920 msgr2=0x7f55b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.515+0000 7f55ddc00640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55b806c920 0x7f55b806ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f55c8036000 tx=0x7f55c802e000 comp rx=0 tx=0).stop 2024-04-20T21:20:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.515+0000 7f55ddc00640 1 -- 172.21.15.71:0/2437803874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d809d630 msgr2=0x7f55d809dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.515+0000 7f55ddc00640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d809d630 0x7f55d809dab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f55d0009fd0 tx=0x7f55d000f4a0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.516+0000 7f55ddc00640 1 -- 172.21.15.71:0/2437803874 shutdown_connections 2024-04-20T21:20:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.516+0000 7f55ddc00640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55b806c920 0x7f55b806ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.516+0000 7f55ddc00640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d809d630 0x7f55d809dab0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.516+0000 7f55ddc00640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55d8149a50 0x7f55d80b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.516+0000 7f55ddc00640 1 --2- 172.21.15.71:0/2437803874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc0039b0 0x7f55d8153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.516+0000 7f55ddc00640 1 -- 172.21.15.71:0/2437803874 >> 172.21.15.71:0/2437803874 conn(0x7f55d80cffa0 msgr2=0x7f55d80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.516+0000 7f55ddc00640 1 -- 172.21.15.71:0/2437803874 shutdown_connections 2024-04-20T21:20:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.516+0000 7f55ddc00640 1 -- 172.21.15.71:0/2437803874 wait complete. 2024-04-20T21:20:30.535 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.739+0000 7fa7caa00640 1 Processor -- start 2024-04-20T21:20:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.739+0000 7fa7caa00640 1 -- start start 2024-04-20T21:20:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.741+0000 7fa7caa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7c415e8a0 0x7fa7c406e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.741+0000 7fa7caa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa7c40d0a70 0x7fa7c40ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.741+0000 7fa7caa00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c406f060 con 0x7fa7c406dbb0 2024-04-20T21:20:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.741+0000 7fa7caa00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c406e7c0 con 0x7fa7c40d0a70 2024-04-20T21:20:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.741+0000 7fa7caa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c406eaa0 con 0x7fa7c415e8a0 2024-04-20T21:20:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.741+0000 7fa7c3400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa7c406dbb0 0x7fa7c40d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52026/0 (socket says 172.21.15.71:52026) 2024-04-20T21:20:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.741+0000 7fa7c3400640 1 -- 172.21.15.71:0/3393925000 learned_addr learned my addr 172.21.15.71:0/3393925000 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.741+0000 7fa7c3e00640 1 --2- 172.21.15.71:0/3393925000 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7c415e8a0 0x7fa7c406e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.741+0000 7fa7c8a00640 1 --2- 172.21.15.71:0/3393925000 >> v2:172.21.15.137:3300/0 conn(0x7fa7c40d0a70 0x7fa7c40ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241822993 0 0) 0x7fa7c406f060 con 0x7fa7c406dbb0 2024-04-20T21:20:30.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7a8003520 con 0x7fa7c406dbb0 2024-04-20T21:20:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 569532561 0 0) 0x7fa7a8003520 con 0x7fa7c406dbb0 2024-04-20T21:20:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7c415e8a0 msgr2=0x7fa7c406e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 --2- 172.21.15.71:0/3393925000 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7c415e8a0 0x7fa7c406e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 >> v2:172.21.15.137:3300/0 conn(0x7fa7c40d0a70 msgr2=0x7fa7c40ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 --2- 172.21.15.71:0/3393925000 >> v2:172.21.15.137:3300/0 conn(0x7fa7c40d0a70 0x7fa7c40ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c406ed80 con 0x7fa7c406dbb0 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fa7b0001670 con 0x7fa7c406dbb0 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 >> v1:172.21.15.71:6789/0 conn(0x7fa7c406dbb0 legacy=0x7fa7c40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 --2- 172.21.15.71:0/3393925000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a80039b0 0x7fa7a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 --2- 172.21.15.71:0/3393925000 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7a8004800 0x7fa7a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 --2- 172.21.15.71:0/3393925000 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7c415e8a0 0x7fa7a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c406e7c0 con 0x7fa7a80039b0 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c406eaa0 con 0x7fa7a8004800 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a800b9c0 con 0x7fa7c415e8a0 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.742+0000 7fa7c3e00640 1 --2- 172.21.15.71:0/3393925000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a80039b0 0x7fa7a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.743+0000 7fa7c3e00640 1 -- 172.21.15.71:0/3393925000 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7c415e8a0 msgr2=0x7fa7a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.743+0000 7fa7c3e00640 1 --2- 172.21.15.71:0/3393925000 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7c415e8a0 0x7fa7a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.743+0000 7fa7c3e00640 1 -- 172.21.15.71:0/3393925000 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7a8004800 msgr2=0x7fa7a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.743+0000 7fa7c3e00640 1 --2- 172.21.15.71:0/3393925000 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7a8004800 0x7fa7a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.743+0000 7fa7c3e00640 1 -- 172.21.15.71:0/3393925000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a8003520 con 0x7fa7a80039b0 2024-04-20T21:20:30.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.744+0000 7fa7c3e00640 1 --2- 172.21.15.71:0/3393925000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a80039b0 0x7fa7a8003dd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009ac0 tx=0x7fa7a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353d851edee811df server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:30.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.744+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4039070 con 0x7fa7a80039b0 2024-04-20T21:20:30.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.744+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b402c710 con 0x7fa7a80039b0 2024-04-20T21:20:30.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.744+0000 7fa7c2a00640 1 -- 172.21.15.71:0/3393925000 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4009690 con 0x7fa7a80039b0 2024-04-20T21:20:30.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.745+0000 7fa7caa00640 1 -- 172.21.15.71:0/3393925000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a80039b0 msgr2=0x7fa7a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.745+0000 7fa7caa00640 1 --2- 172.21.15.71:0/3393925000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a80039b0 0x7fa7a8003dd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009ac0 tx=0x7fa7a8005830 comp rx=0 tx=0).stop 2024-04-20T21:20:30.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.745+0000 7fa7c8a00640 1 -- 172.21.15.71:0/3393925000 reap_dead start 2024-04-20T21:20:30.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.745+0000 7fa7caa00640 1 -- 172.21.15.71:0/3393925000 shutdown_connections 2024-04-20T21:20:30.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.745+0000 7fa7caa00640 1 -- 172.21.15.71:0/3393925000 >> 172.21.15.71:0/3393925000 conn(0x7fa7c40b3350 msgr2=0x7fa7c40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:30.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.745+0000 7fa7caa00640 1 -- 172.21.15.71:0/3393925000 shutdown_connections 2024-04-20T21:20:30.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.745+0000 7fa7caa00640 1 -- 172.21.15.71:0/3393925000 wait complete. 2024-04-20T21:20:30.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.747+0000 7fa7caa00640 1 Processor -- start 2024-04-20T21:20:30.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.747+0000 7fa7caa00640 1 -- start start 2024-04-20T21:20:30.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.748+0000 7fa7caa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a80039b0 0x7fa7c41448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.748+0000 7fa7caa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7c4150f90 0x7fa7c4151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.748+0000 7fa7caa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7c4152d00 0x7fa7c4153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.748+0000 7fa7caa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c406fef0 con 0x7fa7c4152d00 2024-04-20T21:20:30.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.748+0000 7fa7caa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c406fd70 con 0x7fa7c4150f90 2024-04-20T21:20:30.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.748+0000 7fa7caa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c406e1e0 con 0x7fa7a80039b0 2024-04-20T21:20:30.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.748+0000 7fa7c8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7c4152d00 0x7fa7c4153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.748+0000 7fa7c8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7c4152d00 0x7fa7c4153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57104/0 (socket says 172.21.15.71:57104) 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.748+0000 7fa7c8a00640 1 -- 172.21.15.71:0/3381696033 learned_addr learned my addr 172.21.15.71:0/3381696033 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.748+0000 7fa7c3e00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a80039b0 0x7fa7c41448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.748+0000 7fa7c3400640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7c4150f90 0x7fa7c4151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.749+0000 7fa7c8a00640 1 -- 172.21.15.71:0/3381696033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a80039b0 msgr2=0x7fa7c41448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.749+0000 7fa7c8a00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a80039b0 0x7fa7c41448f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.749+0000 7fa7c8a00640 1 -- 172.21.15.71:0/3381696033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7c4150f90 msgr2=0x7fa7c4151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.749+0000 7fa7c8a00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7c4150f90 0x7fa7c4151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.749+0000 7fa7c8a00640 1 -- 172.21.15.71:0/3381696033 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c4151b00 con 0x7fa7c4152d00 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.749+0000 7fa7c8a00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7c4152d00 0x7fa7c4153180 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00ea30 tx=0x7fa7bc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.749+0000 7fa7bbe00640 1 -- 172.21.15.71:0/3381696033 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc00bba0 con 0x7fa7c4152d00 2024-04-20T21:20:30.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.749+0000 7fa7bbe00640 1 -- 172.21.15.71:0/3381696033 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc01a070 con 0x7fa7c4152d00 2024-04-20T21:20:30.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.749+0000 7fa7bbe00640 1 -- 172.21.15.71:0/3381696033 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc014400 con 0x7fa7c4152d00 2024-04-20T21:20:30.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.749+0000 7fa7caa00640 1 -- 172.21.15.71:0/3381696033 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c4151de0 con 0x7fa7c4152d00 2024-04-20T21:20:30.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.749+0000 7fa7caa00640 1 -- 172.21.15.71:0/3381696033 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c41523a0 con 0x7fa7c4152d00 2024-04-20T21:20:30.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.750+0000 7fa7caa00640 1 -- 172.21.15.71:0/3381696033 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c4068980 con 0x7fa7c4152d00 2024-04-20T21:20:30.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.751+0000 7fa7bbe00640 1 -- 172.21.15.71:0/3381696033 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa7bc005d10 con 0x7fa7c4152d00 2024-04-20T21:20:30.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.752+0000 7fa7bbe00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa7a406c920 0x7fa7a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:30.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.752+0000 7fa7bbe00640 1 -- 172.21.15.71:0/3381696033 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fa7bc08c0a0 con 0x7fa7c4152d00 2024-04-20T21:20:30.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.752+0000 7fa7c3e00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa7a406c920 0x7fa7a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:30.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.753+0000 7fa7c3e00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa7a406c920 0x7fa7a406ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4036000 tx=0x7fa7b4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:30.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.756+0000 7fa7bbe00640 1 -- 172.21.15.71:0/3381696033 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa7bc024020 con 0x7fa7c4152d00 2024-04-20T21:20:30.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.954+0000 7fa7caa00640 1 -- 172.21.15.71:0/3381696033 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa7c406d160 con 0x7fa7c4152d00 2024-04-20T21:20:30.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.955+0000 7fa7bbe00640 1 -- 172.21.15.71:0/3381696033 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fa7bc05a010 con 0x7fa7c4152d00 2024-04-20T21:20:30.954 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.957+0000 7fa7caa00640 1 -- 172.21.15.71:0/3381696033 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa7a406c920 msgr2=0x7fa7a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.957+0000 7fa7caa00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa7a406c920 0x7fa7a406ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4036000 tx=0x7fa7b4030000 comp rx=0 tx=0).stop 2024-04-20T21:20:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.957+0000 7fa7caa00640 1 -- 172.21.15.71:0/3381696033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7c4152d00 msgr2=0x7fa7c4153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.957+0000 7fa7caa00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7c4152d00 0x7fa7c4153180 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00ea30 tx=0x7fa7bc00eef0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.957+0000 7fa7caa00640 1 -- 172.21.15.71:0/3381696033 shutdown_connections 2024-04-20T21:20:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.957+0000 7fa7caa00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa7a406c920 0x7fa7a406ede0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.957+0000 7fa7caa00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7c4152d00 0x7fa7c4153180 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.957+0000 7fa7caa00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7c4150f90 0x7fa7c4151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.957+0000 7fa7caa00640 1 --2- 172.21.15.71:0/3381696033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a80039b0 0x7fa7c41448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.957+0000 7fa7caa00640 1 -- 172.21.15.71:0/3381696033 >> 172.21.15.71:0/3381696033 conn(0x7fa7c40b3350 msgr2=0x7fa7c415d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.958+0000 7fa7caa00640 1 -- 172.21.15.71:0/3381696033 shutdown_connections 2024-04-20T21:20:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:30.958+0000 7fa7caa00640 1 -- 172.21.15.71:0/3381696033 wait complete. 2024-04-20T21:20:30.976 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:31.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.172+0000 7f78d5800640 1 Processor -- start 2024-04-20T21:20:31.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.173+0000 7f78d5800640 1 -- start start 2024-04-20T21:20:31.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.174+0000 7f78d5800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f78d0162210 0x7f78d0162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:31.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.174+0000 7f78d5800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78d00b3ba0 con 0x7f78d015e770 2024-04-20T21:20:31.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.174+0000 7f78d5800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78d00d3590 con 0x7f78d00b6400 2024-04-20T21:20:31.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.174+0000 7f78d5800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f78d015eb50 con 0x7f78d0162210 2024-04-20T21:20:31.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.175+0000 7f78cf400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f78d0162210 0x7f78d0162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:31.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.175+0000 7f78cfe00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f78d015e770 0x7f78d00b3490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52028/0 (socket says 172.21.15.71:52028) 2024-04-20T21:20:31.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.175+0000 7f78cfe00640 1 -- 172.21.15.71:0/2842607446 learned_addr learned my addr 172.21.15.71:0/2842607446 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:31.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.175+0000 7f78cf400640 1 -- 172.21.15.71:0/2842607446 >> v1:172.21.15.137:6789/0 conn(0x7f78d00b6400 legacy=0x7f78d00d42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:31.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.175+0000 7f78cf400640 1 -- 172.21.15.71:0/2842607446 >> v1:172.21.15.71:6789/0 conn(0x7f78d015e770 legacy=0x7f78d00b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.175+0000 7f78cf400640 1 -- 172.21.15.71:0/2842607446 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d00d3870 con 0x7f78d0162210 2024-04-20T21:20:31.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.175+0000 7f78cea00640 1 -- 172.21.15.71:0/2842607446 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 349455050 0 0) 0x7f78d00b3ba0 con 0x7f78d015e770 2024-04-20T21:20:31.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.176+0000 7f78cf400640 1 --2- 172.21.15.71:0/2842607446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78d0162210 0x7f78d0162670 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f78b80097a0 tx=0x7f78b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cadb68c2ea20fc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:31.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.177+0000 7f78cea00640 1 -- 172.21.15.71:0/2842607446 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b80315a0 con 0x7f78d0162210 2024-04-20T21:20:31.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.177+0000 7f78cea00640 1 -- 172.21.15.71:0/2842607446 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b8037070 con 0x7f78d0162210 2024-04-20T21:20:31.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.177+0000 7f78cea00640 1 -- 172.21.15.71:0/2842607446 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8031960 con 0x7f78d0162210 2024-04-20T21:20:31.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.178+0000 7f78d5800640 1 -- 172.21.15.71:0/2842607446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78d0162210 msgr2=0x7f78d0162670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.178+0000 7f78d5800640 1 --2- 172.21.15.71:0/2842607446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78d0162210 0x7f78d0162670 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f78b80097a0 tx=0x7f78b802b840 comp rx=0 tx=0).stop 2024-04-20T21:20:31.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.178+0000 7f78d5800640 1 -- 172.21.15.71:0/2842607446 shutdown_connections 2024-04-20T21:20:31.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.178+0000 7f78d5800640 1 --2- 172.21.15.71:0/2842607446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78d0162210 0x7f78d0162670 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.178+0000 7f78d5800640 1 -- 172.21.15.71:0/2842607446 >> 172.21.15.71:0/2842607446 conn(0x7f78d009d6d0 msgr2=0x7f78d00b92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:31.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.178+0000 7f78d5800640 1 -- 172.21.15.71:0/2842607446 shutdown_connections 2024-04-20T21:20:31.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.178+0000 7f78d5800640 1 -- 172.21.15.71:0/2842607446 wait complete. 2024-04-20T21:20:31.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.179+0000 7f78d5800640 1 Processor -- start 2024-04-20T21:20:31.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.180+0000 7f78d5800640 1 -- start start 2024-04-20T21:20:31.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.180+0000 7f78d5800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78d00b6400 0x7f78d015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:31.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.180+0000 7f78d5800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78d015e770 0x7f78d0161900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:31.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.180+0000 7f78d5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d0162210 0x7f78d01f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.180+0000 7f78d5800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f78d00d3e30 con 0x7f78d00b6400 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.180+0000 7f78d5800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78d00b5ee0 con 0x7f78d0162210 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.180+0000 7f78d5800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f78d00d3120 con 0x7f78d015e770 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.181+0000 7f78cfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78d00b6400 0x7f78d015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.181+0000 7f78cfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78d00b6400 0x7f78d015c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57128/0 (socket says 172.21.15.71:57128) 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.181+0000 7f78cfe00640 1 -- 172.21.15.71:0/1711913776 learned_addr learned my addr 172.21.15.71:0/1711913776 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.181+0000 7f78cf400640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78d015e770 0x7f78d0161900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.181+0000 7f78d4e00640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d0162210 0x7f78d01f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.181+0000 7f78cfe00640 1 -- 172.21.15.71:0/1711913776 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78d015e770 msgr2=0x7f78d0161900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.181+0000 7f78cfe00640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78d015e770 0x7f78d0161900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.181+0000 7f78cfe00640 1 -- 172.21.15.71:0/1711913776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d0162210 msgr2=0x7f78d01f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.181+0000 7f78cfe00640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d0162210 0x7f78d01f4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.181+0000 7f78cfe00640 1 -- 172.21.15.71:0/1711913776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d006d010 con 0x7f78d00b6400 2024-04-20T21:20:31.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.182+0000 7f78cfe00640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78d00b6400 0x7f78d015c2e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f78c000c430 tx=0x7f78c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:31.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.182+0000 7f78c7e00640 1 -- 172.21.15.71:0/1711913776 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c00074e0 con 0x7f78d00b6400 2024-04-20T21:20:31.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.182+0000 7f78c7e00640 1 -- 172.21.15.71:0/1711913776 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c00047e0 con 0x7f78d00b6400 2024-04-20T21:20:31.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.182+0000 7f78c7e00640 1 -- 172.21.15.71:0/1711913776 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0004bd0 con 0x7f78d00b6400 2024-04-20T21:20:31.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.182+0000 7f78d5800640 1 -- 172.21.15.71:0/1711913776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d006d2f0 con 0x7f78d00b6400 2024-04-20T21:20:31.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.182+0000 7f78d5800640 1 -- 172.21.15.71:0/1711913776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d006d8b0 con 0x7f78d00b6400 2024-04-20T21:20:31.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.183+0000 7f78d5800640 1 -- 172.21.15.71:0/1711913776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d0075b30 con 0x7f78d00b6400 2024-04-20T21:20:31.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.184+0000 7f78c7e00640 1 -- 172.21.15.71:0/1711913776 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78c0011070 con 0x7f78d00b6400 2024-04-20T21:20:31.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.186+0000 7f78c7e00640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f78ac06c8f0 0x7f78ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:31.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.186+0000 7f78c7e00640 1 -- 172.21.15.71:0/1711913776 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f78c008bc30 con 0x7f78d00b6400 2024-04-20T21:20:31.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.186+0000 7f78cf400640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f78ac06c8f0 0x7f78ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:31.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.187+0000 7f78cf400640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f78ac06c8f0 0x7f78ac06edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f78b8036000 tx=0x7f78b8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:31.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.190+0000 7f78c7e00640 1 -- 172.21.15.71:0/1711913776 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f78c0059c40 con 0x7f78d00b6400 2024-04-20T21:20:31.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.389+0000 7f78d5800640 1 -- 172.21.15.71:0/1711913776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f78d00cb170 con 0x7f78d00b6400 2024-04-20T21:20:31.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.389+0000 7f78c7e00640 1 -- 172.21.15.71:0/1711913776 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f78c0059540 con 0x7f78d00b6400 2024-04-20T21:20:31.389 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 -- 172.21.15.71:0/1711913776 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f78ac06c8f0 msgr2=0x7f78ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f78ac06c8f0 0x7f78ac06edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f78b8036000 tx=0x7f78b8008030 comp rx=0 tx=0).stop 2024-04-20T21:20:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 -- 172.21.15.71:0/1711913776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78d00b6400 msgr2=0x7f78d015c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78d00b6400 0x7f78d015c2e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f78c000c430 tx=0x7f78c000c8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 -- 172.21.15.71:0/1711913776 shutdown_connections 2024-04-20T21:20:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f78ac06c8f0 0x7f78ac06edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d0162210 0x7f78d01f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78d015e770 0x7f78d0161900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 --2- 172.21.15.71:0/1711913776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78d00b6400 0x7f78d015c2e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 -- 172.21.15.71:0/1711913776 >> 172.21.15.71:0/1711913776 conn(0x7f78d009d6d0 msgr2=0x7f78d00b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:31.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 -- 172.21.15.71:0/1711913776 shutdown_connections 2024-04-20T21:20:31.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.392+0000 7f78d5800640 1 -- 172.21.15.71:0/1711913776 wait complete. 2024-04-20T21:20:31.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:31.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.613+0000 7f4ba3200640 1 Processor -- start 2024-04-20T21:20:31.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.613+0000 7f4ba3200640 1 -- start start 2024-04-20T21:20:31.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.614+0000 7f4ba3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d4f0 0x7f4ba40ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:31.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.614+0000 7f4ba3200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4ba406e060 0x7f4ba406e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba3200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba406b900 con 0x7f4ba40aee60 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba3200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba406c510 con 0x7f4ba406e060 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba406bbe0 con 0x7f4ba415d4f0 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba1e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4ba40aee60 0x7f4ba40af240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52032/0 (socket says 172.21.15.71:52032) 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba1e00640 1 -- 172.21.15.71:0/1770216898 learned_addr learned my addr 172.21.15.71:0/1770216898 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba2800640 1 --2- 172.21.15.71:0/1770216898 >> v2:172.21.15.71:3300/0 conn(0x7f4ba406e060 0x7f4ba406e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba1400640 1 --2- 172.21.15.71:0/1770216898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d4f0 0x7f4ba40ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba0a00640 1 -- 172.21.15.71:0/1770216898 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136706134 0 0) 0x7f4ba406b900 con 0x7f4ba40aee60 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba0a00640 1 -- 172.21.15.71:0/1770216898 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b88003520 con 0x7f4ba40aee60 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba2800640 1 -- 172.21.15.71:0/1770216898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d4f0 msgr2=0x7f4ba40ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba2800640 1 --2- 172.21.15.71:0/1770216898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d4f0 0x7f4ba40ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba2800640 1 -- 172.21.15.71:0/1770216898 >> v1:172.21.15.71:6789/0 conn(0x7f4ba40aee60 legacy=0x7f4ba40af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba2800640 1 -- 172.21.15.71:0/1770216898 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba406bec0 con 0x7f4ba406e060 2024-04-20T21:20:31.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.615+0000 7f4ba1400640 1 --2- 172.21.15.71:0/1770216898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d4f0 0x7f4ba40ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:31.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.617+0000 7f4ba2800640 1 --2- 172.21.15.71:0/1770216898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ba406e060 0x7f4ba406e4c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009d90 tx=0x7f4b9c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88f7ae9c5621025 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:31.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.617+0000 7f4ba0a00640 1 -- 172.21.15.71:0/1770216898 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c039070 con 0x7f4ba406e060 2024-04-20T21:20:31.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.617+0000 7f4ba0a00640 1 -- 172.21.15.71:0/1770216898 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9c02cc60 con 0x7f4ba406e060 2024-04-20T21:20:31.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.617+0000 7f4ba0a00640 1 -- 172.21.15.71:0/1770216898 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c034660 con 0x7f4ba406e060 2024-04-20T21:20:31.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.617+0000 7f4ba3200640 1 -- 172.21.15.71:0/1770216898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ba406e060 msgr2=0x7f4ba406e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.617+0000 7f4ba3200640 1 --2- 172.21.15.71:0/1770216898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ba406e060 0x7f4ba406e4c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009d90 tx=0x7f4b9c02beb0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.618+0000 7f4ba3200640 1 -- 172.21.15.71:0/1770216898 shutdown_connections 2024-04-20T21:20:31.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.618+0000 7f4ba3200640 1 --2- 172.21.15.71:0/1770216898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ba406e060 0x7f4ba406e4c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.618+0000 7f4ba3200640 1 --2- 172.21.15.71:0/1770216898 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d4f0 0x7f4ba40ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.618+0000 7f4ba3200640 1 -- 172.21.15.71:0/1770216898 >> 172.21.15.71:0/1770216898 conn(0x7f4ba40b5270 msgr2=0x7f4ba40b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:31.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.618+0000 7f4ba3200640 1 -- 172.21.15.71:0/1770216898 shutdown_connections 2024-04-20T21:20:31.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.618+0000 7f4ba3200640 1 -- 172.21.15.71:0/1770216898 wait complete. 2024-04-20T21:20:31.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.619+0000 7f4ba3200640 1 Processor -- start 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.620+0000 7f4ba3200640 1 -- start start 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.620+0000 7f4ba3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba406e060 0x7f4ba41f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.620+0000 7f4ba3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ba40aee60 0x7f4ba4154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.620+0000 7f4ba3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba415d4f0 0x7f4ba4154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.620+0000 7f4ba3200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba40ad630 con 0x7f4ba40aee60 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.620+0000 7f4ba3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba406c9a0 con 0x7f4ba415d4f0 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.620+0000 7f4ba3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba40ad7b0 con 0x7f4ba406e060 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.621+0000 7f4ba1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ba40aee60 0x7f4ba4154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.621+0000 7f4ba1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ba40aee60 0x7f4ba4154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57138/0 (socket says 172.21.15.71:57138) 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.621+0000 7f4ba1400640 1 -- 172.21.15.71:0/2173960079 learned_addr learned my addr 172.21.15.71:0/2173960079 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.621+0000 7f4ba2800640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba415d4f0 0x7f4ba4154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:31.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.621+0000 7f4ba1e00640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba406e060 0x7f4ba41f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.621+0000 7f4ba1400640 1 -- 172.21.15.71:0/2173960079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba406e060 msgr2=0x7f4ba41f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.621+0000 7f4ba1400640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba406e060 0x7f4ba41f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.621+0000 7f4ba1400640 1 -- 172.21.15.71:0/2173960079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba415d4f0 msgr2=0x7f4ba4154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.621+0000 7f4ba1400640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba415d4f0 0x7f4ba4154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.621+0000 7f4ba1400640 1 -- 172.21.15.71:0/2173960079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba4151270 con 0x7f4ba40aee60 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.621+0000 7f4ba1e00640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba406e060 0x7f4ba41f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.622+0000 7f4ba1400640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ba40aee60 0x7f4ba4154150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000c7f0 tx=0x7f4b9000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.622+0000 7f4b9a000640 1 -- 172.21.15.71:0/2173960079 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90015070 con 0x7f4ba40aee60 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.622+0000 7f4b9a000640 1 -- 172.21.15.71:0/2173960079 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b90007a30 con 0x7f4ba40aee60 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.622+0000 7f4b9a000640 1 -- 172.21.15.71:0/2173960079 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90007e00 con 0x7f4ba40aee60 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.622+0000 7f4ba3200640 1 -- 172.21.15.71:0/2173960079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba415e2e0 con 0x7f4ba40aee60 2024-04-20T21:20:31.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.622+0000 7f4ba3200640 1 -- 172.21.15.71:0/2173960079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba415e8a0 con 0x7f4ba40aee60 2024-04-20T21:20:31.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.623+0000 7f4ba3200640 1 -- 172.21.15.71:0/2173960079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba40ae8a0 con 0x7f4ba40aee60 2024-04-20T21:20:31.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.624+0000 7f4b9a000640 1 -- 172.21.15.71:0/2173960079 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b90018070 con 0x7f4ba40aee60 2024-04-20T21:20:31.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.625+0000 7f4b9a000640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b8406c8f0 0x7f4b8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:31.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.625+0000 7f4b9a000640 1 -- 172.21.15.71:0/2173960079 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f4b9008bf50 con 0x7f4ba40aee60 2024-04-20T21:20:31.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.625+0000 7f4ba1e00640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b8406c8f0 0x7f4b8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:31.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.626+0000 7f4ba1e00640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b8406c8f0 0x7f4b8406edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4b94005880 tx=0x7f4b94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.629+0000 7f4b9a000640 1 -- 172.21.15.71:0/2173960079 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4ba40ae8a0 con 0x7f4ba40aee60 2024-04-20T21:20:31.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.831+0000 7f4ba3200640 1 -- 172.21.15.71:0/2173960079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4ba4075b30 con 0x7f4ba40aee60 2024-04-20T21:20:31.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.832+0000 7f4b9a000640 1 -- 172.21.15.71:0/2173960079 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f4b90059f60 con 0x7f4ba40aee60 2024-04-20T21:20:31.832 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 -- 172.21.15.71:0/2173960079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b8406c8f0 msgr2=0x7f4b8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b8406c8f0 0x7f4b8406edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4b94005880 tx=0x7f4b94009040 comp rx=0 tx=0).stop 2024-04-20T21:20:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 -- 172.21.15.71:0/2173960079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ba40aee60 msgr2=0x7f4ba4154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ba40aee60 0x7f4ba4154150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000c7f0 tx=0x7f4b9000cbf0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 -- 172.21.15.71:0/2173960079 shutdown_connections 2024-04-20T21:20:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b8406c8f0 0x7f4b8406edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba415d4f0 0x7f4ba4154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ba40aee60 0x7f4ba4154150 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 --2- 172.21.15.71:0/2173960079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba406e060 0x7f4ba41f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 -- 172.21.15.71:0/2173960079 >> 172.21.15.71:0/2173960079 conn(0x7f4ba40b5270 msgr2=0x7f4ba40b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 -- 172.21.15.71:0/2173960079 shutdown_connections 2024-04-20T21:20:31.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:31.835+0000 7f4ba3200640 1 -- 172.21.15.71:0/2173960079 wait complete. 2024-04-20T21:20:31.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-04-20T21:20:32.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.055+0000 7f66ff200640 1 Processor -- start 2024-04-20T21:20:32.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.055+0000 7f66ff200640 1 -- start start 2024-04-20T21:20:32.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.057+0000 7f66ff200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f815ba70 0x7f66f806c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:32.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.057+0000 7f66ff200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f806cbc0 con 0x7f66f806c6d0 2024-04-20T21:20:32.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.057+0000 7f66ff200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f806cea0 con 0x7f66f80cf290 2024-04-20T21:20:32.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.057+0000 7f66ff200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f66f806d180 con 0x7f66f815ba70 2024-04-20T21:20:32.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.057+0000 7f66fd400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f66f806c6d0 0x7f66f80ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52046/0 (socket says 172.21.15.71:52046) 2024-04-20T21:20:32.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.057+0000 7f66fd400640 1 -- 172.21.15.71:0/2719605823 learned_addr learned my addr 172.21.15.71:0/2719605823 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:32.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fde00640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f815ba70 0x7f66f806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:32.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3824111920 0 0) 0x7f66f806cbc0 con 0x7f66f806c6d0 2024-04-20T21:20:32.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66e0003520 con 0x7f66f806c6d0 2024-04-20T21:20:32.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3777634236 0 0) 0x7f66e0003520 con 0x7f66f806c6d0 2024-04-20T21:20:32.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f815ba70 msgr2=0x7f66f806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:32.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f815ba70 0x7f66f806c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:32.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 >> v1:172.21.15.137:6789/0 conn(0x7f66f80cf290 legacy=0x7f66f806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f806d460 con 0x7f66f806c6d0 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f66e8001670 con 0x7f66f806c6d0 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 >> v1:172.21.15.71:6789/0 conn(0x7f66f806c6d0 legacy=0x7f66f80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f815ba70 0x7f66e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66e0003f60 0x7f66e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.058+0000 7f66fca00640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 0x7f66e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.059+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f66f806d180 con 0x7f66e0004d40 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.059+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f66e000baa0 con 0x7f66e0003f60 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.059+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f66e000bca0 con 0x7f66f815ba70 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.059+0000 7f66fe800640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 0x7f66e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.059+0000 7f66fde00640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f815ba70 0x7f66e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.059+0000 7f66fd400640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66e0003f60 0x7f66e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.059+0000 7f66fe800640 1 -- 172.21.15.71:0/2719605823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f815ba70 msgr2=0x7f66e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:32.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.059+0000 7f66fe800640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f815ba70 0x7f66e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:32.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.059+0000 7f66fe800640 1 -- 172.21.15.71:0/2719605823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66e0003f60 msgr2=0x7f66e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:32.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.059+0000 7f66fe800640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66e0003f60 0x7f66e0004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:32.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.059+0000 7f66fe800640 1 -- 172.21.15.71:0/2719605823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e0003520 con 0x7f66e0004d40 2024-04-20T21:20:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.060+0000 7f66fe800640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 0x7f66e00051c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f66f4001e50 tx=0x7f66e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb97e19cd28f4e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.061+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4001a70 con 0x7f66e0004d40 2024-04-20T21:20:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.061+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f4003b70 con 0x7f66e0004d40 2024-04-20T21:20:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.061+0000 7f66fca00640 1 -- 172.21.15.71:0/2719605823 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f40050d0 con 0x7f66e0004d40 2024-04-20T21:20:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.061+0000 7f66ff200640 1 -- 172.21.15.71:0/2719605823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 msgr2=0x7f66e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.061+0000 7f66ff200640 1 --2- 172.21.15.71:0/2719605823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 0x7f66e00051c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f66f4001e50 tx=0x7f66e0005830 comp rx=0 tx=0).stop 2024-04-20T21:20:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.061+0000 7f66fe800640 1 -- 172.21.15.71:0/2719605823 reap_dead start 2024-04-20T21:20:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.061+0000 7f66ff200640 1 -- 172.21.15.71:0/2719605823 shutdown_connections 2024-04-20T21:20:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.061+0000 7f66ff200640 1 -- 172.21.15.71:0/2719605823 >> 172.21.15.71:0/2719605823 conn(0x7f66f80cd3b0 msgr2=0x7f66f80cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.061+0000 7f66ff200640 1 -- 172.21.15.71:0/2719605823 shutdown_connections 2024-04-20T21:20:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.061+0000 7f66ff200640 1 -- 172.21.15.71:0/2719605823 wait complete. 2024-04-20T21:20:32.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.063+0000 7f66ff200640 1 Processor -- start 2024-04-20T21:20:32.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.063+0000 7f66ff200640 1 -- start start 2024-04-20T21:20:32.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.064+0000 7f66ff200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 0x7f66f81440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:32.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.064+0000 7f66ff200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f8149540 0x7f66f81499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.064+0000 7f66ff200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66f8129900 0x7f66f8129d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.064+0000 7f66ff200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f66f815bfd0 con 0x7f66e0004d40 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.064+0000 7f66ff200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f66f815be50 con 0x7f66f8129900 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.064+0000 7f66ff200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f66f806ec40 con 0x7f66f8149540 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fde00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 0x7f66f81440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fde00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 0x7f66f81440b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57166/0 (socket says 172.21.15.71:57166) 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fde00640 1 -- 172.21.15.71:0/1808538255 learned_addr learned my addr 172.21.15.71:0/1808538255 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fd400640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f8149540 0x7f66f81499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fe800640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66f8129900 0x7f66f8129d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fde00640 1 -- 172.21.15.71:0/1808538255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f8149540 msgr2=0x7f66f81499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fde00640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f8149540 0x7f66f81499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fde00640 1 -- 172.21.15.71:0/1808538255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66f8129900 msgr2=0x7f66f8129d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fde00640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66f8129900 0x7f66f8129d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fde00640 1 -- 172.21.15.71:0/1808538255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f8149ee0 con 0x7f66e0004d40 2024-04-20T21:20:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fd400640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f8149540 0x7f66f81499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:32.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fe800640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66f8129900 0x7f66f8129d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:32.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.065+0000 7f66fde00640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 0x7f66f81440b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f66ec011630 tx=0x7f66ec011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:32.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.066+0000 7f66f2000640 1 -- 172.21.15.71:0/1808538255 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00f920 con 0x7f66e0004d40 2024-04-20T21:20:32.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.066+0000 7f66f2000640 1 -- 172.21.15.71:0/1808538255 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66ec00fac0 con 0x7f66e0004d40 2024-04-20T21:20:32.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.066+0000 7f66f2000640 1 -- 172.21.15.71:0/1808538255 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00fe70 con 0x7f66e0004d40 2024-04-20T21:20:32.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.066+0000 7f66ff200640 1 -- 172.21.15.71:0/1808538255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f8143010 con 0x7f66e0004d40 2024-04-20T21:20:32.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.066+0000 7f66ff200640 1 -- 172.21.15.71:0/1808538255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f81435d0 con 0x7f66e0004d40 2024-04-20T21:20:32.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.067+0000 7f66ff200640 1 -- 172.21.15.71:0/1808538255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f80d0020 con 0x7f66e0004d40 2024-04-20T21:20:32.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.068+0000 7f66f2000640 1 -- 172.21.15.71:0/1808538255 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f66ec015460 con 0x7f66e0004d40 2024-04-20T21:20:32.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.069+0000 7f66f2000640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f66dc06c920 0x7f66dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:32.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.069+0000 7f66f2000640 1 -- 172.21.15.71:0/1808538255 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f66ec08c520 con 0x7f66e0004d40 2024-04-20T21:20:32.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.069+0000 7f66fd400640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f66dc06c920 0x7f66dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:32.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.070+0000 7f66fd400640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f66dc06c920 0x7f66dc06ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f66e8001eb0 tx=0x7f66e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:32.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.074+0000 7f66f2000640 1 -- 172.21.15.71:0/1808538255 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f66f80d0020 con 0x7f66e0004d40 2024-04-20T21:20:32.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:32.334+0000 7f66ff200640 1 -- 172.21.15.71:0/1808538255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f66f806e310 con 0x7f66e0004d40 2024-04-20T21:20:33.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.005+0000 7f66f2000640 1 -- 172.21.15.71:0/1808538255 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v84) ==== 147+0+0 (secure 0 0 0) 0x7f66ec019030 con 0x7f66e0004d40 2024-04-20T21:20:33.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.009+0000 7f66ff200640 1 -- 172.21.15.71:0/1808538255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f66dc06c920 msgr2=0x7f66dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:33.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.009+0000 7f66ff200640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f66dc06c920 0x7f66dc06ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f66e8001eb0 tx=0x7f66e8009040 comp rx=0 tx=0).stop 2024-04-20T21:20:33.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.009+0000 7f66ff200640 1 -- 172.21.15.71:0/1808538255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 msgr2=0x7f66f81440b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:33.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.009+0000 7f66ff200640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 0x7f66f81440b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f66ec011630 tx=0x7f66ec011af0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.009+0000 7f66ff200640 1 -- 172.21.15.71:0/1808538255 shutdown_connections 2024-04-20T21:20:33.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.009+0000 7f66ff200640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f66dc06c920 0x7f66dc06ede0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.009+0000 7f66ff200640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66f8129900 0x7f66f8129d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.009+0000 7f66ff200640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f66f8149540 0x7f66f81499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.009+0000 7f66ff200640 1 --2- 172.21.15.71:0/1808538255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66e0004d40 0x7f66f81440b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.009+0000 7f66ff200640 1 -- 172.21.15.71:0/1808538255 >> 172.21.15.71:0/1808538255 conn(0x7f66f80cd3b0 msgr2=0x7f66f80b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:33.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.009+0000 7f66ff200640 1 -- 172.21.15.71:0/1808538255 shutdown_connections 2024-04-20T21:20:33.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.010+0000 7f66ff200640 1 -- 172.21.15.71:0/1808538255 wait complete. 2024-04-20T21:20:33.031 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-20T21:20:33.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.233+0000 7fb810a00640 1 Processor -- start 2024-04-20T21:20:33.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.234+0000 7fb810a00640 1 -- start start 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.235+0000 7fb810a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb80c0aee60 0x7fb80c0af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.235+0000 7fb810a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb80c06e060 0x7fb80c06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.235+0000 7fb810a00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80c0af780 con 0x7fb80c15d4f0 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.235+0000 7fb810a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb80c06c510 con 0x7fb80c06e060 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.235+0000 7fb810a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb80c06b900 con 0x7fb80c0aee60 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.236+0000 7fb80b200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb80c06e060 0x7fb80c06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.236+0000 7fb801e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb80c15d4f0 0x7fb80c0ad0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43186/0 (socket says 172.21.15.71:43186) 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.236+0000 7fb801e00640 1 -- 172.21.15.71:0/579770653 learned_addr learned my addr 172.21.15.71:0/579770653 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.236+0000 7fb80a800640 1 --2- 172.21.15.71:0/579770653 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb80c0aee60 0x7fb80c0af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.236+0000 7fb80b200640 1 -- 172.21.15.71:0/579770653 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb80c0aee60 msgr2=0x7fb80c0af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.236+0000 7fb80b200640 1 --2- 172.21.15.71:0/579770653 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb80c0aee60 0x7fb80c0af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.236+0000 7fb80b200640 1 -- 172.21.15.71:0/579770653 >> v1:172.21.15.71:6789/0 conn(0x7fb80c15d4f0 legacy=0x7fb80c0ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.236+0000 7fb80b200640 1 -- 172.21.15.71:0/579770653 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c06bbe0 con 0x7fb80c06e060 2024-04-20T21:20:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.236+0000 7fb809e00640 1 -- 172.21.15.71:0/579770653 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4011210665 0 0) 0x7fb80c0af780 con 0x7fb80c15d4f0 2024-04-20T21:20:33.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.236+0000 7fb80a800640 1 --2- 172.21.15.71:0/579770653 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb80c0aee60 0x7fb80c0af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.237+0000 7fb80b200640 1 --2- 172.21.15.71:0/579770653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb80c06e060 0x7fb80c06e4c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb804009d90 tx=0x7fb80402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3e3bc2c09532ca server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.237+0000 7fb809e00640 1 -- 172.21.15.71:0/579770653 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804039070 con 0x7fb80c06e060 2024-04-20T21:20:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.237+0000 7fb809e00640 1 -- 172.21.15.71:0/579770653 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80402cc50 con 0x7fb80c06e060 2024-04-20T21:20:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.237+0000 7fb809e00640 1 -- 172.21.15.71:0/579770653 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804034440 con 0x7fb80c06e060 2024-04-20T21:20:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.238+0000 7fb810a00640 1 -- 172.21.15.71:0/579770653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb80c06e060 msgr2=0x7fb80c06e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.238+0000 7fb810a00640 1 --2- 172.21.15.71:0/579770653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb80c06e060 0x7fb80c06e4c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb804009d90 tx=0x7fb80402bea0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.238+0000 7fb810a00640 1 -- 172.21.15.71:0/579770653 shutdown_connections 2024-04-20T21:20:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.238+0000 7fb810a00640 1 --2- 172.21.15.71:0/579770653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb80c06e060 0x7fb80c06e4c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.238+0000 7fb810a00640 1 --2- 172.21.15.71:0/579770653 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb80c0aee60 0x7fb80c0af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.238+0000 7fb810a00640 1 -- 172.21.15.71:0/579770653 >> 172.21.15.71:0/579770653 conn(0x7fb80c0b5270 msgr2=0x7fb80c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:33.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.238+0000 7fb810a00640 1 -- 172.21.15.71:0/579770653 shutdown_connections 2024-04-20T21:20:33.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.238+0000 7fb810a00640 1 -- 172.21.15.71:0/579770653 wait complete. 2024-04-20T21:20:33.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.240+0000 7fb810a00640 1 Processor -- start 2024-04-20T21:20:33.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.240+0000 7fb810a00640 1 -- start start 2024-04-20T21:20:33.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.241+0000 7fb810a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb80c06e060 0x7fb80c14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:33.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.241+0000 7fb810a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb80c0aee60 0x7fb80c1f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:33.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.241+0000 7fb810a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80c15d4f0 0x7fb80c14cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:33.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.241+0000 7fb810a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c06c9a0 con 0x7fb80c06e060 2024-04-20T21:20:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.241+0000 7fb810a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c06c1a0 con 0x7fb80c15d4f0 2024-04-20T21:20:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.241+0000 7fb810a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb80c06ea00 con 0x7fb80c0aee60 2024-04-20T21:20:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.241+0000 7fb80a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb80c06e060 0x7fb80c14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.241+0000 7fb80a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb80c06e060 0x7fb80c14ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57470/0 (socket says 172.21.15.71:57470) 2024-04-20T21:20:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.241+0000 7fb80a800640 1 -- 172.21.15.71:0/652157473 learned_addr learned my addr 172.21.15.71:0/652157473 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.242+0000 7fb80a800640 1 -- 172.21.15.71:0/652157473 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb80c0aee60 msgr2=0x7fb80c1f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.242+0000 7fb80a800640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb80c0aee60 0x7fb80c1f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.242+0000 7fb80a800640 1 -- 172.21.15.71:0/652157473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80c15d4f0 msgr2=0x7fb80c14cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.242+0000 7fb80a800640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80c15d4f0 0x7fb80c14cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.242+0000 7fb80a800640 1 -- 172.21.15.71:0/652157473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c1f3700 con 0x7fb80c06e060 2024-04-20T21:20:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.242+0000 7fb80a800640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb80c06e060 0x7fb80c14ae90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00c7f0 tx=0x7fb7fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.242+0000 7fb803400640 1 -- 172.21.15.71:0/652157473 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc015070 con 0x7fb80c06e060 2024-04-20T21:20:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.242+0000 7fb803400640 1 -- 172.21.15.71:0/652157473 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc007a30 con 0x7fb80c06e060 2024-04-20T21:20:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.242+0000 7fb803400640 1 -- 172.21.15.71:0/652157473 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc007e00 con 0x7fb80c06e060 2024-04-20T21:20:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.242+0000 7fb810a00640 1 -- 172.21.15.71:0/652157473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80c14d070 con 0x7fb80c06e060 2024-04-20T21:20:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.242+0000 7fb810a00640 1 -- 172.21.15.71:0/652157473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb80c14b800 con 0x7fb80c06e060 2024-04-20T21:20:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.244+0000 7fb810a00640 1 -- 172.21.15.71:0/652157473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb80c075b30 con 0x7fb80c06e060 2024-04-20T21:20:33.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.245+0000 7fb803400640 1 -- 172.21.15.71:0/652157473 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb7fc018070 con 0x7fb80c06e060 2024-04-20T21:20:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.245+0000 7fb803400640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb7e806c8f0 0x7fb7e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.246+0000 7fb803400640 1 -- 172.21.15.71:0/652157473 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fb7fc08bf70 con 0x7fb80c06e060 2024-04-20T21:20:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.246+0000 7fb801e00640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb7e806c8f0 0x7fb7e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:33.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.246+0000 7fb801e00640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb7e806c8f0 0x7fb7e806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4007fd0 tx=0x7fb7f4007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:33.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.250+0000 7fb803400640 1 -- 172.21.15.71:0/652157473 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb7fc059ef0 con 0x7fb80c06e060 2024-04-20T21:20:33.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.459+0000 7fb810a00640 1 -- 172.21.15.71:0/652157473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb80c06ceb0 con 0x7fb80c06e060 2024-04-20T21:20:33.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.467+0000 7fb803400640 1 -- 172.21.15.71:0/652157473 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fb7fc0597f0 con 0x7fb80c06e060 2024-04-20T21:20:33.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.469+0000 7fb810a00640 1 -- 172.21.15.71:0/652157473 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb7e806c8f0 msgr2=0x7fb7e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:33.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.469+0000 7fb810a00640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb7e806c8f0 0x7fb7e806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4007fd0 tx=0x7fb7f4007920 comp rx=0 tx=0).stop 2024-04-20T21:20:33.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.469+0000 7fb810a00640 1 -- 172.21.15.71:0/652157473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb80c06e060 msgr2=0x7fb80c14ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:33.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.470+0000 7fb810a00640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb80c06e060 0x7fb80c14ae90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00c7f0 tx=0x7fb7fc00cbf0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.470+0000 7fb810a00640 1 -- 172.21.15.71:0/652157473 shutdown_connections 2024-04-20T21:20:33.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.470+0000 7fb810a00640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb7e806c8f0 0x7fb7e806edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.470+0000 7fb810a00640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80c15d4f0 0x7fb80c14cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.470+0000 7fb810a00640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb80c0aee60 0x7fb80c1f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.470+0000 7fb810a00640 1 --2- 172.21.15.71:0/652157473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb80c06e060 0x7fb80c14ae90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:33.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.470+0000 7fb810a00640 1 -- 172.21.15.71:0/652157473 >> 172.21.15.71:0/652157473 conn(0x7fb80c0b5270 msgr2=0x7fb80c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:33.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.470+0000 7fb810a00640 1 -- 172.21.15.71:0/652157473 shutdown_connections 2024-04-20T21:20:33.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:33.470+0000 7fb810a00640 1 -- 172.21.15.71:0/652157473 wait complete. 2024-04-20T21:20:33.489 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-20T21:20:33.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-20T21:20:33.581 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-20T21:20:33.704 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-20T21:20:33.704 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:20:33.704 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:33.763 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:20:33.763 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:33.813 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:34.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.045+0000 7f19d9200640 1 Processor -- start 2024-04-20T21:20:34.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.045+0000 7f19d9200640 1 -- start start 2024-04-20T21:20:34.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.047+0000 7f19d9200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f19d4161d50 0x7f19d40d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.047+0000 7f19d9200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19d40b3330 0x7f19d40b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.047+0000 7f19d9200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19d406c190 con 0x7f19d406c6d0 2024-04-20T21:20:34.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.047+0000 7f19d9200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f19d4162130 con 0x7f19d4161d50 2024-04-20T21:20:34.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.047+0000 7f19d9200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f19d406c470 con 0x7f19d40b3330 2024-04-20T21:20:34.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.047+0000 7f19d3400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f19d4161d50 0x7f19d40d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.047+0000 7f19d3400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f19d4161d50 0x7f19d40d38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57476/0 (socket says 172.21.15.71:57476) 2024-04-20T21:20:34.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.047+0000 7f19d3400640 1 -- 172.21.15.71:0/3083899447 learned_addr learned my addr 172.21.15.71:0/3083899447 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:34.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.048+0000 7f19cbe00640 1 --2- 172.21.15.71:0/3083899447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19d40b3330 0x7f19d40b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.048+0000 7f19d3400640 1 -- 172.21.15.71:0/3083899447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19d40b3330 msgr2=0x7f19d40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:34.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.048+0000 7f19d3400640 1 --2- 172.21.15.71:0/3083899447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19d40b3330 0x7f19d40b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.048+0000 7f19d3400640 1 -- 172.21.15.71:0/3083899447 >> v1:172.21.15.137:6789/0 conn(0x7f19d406c6d0 legacy=0x7f19d40cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:34.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.048+0000 7f19d3400640 1 -- 172.21.15.71:0/3083899447 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d40d2e00 con 0x7f19d4161d50 2024-04-20T21:20:34.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.049+0000 7f19d3400640 1 --2- 172.21.15.71:0/3083899447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d4161d50 0x7f19d40d38e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009870 tx=0x7f19c402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f25d7f65e74f8f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:34.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.049+0000 7f19d2a00640 1 -- 172.21.15.71:0/3083899447 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4035020 con 0x7f19d4161d50 2024-04-20T21:20:34.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.049+0000 7f19d2a00640 1 -- 172.21.15.71:0/3083899447 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c4031640 con 0x7f19d4161d50 2024-04-20T21:20:34.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.049+0000 7f19d2a00640 1 -- 172.21.15.71:0/3083899447 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c402d040 con 0x7f19d4161d50 2024-04-20T21:20:34.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.050+0000 7f19d9200640 1 -- 172.21.15.71:0/3083899447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d4161d50 msgr2=0x7f19d40d38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.050+0000 7f19d9200640 1 --2- 172.21.15.71:0/3083899447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d4161d50 0x7f19d40d38e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009870 tx=0x7f19c402b8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.050+0000 7f19d9200640 1 -- 172.21.15.71:0/3083899447 shutdown_connections 2024-04-20T21:20:34.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.050+0000 7f19d9200640 1 --2- 172.21.15.71:0/3083899447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19d40b3330 0x7f19d40b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.050+0000 7f19d9200640 1 --2- 172.21.15.71:0/3083899447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d4161d50 0x7f19d40d38e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.050+0000 7f19d9200640 1 -- 172.21.15.71:0/3083899447 >> 172.21.15.71:0/3083899447 conn(0x7f19d40d4450 msgr2=0x7f19d40d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:34.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.050+0000 7f19d9200640 1 -- 172.21.15.71:0/3083899447 shutdown_connections 2024-04-20T21:20:34.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.050+0000 7f19d9200640 1 -- 172.21.15.71:0/3083899447 wait complete. 2024-04-20T21:20:34.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.052+0000 7f19d9200640 1 Processor -- start 2024-04-20T21:20:34.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.052+0000 7f19d9200640 1 -- start start 2024-04-20T21:20:34.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.053+0000 7f19d9200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d406c6d0 0x7f19d40c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.053+0000 7f19d9200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19d40b3330 0x7f19d415d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.053+0000 7f19d9200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19d4161d50 0x7f19d4147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.053+0000 7f19d9200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19d406cb60 con 0x7f19d406c6d0 2024-04-20T21:20:34.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.053+0000 7f19d9200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f19d40d33c0 con 0x7f19d40b3330 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.053+0000 7f19d9200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f19d406cce0 con 0x7f19d4161d50 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.053+0000 7f19d3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d406c6d0 0x7f19d40c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.053+0000 7f19d3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d406c6d0 0x7f19d40c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57484/0 (socket says 172.21.15.71:57484) 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.053+0000 7f19d3400640 1 -- 172.21.15.71:0/1527862835 learned_addr learned my addr 172.21.15.71:0/1527862835 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19cbe00640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19d40b3330 0x7f19d415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19d3e00640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19d4161d50 0x7f19d4147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19d3400640 1 -- 172.21.15.71:0/1527862835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19d4161d50 msgr2=0x7f19d4147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19d3400640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19d4161d50 0x7f19d4147260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19d3400640 1 -- 172.21.15.71:0/1527862835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19d40b3330 msgr2=0x7f19d415d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19d3400640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19d40b3330 0x7f19d415d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19d3400640 1 -- 172.21.15.71:0/1527862835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d40cdf10 con 0x7f19d406c6d0 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19cbe00640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19d40b3330 0x7f19d415d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19d3400640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d406c6d0 0x7f19d40c7f60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f19c402b930 tx=0x7f19c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19cb400640 1 -- 172.21.15.71:0/1527862835 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4035040 con 0x7f19d406c6d0 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19cb400640 1 -- 172.21.15.71:0/1527862835 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c4039bf0 con 0x7f19d406c6d0 2024-04-20T21:20:34.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19cb400640 1 -- 172.21.15.71:0/1527862835 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4045480 con 0x7f19d406c6d0 2024-04-20T21:20:34.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.054+0000 7f19d9200640 1 -- 172.21.15.71:0/1527862835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d40ce1f0 con 0x7f19d406c6d0 2024-04-20T21:20:34.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.055+0000 7f19d9200640 1 -- 172.21.15.71:0/1527862835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d415d1e0 con 0x7f19d406c6d0 2024-04-20T21:20:34.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.056+0000 7f19d9200640 1 -- 172.21.15.71:0/1527862835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d4075b60 con 0x7f19d406c6d0 2024-04-20T21:20:34.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.056+0000 7f19cb400640 1 -- 172.21.15.71:0/1527862835 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f19c4038020 con 0x7f19d406c6d0 2024-04-20T21:20:34.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.057+0000 7f19cb400640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f19b006c8f0 0x7f19b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.057+0000 7f19cb400640 1 -- 172.21.15.71:0/1527862835 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f19c40adee0 con 0x7f19d406c6d0 2024-04-20T21:20:34.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.058+0000 7f19cbe00640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f19b006c8f0 0x7f19b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.058+0000 7f19cbe00640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f19b006c8f0 0x7f19b006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f19d41f7bb0 tx=0x7f19bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.062+0000 7f19cb400640 1 -- 172.21.15.71:0/1527862835 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f19c4043380 con 0x7f19d406c6d0 2024-04-20T21:20:34.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.261+0000 7f19d9200640 1 -- 172.21.15.71:0/1527862835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19d40cfeb0 con 0x7f19d406c6d0 2024-04-20T21:20:34.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.264+0000 7f19cb400640 1 -- 172.21.15.71:0/1527862835 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7f19c407bee0 con 0x7f19d406c6d0 2024-04-20T21:20:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:34.265 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 -- 172.21.15.71:0/1527862835 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f19b006c8f0 msgr2=0x7f19b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f19b006c8f0 0x7f19b006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f19d41f7bb0 tx=0x7f19bc008040 comp rx=0 tx=0).stop 2024-04-20T21:20:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 -- 172.21.15.71:0/1527862835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d406c6d0 msgr2=0x7f19d40c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d406c6d0 0x7f19d40c7f60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f19c402b930 tx=0x7f19c40046c0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 -- 172.21.15.71:0/1527862835 shutdown_connections 2024-04-20T21:20:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f19b006c8f0 0x7f19b006edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19d4161d50 0x7f19d4147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19d40b3330 0x7f19d415d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 --2- 172.21.15.71:0/1527862835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19d406c6d0 0x7f19d40c7f60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 -- 172.21.15.71:0/1527862835 >> 172.21.15.71:0/1527862835 conn(0x7f19d40d4450 msgr2=0x7f19d40677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 -- 172.21.15.71:0/1527862835 shutdown_connections 2024-04-20T21:20:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.267+0000 7f19d9200640 1 -- 172.21.15.71:0/1527862835 wait complete. 2024-04-20T21:20:34.286 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:34.286 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:34.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.488+0000 7f09e1600640 1 Processor -- start 2024-04-20T21:20:34.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.489+0000 7f09e1600640 1 -- start start 2024-04-20T21:20:34.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.490+0000 7f09e1600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc15ca40 0x7f09dc0ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.490+0000 7f09e1600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09dc0ad8e0 0x7f09dc0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.490+0000 7f09e1600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09dc141c60 con 0x7f09dc156c20 2024-04-20T21:20:34.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.490+0000 7f09e1600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f09dc06c010 con 0x7f09dc0ad8e0 2024-04-20T21:20:34.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.490+0000 7f09e1600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f09dc15cf90 con 0x7f09dc15ca40 2024-04-20T21:20:34.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.490+0000 7f09daa00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f09dc156c20 0x7f09dc06b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43192/0 (socket says 172.21.15.71:43192) 2024-04-20T21:20:34.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.490+0000 7f09daa00640 1 -- 172.21.15.71:0/3363101641 learned_addr learned my addr 172.21.15.71:0/3363101641 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135298923 0 0) 0x7f09dc141c60 con 0x7f09dc156c20 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09c0003520 con 0x7f09dc156c20 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09db400640 1 --2- 172.21.15.71:0/3363101641 >> v2:172.21.15.137:3300/0 conn(0x7f09dc0ad8e0 0x7f09dc0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09da000640 1 --2- 172.21.15.71:0/3363101641 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc15ca40 0x7f09dc0ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2788971489 0 0) 0x7f09c0003520 con 0x7f09dc156c20 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc15ca40 msgr2=0x7f09dc0ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 --2- 172.21.15.71:0/3363101641 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc15ca40 0x7f09dc0ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 >> v2:172.21.15.137:3300/0 conn(0x7f09dc0ad8e0 msgr2=0x7f09dc0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 --2- 172.21.15.71:0/3363101641 >> v2:172.21.15.137:3300/0 conn(0x7f09dc0ad8e0 0x7f09dc0d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc15d270 con 0x7f09dc156c20 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f09cc001670 con 0x7f09dc156c20 2024-04-20T21:20:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 >> v1:172.21.15.71:6789/0 conn(0x7f09dc156c20 legacy=0x7f09dc06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 --2- 172.21.15.71:0/3363101641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c00039b0 0x7f09c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 --2- 172.21.15.71:0/3363101641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 0x7f09c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 --2- 172.21.15.71:0/3363101641 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc15ca40 0x7f09c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc06c010 con 0x7f09c0004800 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc15cf90 con 0x7f09c00039b0 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.491+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f09c000ba70 con 0x7f09dc15ca40 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.492+0000 7f09da000640 1 --2- 172.21.15.71:0/3363101641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 0x7f09c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.492+0000 7f09daa00640 1 --2- 172.21.15.71:0/3363101641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c00039b0 0x7f09c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.492+0000 7f09da000640 1 -- 172.21.15.71:0/3363101641 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc15ca40 msgr2=0x7f09c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.492+0000 7f09da000640 1 --2- 172.21.15.71:0/3363101641 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc15ca40 0x7f09c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.492+0000 7f09da000640 1 -- 172.21.15.71:0/3363101641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c00039b0 msgr2=0x7f09c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.492+0000 7f09da000640 1 --2- 172.21.15.71:0/3363101641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c00039b0 0x7f09c0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.492+0000 7f09da000640 1 -- 172.21.15.71:0/3363101641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c0003520 con 0x7f09c0004800 2024-04-20T21:20:34.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.493+0000 7f09da000640 1 --2- 172.21.15.71:0/3363101641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 0x7f09c0004c80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f09c400ba00 tx=0x7f09c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97effb2db91f254 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:34.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.493+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c4036020 con 0x7f09c0004800 2024-04-20T21:20:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.493+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c4032630 con 0x7f09c0004800 2024-04-20T21:20:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.493+0000 7f09d9600640 1 -- 172.21.15.71:0/3363101641 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c400b600 con 0x7f09c0004800 2024-04-20T21:20:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.494+0000 7f09e1600640 1 -- 172.21.15.71:0/3363101641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 msgr2=0x7f09c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.494+0000 7f09e1600640 1 --2- 172.21.15.71:0/3363101641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 0x7f09c0004c80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f09c400ba00 tx=0x7f09c0005830 comp rx=0 tx=0).stop 2024-04-20T21:20:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.494+0000 7f09db400640 1 -- 172.21.15.71:0/3363101641 reap_dead start 2024-04-20T21:20:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.494+0000 7f09e1600640 1 -- 172.21.15.71:0/3363101641 shutdown_connections 2024-04-20T21:20:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.494+0000 7f09e1600640 1 -- 172.21.15.71:0/3363101641 >> 172.21.15.71:0/3363101641 conn(0x7f09dc0b3350 msgr2=0x7f09dc0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.494+0000 7f09e1600640 1 -- 172.21.15.71:0/3363101641 shutdown_connections 2024-04-20T21:20:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.494+0000 7f09e1600640 1 -- 172.21.15.71:0/3363101641 wait complete. 2024-04-20T21:20:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.496+0000 7f09e1600640 1 Processor -- start 2024-04-20T21:20:34.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.496+0000 7f09e1600640 1 -- start start 2024-04-20T21:20:34.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.497+0000 7f09e1600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 0x7f09dc1e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.497+0000 7f09e1600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc099810 0x7f09dc1e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.497+0000 7f09e1600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09dc1e6390 0x7f09dc0731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.497+0000 7f09e1600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc0ad3a0 con 0x7f09c0004800 2024-04-20T21:20:34.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.497+0000 7f09e1600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc15d830 con 0x7f09dc1e6390 2024-04-20T21:20:34.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.497+0000 7f09e1600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f09dc0ad520 con 0x7f09dc099810 2024-04-20T21:20:34.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.497+0000 7f09daa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 0x7f09dc1e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.497+0000 7f09daa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 0x7f09dc1e79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57512/0 (socket says 172.21.15.71:57512) 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.497+0000 7f09daa00640 1 -- 172.21.15.71:0/3770195313 learned_addr learned my addr 172.21.15.71:0/3770195313 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09daa00640 1 -- 172.21.15.71:0/3770195313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc099810 msgr2=0x7f09dc1e5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09db400640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09dc1e6390 0x7f09dc0731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09da000640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc099810 0x7f09dc1e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09daa00640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc099810 0x7f09dc1e5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09daa00640 1 -- 172.21.15.71:0/3770195313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09dc1e6390 msgr2=0x7f09dc0731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09daa00640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09dc1e6390 0x7f09dc0731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09daa00640 1 -- 172.21.15.71:0/3770195313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc1e6910 con 0x7f09c0004800 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09da000640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc099810 0x7f09dc1e5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09daa00640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 0x7f09dc1e79b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00e920 tx=0x7f09cc00ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09d2a00640 1 -- 172.21.15.71:0/3770195313 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc019070 con 0x7f09c0004800 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09d2a00640 1 -- 172.21.15.71:0/3770195313 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc00c870 con 0x7f09c0004800 2024-04-20T21:20:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.498+0000 7f09e1600640 1 -- 172.21.15.71:0/3770195313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09dc1e6bf0 con 0x7f09c0004800 2024-04-20T21:20:34.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.499+0000 7f09d2a00640 1 -- 172.21.15.71:0/3770195313 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc00cc60 con 0x7f09c0004800 2024-04-20T21:20:34.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.499+0000 7f09e1600640 1 -- 172.21.15.71:0/3770195313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09dc1e71b0 con 0x7f09c0004800 2024-04-20T21:20:34.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.500+0000 7f09e1600640 1 -- 172.21.15.71:0/3770195313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09dc068980 con 0x7f09c0004800 2024-04-20T21:20:34.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.501+0000 7f09d2a00640 1 -- 172.21.15.71:0/3770195313 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f09cc01c070 con 0x7f09c0004800 2024-04-20T21:20:34.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.502+0000 7f09d2a00640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f09b806c8f0 0x7f09b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.502+0000 7f09d2a00640 1 -- 172.21.15.71:0/3770195313 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f09cc08b8e0 con 0x7f09c0004800 2024-04-20T21:20:34.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.502+0000 7f09da000640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f09b806c8f0 0x7f09b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.503+0000 7f09da000640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f09b806c8f0 0x7f09b806edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09c00057e0 tx=0x7f09c4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:34.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.506+0000 7f09d2a00640 1 -- 172.21.15.71:0/3770195313 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f09cc059850 con 0x7f09c0004800 2024-04-20T21:20:34.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.704+0000 7f09e1600640 1 -- 172.21.15.71:0/3770195313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f09dc0cfd90 con 0x7f09c0004800 2024-04-20T21:20:34.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.704+0000 7f09d2a00640 1 -- 172.21.15.71:0/3770195313 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f09cc059150 con 0x7f09c0004800 2024-04-20T21:20:34.704 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:34.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.707+0000 7f09e1600640 1 -- 172.21.15.71:0/3770195313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f09b806c8f0 msgr2=0x7f09b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.707+0000 7f09e1600640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f09b806c8f0 0x7f09b806edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09c00057e0 tx=0x7f09c4030000 comp rx=0 tx=0).stop 2024-04-20T21:20:34.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.707+0000 7f09e1600640 1 -- 172.21.15.71:0/3770195313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 msgr2=0x7f09dc1e79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.707+0000 7f09e1600640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 0x7f09dc1e79b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00e920 tx=0x7f09cc00ede0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.707+0000 7f09e1600640 1 -- 172.21.15.71:0/3770195313 shutdown_connections 2024-04-20T21:20:34.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.707+0000 7f09e1600640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f09b806c8f0 0x7f09b806edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.707+0000 7f09e1600640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09dc1e6390 0x7f09dc0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.707+0000 7f09e1600640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09dc099810 0x7f09dc1e5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.707+0000 7f09e1600640 1 --2- 172.21.15.71:0/3770195313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c0004800 0x7f09dc1e79b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.707+0000 7f09e1600640 1 -- 172.21.15.71:0/3770195313 >> 172.21.15.71:0/3770195313 conn(0x7f09dc0b3350 msgr2=0x7f09dc15e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:34.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.708+0000 7f09e1600640 1 -- 172.21.15.71:0/3770195313 shutdown_connections 2024-04-20T21:20:34.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.708+0000 7f09e1600640 1 -- 172.21.15.71:0/3770195313 wait complete. 2024-04-20T21:20:34.725 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:34.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.924+0000 7f18c3e00640 1 Processor -- start 2024-04-20T21:20:34.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.924+0000 7f18c3e00640 1 -- start start 2024-04-20T21:20:34.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.925+0000 7f18c3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f18c406ca10 0x7f18c406ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.925+0000 7f18c3e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c415b5d0 con 0x7f18c40d0010 2024-04-20T21:20:34.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.925+0000 7f18c3e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c406e730 con 0x7f18c415b1f0 2024-04-20T21:20:34.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.925+0000 7f18c3e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f18c406d3a0 con 0x7f18c406ca10 2024-04-20T21:20:34.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.926+0000 7f18c2000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f18c40d0010 0x7f18c40adc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43194/0 (socket says 172.21.15.71:43194) 2024-04-20T21:20:34.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.926+0000 7f18c2000640 1 -- 172.21.15.71:0/707799450 learned_addr learned my addr 172.21.15.71:0/707799450 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:34.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.926+0000 7f18c3400640 1 --2- 172.21.15.71:0/707799450 >> v2:172.21.15.137:3300/0 conn(0x7f18c406ca10 0x7f18c406ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.926+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582821293 0 0) 0x7f18c415b5d0 con 0x7f18c40d0010 2024-04-20T21:20:34.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.926+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18a8005730 con 0x7f18c40d0010 2024-04-20T21:20:34.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2023333811 0 0) 0x7f18a8005730 con 0x7f18c40d0010 2024-04-20T21:20:34.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 >> v2:172.21.15.137:3300/0 conn(0x7f18c406ca10 msgr2=0x7f18c406ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:34.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 --2- 172.21.15.71:0/707799450 >> v2:172.21.15.137:3300/0 conn(0x7f18c406ca10 0x7f18c406ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 >> v1:172.21.15.137:6789/0 conn(0x7f18c415b1f0 legacy=0x7f18c415f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c40ae310 con 0x7f18c40d0010 2024-04-20T21:20:34.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f18b0001670 con 0x7f18c40d0010 2024-04-20T21:20:34.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 >> v1:172.21.15.71:6789/0 conn(0x7f18c40d0010 legacy=0x7f18c40adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 --2- 172.21.15.71:0/707799450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18a8005bc0 0x7f18a8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 --2- 172.21.15.71:0/707799450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a8006a10 0x7f18a8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 --2- 172.21.15.71:0/707799450 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18a80073d0 0x7f18a800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18c406d3a0 con 0x7f18a8005bc0 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18a800e370 con 0x7f18a8006a10 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f18a800e570 con 0x7f18a80073d0 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c2a00640 1 --2- 172.21.15.71:0/707799450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18a8005bc0 0x7f18a8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c2000640 1 --2- 172.21.15.71:0/707799450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a8006a10 0x7f18a8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c2a00640 1 -- 172.21.15.71:0/707799450 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18a80073d0 msgr2=0x7f18a800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c2a00640 1 --2- 172.21.15.71:0/707799450 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18a80073d0 0x7f18a800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c2a00640 1 -- 172.21.15.71:0/707799450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a8006a10 msgr2=0x7f18a8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c2a00640 1 --2- 172.21.15.71:0/707799450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a8006a10 0x7f18a8006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c2a00640 1 -- 172.21.15.71:0/707799450 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a8005730 con 0x7f18a8005bc0 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.927+0000 7f18c2000640 1 --2- 172.21.15.71:0/707799450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a8006a10 0x7f18a8006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.928+0000 7f18c3400640 1 -- 172.21.15.71:0/707799450 reap_dead start 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.929+0000 7f18c2a00640 1 --2- 172.21.15.71:0/707799450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18a8005bc0 0x7f18a8005fe0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f18b4001750 tx=0x7f18a8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed223efd1238ad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.929+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4001370 con 0x7f18a8005bc0 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.929+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b40052d0 con 0x7f18a8005bc0 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.929+0000 7f18c1600640 1 -- 172.21.15.71:0/707799450 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4003830 con 0x7f18a8005bc0 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.929+0000 7f18c3e00640 1 -- 172.21.15.71:0/707799450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18a8005bc0 msgr2=0x7f18a8005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.929+0000 7f18c3e00640 1 --2- 172.21.15.71:0/707799450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18a8005bc0 0x7f18a8005fe0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f18b4001750 tx=0x7f18a8007a40 comp rx=0 tx=0).stop 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.929+0000 7f18c3e00640 1 -- 172.21.15.71:0/707799450 shutdown_connections 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.929+0000 7f18c3e00640 1 --2- 172.21.15.71:0/707799450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18a8005bc0 0x7f18a8005fe0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.929+0000 7f18c3e00640 1 -- 172.21.15.71:0/707799450 >> 172.21.15.71:0/707799450 conn(0x7f18c40b5270 msgr2=0x7f18c40b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.930+0000 7f18c3e00640 1 -- 172.21.15.71:0/707799450 shutdown_connections 2024-04-20T21:20:34.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.930+0000 7f18c3e00640 1 -- 172.21.15.71:0/707799450 wait complete. 2024-04-20T21:20:34.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.931+0000 7f18c3e00640 1 Processor -- start 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.931+0000 7f18c3e00640 1 -- start start 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.932+0000 7f18c3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a8005bc0 0x7f18c409ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.932+0000 7f18c3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18c409db90 0x7f18c41e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.932+0000 7f18c3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c41491f0 0x7f18c4149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.932+0000 7f18c3e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18c40d0b90 con 0x7f18c409db90 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.932+0000 7f18c3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18c40d08b0 con 0x7f18a8005bc0 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.932+0000 7f18c3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f18c40d0e70 con 0x7f18c41491f0 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.933+0000 7f18c2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18c409db90 0x7f18c41e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.933+0000 7f18c2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18c409db90 0x7f18c41e9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57524/0 (socket says 172.21.15.71:57524) 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.933+0000 7f18c2000640 1 -- 172.21.15.71:0/3334651966 learned_addr learned my addr 172.21.15.71:0/3334651966 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.933+0000 7f18c3400640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c41491f0 0x7f18c4149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.933+0000 7f18c2a00640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a8005bc0 0x7f18c409ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.933+0000 7f18c2000640 1 -- 172.21.15.71:0/3334651966 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c41491f0 msgr2=0x7f18c4149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.933+0000 7f18c2000640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c41491f0 0x7f18c4149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.933+0000 7f18c2000640 1 -- 172.21.15.71:0/3334651966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a8005bc0 msgr2=0x7f18c409ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.933+0000 7f18c2000640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a8005bc0 0x7f18c409ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.933+0000 7f18c2000640 1 -- 172.21.15.71:0/3334651966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c409b1c0 con 0x7f18c409db90 2024-04-20T21:20:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.934+0000 7f18c2000640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18c409db90 0x7f18c41e9bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f18b000d7e0 tx=0x7f18b000dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.934+0000 7f18bb400640 1 -- 172.21.15.71:0/3334651966 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0019070 con 0x7f18c409db90 2024-04-20T21:20:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.934+0000 7f18bb400640 1 -- 172.21.15.71:0/3334651966 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b00074e0 con 0x7f18c409db90 2024-04-20T21:20:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.934+0000 7f18c3e00640 1 -- 172.21.15.71:0/3334651966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c409e150 con 0x7f18c409db90 2024-04-20T21:20:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.934+0000 7f18bb400640 1 -- 172.21.15.71:0/3334651966 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0004a00 con 0x7f18c409db90 2024-04-20T21:20:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.934+0000 7f18c3e00640 1 -- 172.21.15.71:0/3334651966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c409b760 con 0x7f18c409db90 2024-04-20T21:20:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.935+0000 7f18c3e00640 1 -- 172.21.15.71:0/3334651966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c40af7a0 con 0x7f18c409db90 2024-04-20T21:20:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.936+0000 7f18bb400640 1 -- 172.21.15.71:0/3334651966 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f18b001c070 con 0x7f18c409db90 2024-04-20T21:20:34.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.937+0000 7f18bb400640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f18a406c920 0x7f18a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:34.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.937+0000 7f18bb400640 1 -- 172.21.15.71:0/3334651966 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f18b008ba70 con 0x7f18c409db90 2024-04-20T21:20:34.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.937+0000 7f18c2a00640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f18a406c920 0x7f18a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:34.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.938+0000 7f18c2a00640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f18a406c920 0x7f18a406ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f18b4033000 tx=0x7f18b4009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:34.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:34.942+0000 7f18bb400640 1 -- 172.21.15.71:0/3334651966 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f18c40af7a0 con 0x7f18c409db90 2024-04-20T21:20:35.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.141+0000 7f18c3e00640 1 -- 172.21.15.71:0/3334651966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f18c4075b30 con 0x7f18c409db90 2024-04-20T21:20:35.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.142+0000 7f18bb400640 1 -- 172.21.15.71:0/3334651966 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f18c409b1c0 con 0x7f18c409db90 2024-04-20T21:20:35.142 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.144+0000 7f18c3e00640 1 -- 172.21.15.71:0/3334651966 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f18a406c920 msgr2=0x7f18a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.144+0000 7f18c3e00640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f18a406c920 0x7f18a406ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f18b4033000 tx=0x7f18b4009030 comp rx=0 tx=0).stop 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.145+0000 7f18c3e00640 1 -- 172.21.15.71:0/3334651966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18c409db90 msgr2=0x7f18c41e9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.145+0000 7f18c3e00640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18c409db90 0x7f18c41e9bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f18b000d7e0 tx=0x7f18b000dca0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.145+0000 7f18c3e00640 1 -- 172.21.15.71:0/3334651966 shutdown_connections 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.145+0000 7f18c3e00640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f18a406c920 0x7f18a406ede0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.145+0000 7f18c3e00640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18c41491f0 0x7f18c4149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.145+0000 7f18c3e00640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18c409db90 0x7f18c41e9bf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.145+0000 7f18c3e00640 1 --2- 172.21.15.71:0/3334651966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a8005bc0 0x7f18c409ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.145+0000 7f18c3e00640 1 -- 172.21.15.71:0/3334651966 >> 172.21.15.71:0/3334651966 conn(0x7f18c40b5270 msgr2=0x7f18c40aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.145+0000 7f18c3e00640 1 -- 172.21.15.71:0/3334651966 shutdown_connections 2024-04-20T21:20:35.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.145+0000 7f18c3e00640 1 -- 172.21.15.71:0/3334651966 wait complete. 2024-04-20T21:20:35.163 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:35.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.362+0000 7f078fc00640 1 Processor -- start 2024-04-20T21:20:35.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.363+0000 7f078fc00640 1 -- start start 2024-04-20T21:20:35.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.364+0000 7f078fc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07880d0700 0x7f07881620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.364+0000 7f078fc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f078806d680 0x7f0788162610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.364+0000 7f078fc00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07880b1d60 con 0x7f078806e350 2024-04-20T21:20:35.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.364+0000 7f078fc00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f07880b2c50 con 0x7f078806d680 2024-04-20T21:20:35.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.364+0000 7f078fc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f07880b2040 con 0x7f07880d0700 2024-04-20T21:20:35.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.365+0000 7f078dc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f078806d680 0x7f0788162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:35.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.365+0000 7f078d200640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f078806e350 0x7f07880cfff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43204/0 (socket says 172.21.15.71:43204) 2024-04-20T21:20:35.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.365+0000 7f078d200640 1 -- 172.21.15.71:0/4271166207 learned_addr learned my addr 172.21.15.71:0/4271166207 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:35.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.365+0000 7f0787e00640 1 --2- 172.21.15.71:0/4271166207 >> v2:172.21.15.137:3300/0 conn(0x7f07880d0700 0x7f07881620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:35.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.365+0000 7f078dc00640 1 -- 172.21.15.71:0/4271166207 >> v2:172.21.15.137:3300/0 conn(0x7f07880d0700 msgr2=0x7f07881620d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:35.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.365+0000 7f078dc00640 1 --2- 172.21.15.71:0/4271166207 >> v2:172.21.15.137:3300/0 conn(0x7f07880d0700 0x7f07881620d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.365+0000 7f078dc00640 1 -- 172.21.15.71:0/4271166207 >> v1:172.21.15.71:6789/0 conn(0x7f078806e350 legacy=0x7f07880cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:35.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.365+0000 7f078dc00640 1 -- 172.21.15.71:0/4271166207 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07880b2320 con 0x7f078806d680 2024-04-20T21:20:35.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.365+0000 7f0787400640 1 -- 172.21.15.71:0/4271166207 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2127941052 0 0) 0x7f07880b1d60 con 0x7f078806e350 2024-04-20T21:20:35.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.366+0000 7f078dc00640 1 --2- 172.21.15.71:0/4271166207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f078806d680 0x7f0788162610 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f07880b2dd0 tx=0x7f078002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9054e8fc2bc6ac6f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:35.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.367+0000 7f0787400640 1 -- 172.21.15.71:0/4271166207 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0780039070 con 0x7f078806d680 2024-04-20T21:20:35.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.367+0000 7f0787400640 1 -- 172.21.15.71:0/4271166207 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078002cc60 con 0x7f078806d680 2024-04-20T21:20:35.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.367+0000 7f0787400640 1 -- 172.21.15.71:0/4271166207 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0780034660 con 0x7f078806d680 2024-04-20T21:20:35.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.367+0000 7f078fc00640 1 -- 172.21.15.71:0/4271166207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f078806d680 msgr2=0x7f0788162610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:35.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.367+0000 7f078fc00640 1 --2- 172.21.15.71:0/4271166207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f078806d680 0x7f0788162610 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f07880b2dd0 tx=0x7f078002beb0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.367+0000 7f078fc00640 1 -- 172.21.15.71:0/4271166207 shutdown_connections 2024-04-20T21:20:35.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.367+0000 7f078fc00640 1 --2- 172.21.15.71:0/4271166207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f078806d680 0x7f0788162610 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.367+0000 7f078fc00640 1 --2- 172.21.15.71:0/4271166207 >> v2:172.21.15.137:3300/0 conn(0x7f07880d0700 0x7f07881620d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.367+0000 7f078fc00640 1 -- 172.21.15.71:0/4271166207 >> 172.21.15.71:0/4271166207 conn(0x7f07880b3fb0 msgr2=0x7f07880b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:35.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.367+0000 7f078fc00640 1 -- 172.21.15.71:0/4271166207 shutdown_connections 2024-04-20T21:20:35.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.368+0000 7f078fc00640 1 -- 172.21.15.71:0/4271166207 wait complete. 2024-04-20T21:20:35.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.369+0000 7f078fc00640 1 Processor -- start 2024-04-20T21:20:35.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.369+0000 7f078fc00640 1 -- start start 2024-04-20T21:20:35.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.370+0000 7f078fc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f078806d680 0x7f07880c0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.370+0000 7f078fc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f078806e350 0x7f07880cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.370+0000 7f078fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07880d0700 0x7f07880c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.370+0000 7f078fc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f078806efb0 con 0x7f078806e350 2024-04-20T21:20:35.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.370+0000 7f078fc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f07880b28e0 con 0x7f078806d680 2024-04-20T21:20:35.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.370+0000 7f078fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f078806f130 con 0x7f07880d0700 2024-04-20T21:20:35.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.371+0000 7f0787e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f078806e350 0x7f07880cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:35.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.371+0000 7f0787e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f078806e350 0x7f07880cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57550/0 (socket says 172.21.15.71:57550) 2024-04-20T21:20:35.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.371+0000 7f0787e00640 1 -- 172.21.15.71:0/1074889346 learned_addr learned my addr 172.21.15.71:0/1074889346 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.371+0000 7f078d200640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f078806d680 0x7f07880c0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.371+0000 7f0787e00640 1 -- 172.21.15.71:0/1074889346 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07880d0700 msgr2=0x7f07880c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.371+0000 7f0787e00640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07880d0700 0x7f07880c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.371+0000 7f0787e00640 1 -- 172.21.15.71:0/1074889346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f078806d680 msgr2=0x7f07880c0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.371+0000 7f0787e00640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f078806d680 0x7f07880c0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.371+0000 7f0787e00640 1 -- 172.21.15.71:0/1074889346 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07880c5070 con 0x7f078806e350 2024-04-20T21:20:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.371+0000 7f078d200640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f078806d680 0x7f07880c0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.371+0000 7f0787e00640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f078806e350 0x7f07880cb930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f077000d7d0 tx=0x7f077000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.372+0000 7f0784c00640 1 -- 172.21.15.71:0/1074889346 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077000b6c0 con 0x7f078806e350 2024-04-20T21:20:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.372+0000 7f0784c00640 1 -- 172.21.15.71:0/1074889346 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0770019070 con 0x7f078806e350 2024-04-20T21:20:35.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.372+0000 7f0784c00640 1 -- 172.21.15.71:0/1074889346 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077000ba80 con 0x7f078806e350 2024-04-20T21:20:35.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.372+0000 7f078fc00640 1 -- 172.21.15.71:0/1074889346 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07880c7560 con 0x7f078806e350 2024-04-20T21:20:35.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.372+0000 7f078fc00640 1 -- 172.21.15.71:0/1074889346 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07880c7b20 con 0x7f078806e350 2024-04-20T21:20:35.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.373+0000 7f078fc00640 1 -- 172.21.15.71:0/1074889346 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0788069090 con 0x7f078806e350 2024-04-20T21:20:35.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.374+0000 7f0784c00640 1 -- 172.21.15.71:0/1074889346 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f077000bc20 con 0x7f078806e350 2024-04-20T21:20:35.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.375+0000 7f0784c00640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f076406c8f0 0x7f076406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.375+0000 7f0784c00640 1 -- 172.21.15.71:0/1074889346 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f077008c410 con 0x7f078806e350 2024-04-20T21:20:35.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.376+0000 7f078d200640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f076406c8f0 0x7f076406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:35.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.376+0000 7f078d200640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f076406c8f0 0x7f076406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0778000f60 tx=0x7f0778009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.380+0000 7f0784c00640 1 -- 172.21.15.71:0/1074889346 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f077001c360 con 0x7f078806e350 2024-04-20T21:20:35.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.577+0000 7f078fc00640 1 -- 172.21.15.71:0/1074889346 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f07880b3910 con 0x7f078806e350 2024-04-20T21:20:35.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.577+0000 7f0784c00640 1 -- 172.21.15.71:0/1074889346 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f077005a400 con 0x7f078806e350 2024-04-20T21:20:35.577 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:35.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.581+0000 7f078fc00640 1 -- 172.21.15.71:0/1074889346 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f076406c8f0 msgr2=0x7f076406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:35.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.581+0000 7f078fc00640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f076406c8f0 0x7f076406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0778000f60 tx=0x7f0778009040 comp rx=0 tx=0).stop 2024-04-20T21:20:35.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.581+0000 7f078fc00640 1 -- 172.21.15.71:0/1074889346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f078806e350 msgr2=0x7f07880cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:35.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.581+0000 7f078fc00640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f078806e350 0x7f07880cb930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f077000d7d0 tx=0x7f077000dc90 comp rx=0 tx=0).stop 2024-04-20T21:20:35.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.581+0000 7f078fc00640 1 -- 172.21.15.71:0/1074889346 shutdown_connections 2024-04-20T21:20:35.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.581+0000 7f078fc00640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f076406c8f0 0x7f076406edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.581+0000 7f078fc00640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07880d0700 0x7f07880c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.581+0000 7f078fc00640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f078806e350 0x7f07880cb930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.581+0000 7f078fc00640 1 --2- 172.21.15.71:0/1074889346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f078806d680 0x7f07880c0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.581+0000 7f078fc00640 1 -- 172.21.15.71:0/1074889346 >> 172.21.15.71:0/1074889346 conn(0x7f07880b3fb0 msgr2=0x7f07880cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:35.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.581+0000 7f078fc00640 1 -- 172.21.15.71:0/1074889346 shutdown_connections 2024-04-20T21:20:35.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.582+0000 7f078fc00640 1 -- 172.21.15.71:0/1074889346 wait complete. 2024-04-20T21:20:35.599 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:35.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.800+0000 7ff402400640 1 Processor -- start 2024-04-20T21:20:35.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.800+0000 7ff402400640 1 -- start start 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.802+0000 7ff402400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3fc15a340 0x7ff3fc15cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.802+0000 7ff402400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff3fc0cf3d0 0x7ff3fc15d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.802+0000 7ff402400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3fc15d6a0 con 0x7ff3fc0ceff0 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.802+0000 7ff402400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff3fc15d950 con 0x7ff3fc15a340 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.802+0000 7ff402400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff3fc0d0480 con 0x7ff3fc0cf3d0 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.802+0000 7ff3f3e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3fc15a340 0x7ff3fc15cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.802+0000 7ff3f3e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3fc15a340 0x7ff3fc15cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57554/0 (socket says 172.21.15.71:57554) 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.802+0000 7ff3f3e00640 1 -- 172.21.15.71:0/547230333 learned_addr learned my addr 172.21.15.71:0/547230333 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.802+0000 7ff3fbe00640 1 --2- 172.21.15.71:0/547230333 >> v2:172.21.15.137:3300/0 conn(0x7ff3fc0cf3d0 0x7ff3fc15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.803+0000 7ff3f3e00640 1 -- 172.21.15.71:0/547230333 >> v2:172.21.15.137:3300/0 conn(0x7ff3fc0cf3d0 msgr2=0x7ff3fc15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.803+0000 7ff3f3e00640 1 --2- 172.21.15.71:0/547230333 >> v2:172.21.15.137:3300/0 conn(0x7ff3fc0cf3d0 0x7ff3fc15d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.803+0000 7ff3f3e00640 1 -- 172.21.15.71:0/547230333 >> v1:172.21.15.137:6789/0 conn(0x7ff3fc0ceff0 legacy=0x7ff3fc159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:35.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.803+0000 7ff3f3e00640 1 -- 172.21.15.71:0/547230333 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc0d0760 con 0x7ff3fc15a340 2024-04-20T21:20:35.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.804+0000 7ff3f3e00640 1 --2- 172.21.15.71:0/547230333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3fc15a340 0x7ff3fc15cc20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0b2f00 tx=0x7ff3e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e12d2c5936e589 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:35.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.804+0000 7ff3faa00640 1 -- 172.21.15.71:0/547230333 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4035020 con 0x7ff3fc15a340 2024-04-20T21:20:35.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.804+0000 7ff3faa00640 1 -- 172.21.15.71:0/547230333 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e4031870 con 0x7ff3fc15a340 2024-04-20T21:20:35.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.804+0000 7ff3faa00640 1 -- 172.21.15.71:0/547230333 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4031c40 con 0x7ff3fc15a340 2024-04-20T21:20:35.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.805+0000 7ff402400640 1 -- 172.21.15.71:0/547230333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3fc15a340 msgr2=0x7ff3fc15cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:35.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.805+0000 7ff402400640 1 --2- 172.21.15.71:0/547230333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3fc15a340 0x7ff3fc15cc20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0b2f00 tx=0x7ff3e402b910 comp rx=0 tx=0).stop 2024-04-20T21:20:35.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.805+0000 7ff402400640 1 -- 172.21.15.71:0/547230333 shutdown_connections 2024-04-20T21:20:35.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.805+0000 7ff402400640 1 --2- 172.21.15.71:0/547230333 >> v2:172.21.15.137:3300/0 conn(0x7ff3fc0cf3d0 0x7ff3fc15d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.805+0000 7ff402400640 1 --2- 172.21.15.71:0/547230333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3fc15a340 0x7ff3fc15cc20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.805+0000 7ff402400640 1 -- 172.21.15.71:0/547230333 >> 172.21.15.71:0/547230333 conn(0x7ff3fc071800 msgr2=0x7ff3fc071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:35.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.805+0000 7ff402400640 1 -- 172.21.15.71:0/547230333 shutdown_connections 2024-04-20T21:20:35.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.805+0000 7ff402400640 1 -- 172.21.15.71:0/547230333 wait complete. 2024-04-20T21:20:35.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.807+0000 7ff402400640 1 Processor -- start 2024-04-20T21:20:35.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.807+0000 7ff402400640 1 -- start start 2024-04-20T21:20:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.808+0000 7ff402400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3fc0ceff0 0x7ff3fc0c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.808+0000 7ff402400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3fc0cf3d0 0x7ff3fc15f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.808+0000 7ff402400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3fc15a340 0x7ff3fc15f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.808+0000 7ff402400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0d10e0 con 0x7ff3fc0ceff0 2024-04-20T21:20:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.808+0000 7ff402400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0d0f60 con 0x7ff3fc15a340 2024-04-20T21:20:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.808+0000 7ff402400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff3fc0d1260 con 0x7ff3fc0cf3d0 2024-04-20T21:20:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.808+0000 7ff3fb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3fc0ceff0 0x7ff3fc0c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.808+0000 7ff3fb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3fc0ceff0 0x7ff3fc0c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57568/0 (socket says 172.21.15.71:57568) 2024-04-20T21:20:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.808+0000 7ff3fb400640 1 -- 172.21.15.71:0/1176237768 learned_addr learned my addr 172.21.15.71:0/1176237768 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3f3e00640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3fc0cf3d0 0x7ff3fc15f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3fbe00640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3fc15a340 0x7ff3fc15f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3fb400640 1 -- 172.21.15.71:0/1176237768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3fc0cf3d0 msgr2=0x7ff3fc15f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3fb400640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3fc0cf3d0 0x7ff3fc15f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3fb400640 1 -- 172.21.15.71:0/1176237768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3fc15a340 msgr2=0x7ff3fc15f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3fb400640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3fc15a340 0x7ff3fc15f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3fb400640 1 -- 172.21.15.71:0/1176237768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc151c20 con 0x7ff3fc0ceff0 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3f3e00640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3fc0cf3d0 0x7ff3fc15f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3fbe00640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3fc15a340 0x7ff3fc15f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3fb400640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3fc0ceff0 0x7ff3fc0c8160 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00c460 tx=0x7ff3ec00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3f3400640 1 -- 172.21.15.71:0/1176237768 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec011790 con 0x7ff3fc0ceff0 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3f3400640 1 -- 172.21.15.71:0/1176237768 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ec017070 con 0x7ff3fc0ceff0 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff402400640 1 -- 172.21.15.71:0/1176237768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc151f00 con 0x7ff3fc0ceff0 2024-04-20T21:20:35.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.809+0000 7ff3f3400640 1 -- 172.21.15.71:0/1176237768 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec011bb0 con 0x7ff3fc0ceff0 2024-04-20T21:20:35.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.810+0000 7ff402400640 1 -- 172.21.15.71:0/1176237768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc0c6180 con 0x7ff3fc0ceff0 2024-04-20T21:20:35.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.811+0000 7ff402400640 1 -- 172.21.15.71:0/1176237768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3fc068980 con 0x7ff3fc0ceff0 2024-04-20T21:20:35.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.812+0000 7ff3f3400640 1 -- 172.21.15.71:0/1176237768 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff3ec01c460 con 0x7ff3fc0ceff0 2024-04-20T21:20:35.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.813+0000 7ff3f3400640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff3d806c8f0 0x7ff3d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:35.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.813+0000 7ff3f3400640 1 -- 172.21.15.71:0/1176237768 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ff3ec08be60 con 0x7ff3fc0ceff0 2024-04-20T21:20:35.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.813+0000 7ff3f3e00640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff3d806c8f0 0x7ff3d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:35.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.814+0000 7ff3f3e00640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff3d806c8f0 0x7ff3d806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4036000 tx=0x7ff3e4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:35.817+0000 7ff3f3400640 1 -- 172.21.15.71:0/1176237768 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff3ec059de0 con 0x7ff3fc0ceff0 2024-04-20T21:20:36.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.016+0000 7ff402400640 1 -- 172.21.15.71:0/1176237768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff3fc0c5c40 con 0x7ff3fc0ceff0 2024-04-20T21:20:36.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.019+0000 7ff3f3400640 1 -- 172.21.15.71:0/1176237768 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7ff3ec0596e0 con 0x7ff3fc0ceff0 2024-04-20T21:20:36.018 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:36.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.021+0000 7ff402400640 1 -- 172.21.15.71:0/1176237768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff3d806c8f0 msgr2=0x7ff3d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.021+0000 7ff402400640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff3d806c8f0 0x7ff3d806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4036000 tx=0x7ff3e4008030 comp rx=0 tx=0).stop 2024-04-20T21:20:36.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.021+0000 7ff402400640 1 -- 172.21.15.71:0/1176237768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3fc0ceff0 msgr2=0x7ff3fc0c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.021+0000 7ff402400640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3fc0ceff0 0x7ff3fc0c8160 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00c460 tx=0x7ff3ec00c920 comp rx=0 tx=0).stop 2024-04-20T21:20:36.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.021+0000 7ff402400640 1 -- 172.21.15.71:0/1176237768 shutdown_connections 2024-04-20T21:20:36.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.021+0000 7ff402400640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff3d806c8f0 0x7ff3d806edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.021+0000 7ff402400640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3fc15a340 0x7ff3fc15f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.021+0000 7ff402400640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3fc0cf3d0 0x7ff3fc15f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.021+0000 7ff402400640 1 --2- 172.21.15.71:0/1176237768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3fc0ceff0 0x7ff3fc0c8160 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.021+0000 7ff402400640 1 -- 172.21.15.71:0/1176237768 >> 172.21.15.71:0/1176237768 conn(0x7ff3fc071800 msgr2=0x7ff3fc0d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:36.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.021+0000 7ff402400640 1 -- 172.21.15.71:0/1176237768 shutdown_connections 2024-04-20T21:20:36.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.022+0000 7ff402400640 1 -- 172.21.15.71:0/1176237768 wait complete. 2024-04-20T21:20:36.040 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T21:20:36.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.218+0000 7f5a60000640 1 Processor -- start 2024-04-20T21:20:36.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.218+0000 7f5a60000640 1 -- start start 2024-04-20T21:20:36.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.220+0000 7f5a60000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a580b11c0 0x7f5a580d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.220+0000 7f5a60000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5a580d4930 0x7f5a580d4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.220+0000 7f5a60000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a580d23b0 con 0x7f5a5815e9c0 2024-04-20T21:20:36.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.220+0000 7f5a60000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5a580d0f20 con 0x7f5a580d4930 2024-04-20T21:20:36.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.220+0000 7f5a60000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5a580d2ce0 con 0x7f5a580b11c0 2024-04-20T21:20:36.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.220+0000 7f5a5d600640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5a5815e9c0 0x7f5a580d0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43210/0 (socket says 172.21.15.71:43210) 2024-04-20T21:20:36.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.220+0000 7f5a5d600640 1 -- 172.21.15.71:0/471185592 learned_addr learned my addr 172.21.15.71:0/471185592 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:36.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2156142385 0 0) 0x7f5a580d23b0 con 0x7f5a5815e9c0 2024-04-20T21:20:36.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a3c003520 con 0x7f5a5815e9c0 2024-04-20T21:20:36.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a5cc00640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a580b11c0 0x7f5a580d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a5e000640 1 --2- 172.21.15.71:0/471185592 >> v2:172.21.15.137:3300/0 conn(0x7f5a580d4930 0x7f5a580d4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2307328743 0 0) 0x7f5a3c003520 con 0x7f5a5815e9c0 2024-04-20T21:20:36.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a580b11c0 msgr2=0x7f5a580d1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:36.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a580b11c0 0x7f5a580d1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 >> v2:172.21.15.137:3300/0 conn(0x7f5a580d4930 msgr2=0x7f5a580d4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:36.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 --2- 172.21.15.71:0/471185592 >> v2:172.21.15.137:3300/0 conn(0x7f5a580d4930 0x7f5a580d4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a580d2690 con 0x7f5a5815e9c0 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f5a480019f0 con 0x7f5a5815e9c0 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 >> v1:172.21.15.71:6789/0 conn(0x7f5a5815e9c0 legacy=0x7f5a580d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a580b11c0 0x7f5a3c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c004030 0x7f5a3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a3c004d40 0x7f5a3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a580d0f20 con 0x7f5a3c004030 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5a580d2ce0 con 0x7f5a3c004d40 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3c00bbd0 con 0x7f5a580b11c0 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.221+0000 7f5a5cc00640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c004030 0x7f5a3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.222+0000 7f5a5d600640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a580b11c0 0x7f5a3c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.222+0000 7f5a5e000640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a3c004d40 0x7f5a3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.222+0000 7f5a5cc00640 1 -- 172.21.15.71:0/471185592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a580b11c0 msgr2=0x7f5a3c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.222+0000 7f5a5cc00640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a580b11c0 0x7f5a3c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.222+0000 7f5a5cc00640 1 -- 172.21.15.71:0/471185592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a3c004d40 msgr2=0x7f5a3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:36.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.222+0000 7f5a5cc00640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a3c004d40 0x7f5a3c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.222+0000 7f5a5cc00640 1 -- 172.21.15.71:0/471185592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c003520 con 0x7f5a3c004030 2024-04-20T21:20:36.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.223+0000 7f5a5cc00640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c004030 0x7f5a3c004800 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400ba00 tx=0x7f5a3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb279b0ffe0229f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:36.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.223+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44036020 con 0x7f5a3c004030 2024-04-20T21:20:36.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.223+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a44032620 con 0x7f5a3c004030 2024-04-20T21:20:36.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.223+0000 7f5a57e00640 1 -- 172.21.15.71:0/471185592 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4400b600 con 0x7f5a3c004030 2024-04-20T21:20:36.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.224+0000 7f5a60000640 1 -- 172.21.15.71:0/471185592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c004030 msgr2=0x7f5a3c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.224+0000 7f5a60000640 1 --2- 172.21.15.71:0/471185592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c004030 0x7f5a3c004800 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400ba00 tx=0x7f5a3c005830 comp rx=0 tx=0).stop 2024-04-20T21:20:36.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.224+0000 7f5a5e000640 1 -- 172.21.15.71:0/471185592 reap_dead start 2024-04-20T21:20:36.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.224+0000 7f5a60000640 1 -- 172.21.15.71:0/471185592 shutdown_connections 2024-04-20T21:20:36.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.224+0000 7f5a60000640 1 -- 172.21.15.71:0/471185592 >> 172.21.15.71:0/471185592 conn(0x7f5a580b9600 msgr2=0x7f5a580b9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:36.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.224+0000 7f5a60000640 1 -- 172.21.15.71:0/471185592 shutdown_connections 2024-04-20T21:20:36.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.224+0000 7f5a60000640 1 -- 172.21.15.71:0/471185592 wait complete. 2024-04-20T21:20:36.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.225+0000 7f5a60000640 1 Processor -- start 2024-04-20T21:20:36.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.226+0000 7f5a60000640 1 -- start start 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.226+0000 7f5a60000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a3c004030 0x7f5a5814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.226+0000 7f5a60000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a581f5230 0x7f5a5815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.226+0000 7f5a60000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a58160150 0x7f5a581605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a60000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a580d1d20 con 0x7f5a58160150 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a60000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5a580d1ba0 con 0x7f5a581f5230 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a60000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5a580d1ea0 con 0x7f5a3c004030 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a5e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a58160150 0x7f5a581605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a5e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a58160150 0x7f5a581605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57586/0 (socket says 172.21.15.71:57586) 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a5e000640 1 -- 172.21.15.71:0/3271016035 learned_addr learned my addr 172.21.15.71:0/3271016035 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a5cc00640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a581f5230 0x7f5a5815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a5d600640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a3c004030 0x7f5a5814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a5e000640 1 -- 172.21.15.71:0/3271016035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a3c004030 msgr2=0x7f5a5814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a5e000640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a3c004030 0x7f5a5814fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a5e000640 1 -- 172.21.15.71:0/3271016035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a581f5230 msgr2=0x7f5a5815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a5e000640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a581f5230 0x7f5a5815eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a5e000640 1 -- 172.21.15.71:0/3271016035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5815f710 con 0x7f5a58160150 2024-04-20T21:20:36.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.227+0000 7f5a5e000640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a58160150 0x7f5a581605d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5a50006fd0 tx=0x7f5a5000e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:36.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.228+0000 7f5a55600640 1 -- 172.21.15.71:0/3271016035 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000f040 con 0x7f5a58160150 2024-04-20T21:20:36.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.228+0000 7f5a55600640 1 -- 172.21.15.71:0/3271016035 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a50004020 con 0x7f5a58160150 2024-04-20T21:20:36.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.228+0000 7f5a55600640 1 -- 172.21.15.71:0/3271016035 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50004410 con 0x7f5a58160150 2024-04-20T21:20:36.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.228+0000 7f5a60000640 1 -- 172.21.15.71:0/3271016035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5815f9f0 con 0x7f5a58160150 2024-04-20T21:20:36.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.228+0000 7f5a60000640 1 -- 172.21.15.71:0/3271016035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a58150740 con 0x7f5a58160150 2024-04-20T21:20:36.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.229+0000 7f5a60000640 1 -- 172.21.15.71:0/3271016035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a58068980 con 0x7f5a58160150 2024-04-20T21:20:36.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.230+0000 7f5a55600640 1 -- 172.21.15.71:0/3271016035 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a5001b020 con 0x7f5a58160150 2024-04-20T21:20:36.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.231+0000 7f5a55600640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a3806c8f0 0x7f5a3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.231+0000 7f5a55600640 1 -- 172.21.15.71:0/3271016035 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f5a5008b320 con 0x7f5a58160150 2024-04-20T21:20:36.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.231+0000 7f5a5d600640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a3806c8f0 0x7f5a3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.232+0000 7f5a5d600640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a3806c8f0 0x7f5a3806edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5a480013d0 tx=0x7f5a480014d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:36.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.235+0000 7f5a55600640 1 -- 172.21.15.71:0/3271016035 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5a50059290 con 0x7f5a58160150 2024-04-20T21:20:36.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.448+0000 7f5a60000640 1 -- 172.21.15.71:0/3271016035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5a5806efb0 con 0x7f5a58160150 2024-04-20T21:20:36.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.449+0000 7f5a55600640 1 -- 172.21.15.71:0/3271016035 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f5a50058b90 con 0x7f5a58160150 2024-04-20T21:20:36.449 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2024-04-20T21:20:36.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 -- 172.21.15.71:0/3271016035 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a3806c8f0 msgr2=0x7f5a3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a3806c8f0 0x7f5a3806edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5a480013d0 tx=0x7f5a480014d0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 -- 172.21.15.71:0/3271016035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a58160150 msgr2=0x7f5a581605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a58160150 0x7f5a581605d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5a50006fd0 tx=0x7f5a5000e830 comp rx=0 tx=0).stop 2024-04-20T21:20:36.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 -- 172.21.15.71:0/3271016035 shutdown_connections 2024-04-20T21:20:36.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5a3806c8f0 0x7f5a3806edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a58160150 0x7f5a581605d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a581f5230 0x7f5a5815eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 --2- 172.21.15.71:0/3271016035 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a3c004030 0x7f5a5814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 -- 172.21.15.71:0/3271016035 >> 172.21.15.71:0/3271016035 conn(0x7f5a580b9600 msgr2=0x7f5a5806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:36.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 -- 172.21.15.71:0/3271016035 shutdown_connections 2024-04-20T21:20:36.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.452+0000 7f5a60000640 1 -- 172.21.15.71:0/3271016035 wait complete. 2024-04-20T21:20:36.470 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:20:36.470 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:36.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:36.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.755+0000 7fede1200640 1 Processor -- start 2024-04-20T21:20:36.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.755+0000 7fede1200640 1 -- start start 2024-04-20T21:20:36.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.757+0000 7fede1200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feddc15a1f0 0x7feddc072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.757+0000 7fede1200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feddc072190 0x7feddc073420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.757+0000 7fede1200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feddc15cc90 con 0x7feddc159e10 2024-04-20T21:20:36.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.757+0000 7fede1200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7feddc072900 con 0x7feddc072190 2024-04-20T21:20:36.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.757+0000 7fede1200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feddc15ca40 con 0x7feddc15a1f0 2024-04-20T21:20:36.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.757+0000 7feddb400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7feddc159e10 0x7feddc071a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43224/0 (socket says 172.21.15.71:43224) 2024-04-20T21:20:36.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.757+0000 7feddb400640 1 -- 172.21.15.71:0/852193256 learned_addr learned my addr 172.21.15.71:0/852193256 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:36.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.757+0000 7feddbe00640 1 --2- 172.21.15.71:0/852193256 >> v2:172.21.15.71:3300/0 conn(0x7feddc072190 0x7feddc073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.758+0000 7feddaa00640 1 --2- 172.21.15.71:0/852193256 >> v2:172.21.15.137:3300/0 conn(0x7feddc15a1f0 0x7feddc072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.758+0000 7fedda000640 1 -- 172.21.15.71:0/852193256 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520218555 0 0) 0x7feddc15cc90 con 0x7feddc159e10 2024-04-20T21:20:36.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.758+0000 7fedda000640 1 -- 172.21.15.71:0/852193256 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedc0003520 con 0x7feddc159e10 2024-04-20T21:20:36.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.758+0000 7feddbe00640 1 -- 172.21.15.71:0/852193256 >> v2:172.21.15.137:3300/0 conn(0x7feddc15a1f0 msgr2=0x7feddc072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:36.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.758+0000 7feddbe00640 1 --2- 172.21.15.71:0/852193256 >> v2:172.21.15.137:3300/0 conn(0x7feddc15a1f0 0x7feddc072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.758+0000 7feddbe00640 1 -- 172.21.15.71:0/852193256 >> v1:172.21.15.71:6789/0 conn(0x7feddc159e10 legacy=0x7feddc071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.758+0000 7feddbe00640 1 -- 172.21.15.71:0/852193256 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc15cf70 con 0x7feddc072190 2024-04-20T21:20:36.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.759+0000 7feddbe00640 1 --2- 172.21.15.71:0/852193256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feddc072190 0x7feddc073420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feddc050400 tx=0x7fedd402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447705c7325dcd59 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:36.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.759+0000 7fedda000640 1 -- 172.21.15.71:0/852193256 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4035020 con 0x7feddc072190 2024-04-20T21:20:36.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.759+0000 7fedda000640 1 -- 172.21.15.71:0/852193256 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd4031830 con 0x7feddc072190 2024-04-20T21:20:36.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.759+0000 7fedda000640 1 -- 172.21.15.71:0/852193256 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4031c00 con 0x7feddc072190 2024-04-20T21:20:36.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.760+0000 7fede1200640 1 -- 172.21.15.71:0/852193256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feddc072190 msgr2=0x7feddc073420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.760+0000 7fede1200640 1 --2- 172.21.15.71:0/852193256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feddc072190 0x7feddc073420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feddc050400 tx=0x7fedd402b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.760+0000 7fede1200640 1 -- 172.21.15.71:0/852193256 shutdown_connections 2024-04-20T21:20:36.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.760+0000 7fede1200640 1 --2- 172.21.15.71:0/852193256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feddc072190 0x7feddc073420 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.760+0000 7fede1200640 1 --2- 172.21.15.71:0/852193256 >> v2:172.21.15.137:3300/0 conn(0x7feddc15a1f0 0x7feddc072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.760+0000 7fede1200640 1 -- 172.21.15.71:0/852193256 >> 172.21.15.71:0/852193256 conn(0x7feddc0d0040 msgr2=0x7feddc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:36.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.760+0000 7fede1200640 1 -- 172.21.15.71:0/852193256 shutdown_connections 2024-04-20T21:20:36.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.760+0000 7fede1200640 1 -- 172.21.15.71:0/852193256 wait complete. 2024-04-20T21:20:36.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.762+0000 7fede1200640 1 Processor -- start 2024-04-20T21:20:36.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.762+0000 7fede1200640 1 -- start start 2024-04-20T21:20:36.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7fede1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feddc072190 0x7feddc152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7fede1200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feddc159e10 0x7feddc0b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7fede1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feddc15a1f0 0x7feddc0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7fede1200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feddc15d810 con 0x7feddc159e10 2024-04-20T21:20:36.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7fede1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feddc15d530 con 0x7feddc072190 2024-04-20T21:20:36.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7fede1200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feddc06da90 con 0x7feddc15a1f0 2024-04-20T21:20:36.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7feddaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feddc159e10 0x7feddc0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7feddaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feddc159e10 0x7feddc0b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57606/0 (socket says 172.21.15.71:57606) 2024-04-20T21:20:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7feddaa00640 1 -- 172.21.15.71:0/416268072 learned_addr learned my addr 172.21.15.71:0/416268072 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7feddb400640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feddc072190 0x7feddc152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7feddaa00640 1 -- 172.21.15.71:0/416268072 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feddc15a1f0 msgr2=0x7feddc0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7feddaa00640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feddc15a1f0 0x7feddc0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7feddaa00640 1 -- 172.21.15.71:0/416268072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feddc072190 msgr2=0x7feddc152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7feddaa00640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feddc072190 0x7feddc152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.763+0000 7feddaa00640 1 -- 172.21.15.71:0/416268072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc159630 con 0x7feddc159e10 2024-04-20T21:20:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.764+0000 7feddaa00640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feddc159e10 0x7feddc0b43a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fedc400d5d0 tx=0x7fedc400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:36.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.764+0000 7fedd3400640 1 -- 172.21.15.71:0/416268072 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4004240 con 0x7feddc159e10 2024-04-20T21:20:36.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.764+0000 7fedd3400640 1 -- 172.21.15.71:0/416268072 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc40043e0 con 0x7feddc159e10 2024-04-20T21:20:36.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.764+0000 7fedd3400640 1 -- 172.21.15.71:0/416268072 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4003830 con 0x7feddc159e10 2024-04-20T21:20:36.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.764+0000 7fede1200640 1 -- 172.21.15.71:0/416268072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feddc0b31a0 con 0x7feddc159e10 2024-04-20T21:20:36.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.764+0000 7fede1200640 1 -- 172.21.15.71:0/416268072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feddc159350 con 0x7feddc159e10 2024-04-20T21:20:36.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.765+0000 7fede1200640 1 -- 172.21.15.71:0/416268072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feddc075b60 con 0x7feddc159e10 2024-04-20T21:20:36.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.766+0000 7fedd3400640 1 -- 172.21.15.71:0/416268072 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fedc40039d0 con 0x7feddc159e10 2024-04-20T21:20:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.767+0000 7fedd3400640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb806c920 0x7fedb806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.767+0000 7fedd3400640 1 -- 172.21.15.71:0/416268072 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fedc408c200 con 0x7feddc159e10 2024-04-20T21:20:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.767+0000 7feddb400640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb806c920 0x7fedb806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:36.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.768+0000 7feddb400640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb806c920 0x7fedb806ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0012e0 tx=0x7fedcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:36.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.772+0000 7fedd3400640 1 -- 172.21.15.71:0/416268072 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fedc405a200 con 0x7feddc159e10 2024-04-20T21:20:36.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.975+0000 7fede1200640 1 -- 172.21.15.71:0/416268072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feddc06c790 con 0x7feddc159e10 2024-04-20T21:20:36.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.978+0000 7fedd3400640 1 -- 172.21.15.71:0/416268072 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7fedc4059b00 con 0x7feddc159e10 2024-04-20T21:20:36.979 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:36.979 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.981+0000 7fede1200640 1 -- 172.21.15.71:0/416268072 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb806c920 msgr2=0x7fedb806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.981+0000 7fede1200640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb806c920 0x7fedb806ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0012e0 tx=0x7fedcc009040 comp rx=0 tx=0).stop 2024-04-20T21:20:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.981+0000 7fede1200640 1 -- 172.21.15.71:0/416268072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feddc159e10 msgr2=0x7feddc0b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.981+0000 7fede1200640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feddc159e10 0x7feddc0b43a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fedc400d5d0 tx=0x7fedc400da90 comp rx=0 tx=0).stop 2024-04-20T21:20:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.981+0000 7fede1200640 1 -- 172.21.15.71:0/416268072 shutdown_connections 2024-04-20T21:20:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.981+0000 7fede1200640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb806c920 0x7fedb806ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.981+0000 7fede1200640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feddc15a1f0 0x7feddc0b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.981+0000 7fede1200640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feddc159e10 0x7feddc0b43a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.981+0000 7fede1200640 1 --2- 172.21.15.71:0/416268072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feddc072190 0x7feddc152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.981+0000 7fede1200640 1 -- 172.21.15.71:0/416268072 >> 172.21.15.71:0/416268072 conn(0x7feddc0d0040 msgr2=0x7feddc06ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.981+0000 7fede1200640 1 -- 172.21.15.71:0/416268072 shutdown_connections 2024-04-20T21:20:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:36.982+0000 7fede1200640 1 -- 172.21.15.71:0/416268072 wait complete. 2024-04-20T21:20:37.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:37.001 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:37.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.203+0000 7f972d200640 1 Processor -- start 2024-04-20T21:20:37.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.203+0000 7f972d200640 1 -- start start 2024-04-20T21:20:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.205+0000 7f972d200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f97280cb570 0x7f9728071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.205+0000 7f972d200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f972815b360 0x7f972806ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.205+0000 7f972d200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972806f3b0 con 0x7f972815af80 2024-04-20T21:20:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.205+0000 7f972d200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f972809e150 con 0x7f972815b360 2024-04-20T21:20:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.205+0000 7f972d200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f972806f180 con 0x7f97280cb570 2024-04-20T21:20:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.205+0000 7f9727400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f972815af80 0x7f97280cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43234/0 (socket says 172.21.15.71:43234) 2024-04-20T21:20:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.205+0000 7f9727400640 1 -- 172.21.15.71:0/601474610 learned_addr learned my addr 172.21.15.71:0/601474610 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.206+0000 7f9727e00640 1 --2- 172.21.15.71:0/601474610 >> v2:172.21.15.71:3300/0 conn(0x7f972815b360 0x7f972806ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.206+0000 7f971fe00640 1 --2- 172.21.15.71:0/601474610 >> v2:172.21.15.137:3300/0 conn(0x7f97280cb570 0x7f9728071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.206+0000 7f9726a00640 1 -- 172.21.15.71:0/601474610 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567959109 0 0) 0x7f972806f3b0 con 0x7f972815af80 2024-04-20T21:20:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.206+0000 7f9726a00640 1 -- 172.21.15.71:0/601474610 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f970c003520 con 0x7f972815af80 2024-04-20T21:20:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.206+0000 7f9727e00640 1 -- 172.21.15.71:0/601474610 >> v2:172.21.15.137:3300/0 conn(0x7f97280cb570 msgr2=0x7f9728071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:37.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.206+0000 7f9727e00640 1 --2- 172.21.15.71:0/601474610 >> v2:172.21.15.137:3300/0 conn(0x7f97280cb570 0x7f9728071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.206+0000 7f9727e00640 1 -- 172.21.15.71:0/601474610 >> v1:172.21.15.71:6789/0 conn(0x7f972815af80 legacy=0x7f97280cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.206+0000 7f9727e00640 1 -- 172.21.15.71:0/601474610 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972806f690 con 0x7f972815b360 2024-04-20T21:20:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.207+0000 7f9727e00640 1 --2- 172.21.15.71:0/601474610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f972815b360 0x7f972806ec40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f97280cc980 tx=0x7f972002be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bd343d3a700e6c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.208+0000 7f9726a00640 1 -- 172.21.15.71:0/601474610 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9720039070 con 0x7f972815b360 2024-04-20T21:20:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.208+0000 7f9726a00640 1 -- 172.21.15.71:0/601474610 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f972002cbe0 con 0x7f972815b360 2024-04-20T21:20:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.208+0000 7f9726a00640 1 -- 172.21.15.71:0/601474610 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9720034440 con 0x7f972815b360 2024-04-20T21:20:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.208+0000 7f972d200640 1 -- 172.21.15.71:0/601474610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f972815b360 msgr2=0x7f972806ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.208+0000 7f972d200640 1 --2- 172.21.15.71:0/601474610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f972815b360 0x7f972806ec40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f97280cc980 tx=0x7f972002be30 comp rx=0 tx=0).stop 2024-04-20T21:20:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.208+0000 7f972d200640 1 -- 172.21.15.71:0/601474610 shutdown_connections 2024-04-20T21:20:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.208+0000 7f972d200640 1 --2- 172.21.15.71:0/601474610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f972815b360 0x7f972806ec40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.208+0000 7f972d200640 1 --2- 172.21.15.71:0/601474610 >> v2:172.21.15.137:3300/0 conn(0x7f97280cb570 0x7f9728071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.208+0000 7f972d200640 1 -- 172.21.15.71:0/601474610 >> 172.21.15.71:0/601474610 conn(0x7f97280cffa0 msgr2=0x7f97280d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:37.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.208+0000 7f972d200640 1 -- 172.21.15.71:0/601474610 shutdown_connections 2024-04-20T21:20:37.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.208+0000 7f972d200640 1 -- 172.21.15.71:0/601474610 wait complete. 2024-04-20T21:20:37.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.210+0000 7f972d200640 1 Processor -- start 2024-04-20T21:20:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.210+0000 7f972d200640 1 -- start start 2024-04-20T21:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.211+0000 7f972d200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97280cb570 0x7f972815a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.211+0000 7f972d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f972815af80 0x7f97280b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.211+0000 7f972d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f972815b360 0x7f97280c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.211+0000 7f972d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97280ad480 con 0x7f972815af80 2024-04-20T21:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.211+0000 7f972d200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97280acf50 con 0x7f972815b360 2024-04-20T21:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.211+0000 7f972d200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f97280ca910 con 0x7f97280cb570 2024-04-20T21:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.212+0000 7f971fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f972815af80 0x7f97280b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.212+0000 7f971fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f972815af80 0x7f97280b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57618/0 (socket says 172.21.15.71:57618) 2024-04-20T21:20:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.212+0000 7f971fe00640 1 -- 172.21.15.71:0/755384533 learned_addr learned my addr 172.21.15.71:0/755384533 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.212+0000 7f9727400640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97280cb570 0x7f972815a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.212+0000 7f9727e00640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f972815b360 0x7f97280c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.212+0000 7f971fe00640 1 -- 172.21.15.71:0/755384533 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97280cb570 msgr2=0x7f972815a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.212+0000 7f971fe00640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97280cb570 0x7f972815a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.212+0000 7f971fe00640 1 -- 172.21.15.71:0/755384533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f972815b360 msgr2=0x7f97280c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.212+0000 7f971fe00640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f972815b360 0x7f97280c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.212+0000 7f971fe00640 1 -- 172.21.15.71:0/755384533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972815a790 con 0x7f972815af80 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.212+0000 7f971fe00640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f972815af80 0x7f97280b2d60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f971000d800 tx=0x7f971000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.213+0000 7f971f400640 1 -- 172.21.15.71:0/755384533 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971000b660 con 0x7f972815af80 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.213+0000 7f971f400640 1 -- 172.21.15.71:0/755384533 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9710019070 con 0x7f972815af80 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.213+0000 7f971f400640 1 -- 172.21.15.71:0/755384533 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971000ba20 con 0x7f972815af80 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.213+0000 7f972d200640 1 -- 172.21.15.71:0/755384533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97281591b0 con 0x7f972815af80 2024-04-20T21:20:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.213+0000 7f972d200640 1 -- 172.21.15.71:0/755384533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9728159770 con 0x7f972815af80 2024-04-20T21:20:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.214+0000 7f972d200640 1 -- 172.21.15.71:0/755384533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9728075b30 con 0x7f972815af80 2024-04-20T21:20:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.215+0000 7f971f400640 1 -- 172.21.15.71:0/755384533 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f971000bbc0 con 0x7f972815af80 2024-04-20T21:20:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.216+0000 7f971f400640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f970406c920 0x7f970406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.216+0000 7f971f400640 1 -- 172.21.15.71:0/755384533 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f971008c3d0 con 0x7f972815af80 2024-04-20T21:20:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.216+0000 7f9727400640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f970406c920 0x7f970406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.217+0000 7f9727400640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f970406c920 0x7f970406ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9718000f60 tx=0x7f9718009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.220+0000 7f971f400640 1 -- 172.21.15.71:0/755384533 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f971001c360 con 0x7f972815af80 2024-04-20T21:20:37.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.416+0000 7f972d200640 1 -- 172.21.15.71:0/755384533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9728073e20 con 0x7f972815af80 2024-04-20T21:20:37.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.417+0000 7f971f400640 1 -- 172.21.15.71:0/755384533 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f971005a3d0 con 0x7f972815af80 2024-04-20T21:20:37.417 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:37.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 -- 172.21.15.71:0/755384533 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f970406c920 msgr2=0x7f970406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f970406c920 0x7f970406ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9718000f60 tx=0x7f9718009040 comp rx=0 tx=0).stop 2024-04-20T21:20:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 -- 172.21.15.71:0/755384533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f972815af80 msgr2=0x7f97280b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f972815af80 0x7f97280b2d60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f971000d800 tx=0x7f971000dcc0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 -- 172.21.15.71:0/755384533 shutdown_connections 2024-04-20T21:20:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f970406c920 0x7f970406ede0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f972815b360 0x7f97280c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f972815af80 0x7f97280b2d60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 --2- 172.21.15.71:0/755384533 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97280cb570 0x7f972815a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 -- 172.21.15.71:0/755384533 >> 172.21.15.71:0/755384533 conn(0x7f97280cffa0 msgr2=0x7f9728154380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 -- 172.21.15.71:0/755384533 shutdown_connections 2024-04-20T21:20:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.420+0000 7f972d200640 1 -- 172.21.15.71:0/755384533 wait complete. 2024-04-20T21:20:37.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:37.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.641+0000 7f8afa400640 1 Processor -- start 2024-04-20T21:20:37.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.641+0000 7f8afa400640 1 -- start start 2024-04-20T21:20:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.642+0000 7f8afa400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8af415a930 0x7f8af406cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.642+0000 7f8afa400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af406db90 0x7f8af406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.642+0000 7f8afa400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af415be80 con 0x7f8af406ea50 2024-04-20T21:20:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.642+0000 7f8afa400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8af406d2c0 con 0x7f8af415a930 2024-04-20T21:20:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.642+0000 7f8afa400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8af406eea0 con 0x7f8af406db90 2024-04-20T21:20:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.643+0000 7f8af9a00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8af406ea50 0x7f8af4072230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43240/0 (socket says 172.21.15.71:43240) 2024-04-20T21:20:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.643+0000 7f8af9a00640 1 -- 172.21.15.71:0/572073475 learned_addr learned my addr 172.21.15.71:0/572073475 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.643+0000 7f8af9000640 1 --2- 172.21.15.71:0/572073475 >> v2:172.21.15.137:3300/0 conn(0x7f8af415a930 0x7f8af406cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.643+0000 7f8af3e00640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af406db90 0x7f8af406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.643+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105842752 0 0) 0x7f8af415be80 con 0x7f8af406ea50 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.643+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8adc003520 con 0x7f8af406ea50 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.643+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1165222489 0 0) 0x7f8adc003520 con 0x7f8af406ea50 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.643+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af406db90 msgr2=0x7f8af406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.643+0000 7f8af3400640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af406db90 0x7f8af406e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.643+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 >> v2:172.21.15.137:3300/0 conn(0x7f8af415a930 msgr2=0x7f8af406cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af3400640 1 --2- 172.21.15.71:0/572073475 >> v2:172.21.15.137:3300/0 conn(0x7f8af415a930 0x7f8af406cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af406bce0 con 0x7f8af406ea50 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f8aec0019f0 con 0x7f8af406ea50 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 >> v1:172.21.15.71:6789/0 conn(0x7f8af406ea50 legacy=0x7f8af4072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af3400640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8adc0039b0 0x7f8adc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af3400640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af406db90 0x7f8adc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af3400640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8adc004d40 0x7f8adc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8af406d2c0 con 0x7f8adc0039b0 2024-04-20T21:20:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8af406eea0 con 0x7f8adc004d40 2024-04-20T21:20:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8adc00b9f0 con 0x7f8af406db90 2024-04-20T21:20:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af9000640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8adc0039b0 0x7f8adc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af3e00640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af406db90 0x7f8adc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af9000640 1 -- 172.21.15.71:0/572073475 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af406db90 msgr2=0x7f8adc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af9000640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8af406db90 0x7f8adc004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af9a00640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8adc004d40 0x7f8adc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af9000640 1 -- 172.21.15.71:0/572073475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8adc004d40 msgr2=0x7f8adc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af9000640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8adc004d40 0x7f8adc0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.644+0000 7f8af9000640 1 -- 172.21.15.71:0/572073475 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc003520 con 0x7f8adc0039b0 2024-04-20T21:20:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.646+0000 7f8af9000640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8adc0039b0 0x7f8adc003dd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009ac0 tx=0x7f8adc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947d152d6e00cb82 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.646+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8039070 con 0x7f8adc0039b0 2024-04-20T21:20:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.646+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae802c710 con 0x7f8adc0039b0 2024-04-20T21:20:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.646+0000 7f8af3400640 1 -- 172.21.15.71:0/572073475 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8009690 con 0x7f8adc0039b0 2024-04-20T21:20:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.646+0000 7f8afa400640 1 -- 172.21.15.71:0/572073475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8adc0039b0 msgr2=0x7f8adc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.646+0000 7f8afa400640 1 --2- 172.21.15.71:0/572073475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8adc0039b0 0x7f8adc003dd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009ac0 tx=0x7f8adc005830 comp rx=0 tx=0).stop 2024-04-20T21:20:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.646+0000 7f8af9a00640 1 -- 172.21.15.71:0/572073475 reap_dead start 2024-04-20T21:20:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.647+0000 7f8afa400640 1 -- 172.21.15.71:0/572073475 shutdown_connections 2024-04-20T21:20:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.647+0000 7f8afa400640 1 -- 172.21.15.71:0/572073475 >> 172.21.15.71:0/572073475 conn(0x7f8af40b5270 msgr2=0x7f8af40b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.647+0000 7f8afa400640 1 -- 172.21.15.71:0/572073475 shutdown_connections 2024-04-20T21:20:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.647+0000 7f8afa400640 1 -- 172.21.15.71:0/572073475 wait complete. 2024-04-20T21:20:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.648+0000 7f8afa400640 1 Processor -- start 2024-04-20T21:20:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.648+0000 7f8afa400640 1 -- start start 2024-04-20T21:20:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.649+0000 7f8afa400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8adc0039b0 0x7f8af41590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.649+0000 7f8afa400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8af4159df0 0x7f8af40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.649+0000 7f8afa400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40cd0d0 0x7f8af4152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.649+0000 7f8afa400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8af406c580 con 0x7f8af40cd0d0 2024-04-20T21:20:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.649+0000 7f8afa400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8af406c2a0 con 0x7f8af4159df0 2024-04-20T21:20:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.649+0000 7f8afa400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8af415ad10 con 0x7f8adc0039b0 2024-04-20T21:20:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.650+0000 7f8af9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40cd0d0 0x7f8af4152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.650+0000 7f8af9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40cd0d0 0x7f8af4152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57646/0 (socket says 172.21.15.71:57646) 2024-04-20T21:20:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.650+0000 7f8af9a00640 1 -- 172.21.15.71:0/2329909696 learned_addr learned my addr 172.21.15.71:0/2329909696 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.650+0000 7f8af9000640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8adc0039b0 0x7f8af41590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.650+0000 7f8af9a00640 1 -- 172.21.15.71:0/2329909696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8adc0039b0 msgr2=0x7f8af41590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.650+0000 7f8af9a00640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8adc0039b0 0x7f8af41590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.650+0000 7f8af3e00640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8af4159df0 0x7f8af40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.650+0000 7f8af9a00640 1 -- 172.21.15.71:0/2329909696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8af4159df0 msgr2=0x7f8af40ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.650+0000 7f8af9a00640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8af4159df0 0x7f8af40ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.650+0000 7f8af9a00640 1 -- 172.21.15.71:0/2329909696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af41520f0 con 0x7f8af40cd0d0 2024-04-20T21:20:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.650+0000 7f8af9a00640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40cd0d0 0x7f8af4152eb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8aec007c40 tx=0x7f8aec00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.651+0000 7f8af0c00640 1 -- 172.21.15.71:0/2329909696 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec004d60 con 0x7f8af40cd0d0 2024-04-20T21:20:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.651+0000 7f8af0c00640 1 -- 172.21.15.71:0/2329909696 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aec00bb80 con 0x7f8af40cd0d0 2024-04-20T21:20:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.651+0000 7f8af0c00640 1 -- 172.21.15.71:0/2329909696 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec007110 con 0x7f8af40cd0d0 2024-04-20T21:20:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.651+0000 7f8afa400640 1 -- 172.21.15.71:0/2329909696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af41523d0 con 0x7f8af40cd0d0 2024-04-20T21:20:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.651+0000 7f8afa400640 1 -- 172.21.15.71:0/2329909696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af4152990 con 0x7f8af40cd0d0 2024-04-20T21:20:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.652+0000 7f8afa400640 1 -- 172.21.15.71:0/2329909696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af406b900 con 0x7f8af40cd0d0 2024-04-20T21:20:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.653+0000 7f8af0c00640 1 -- 172.21.15.71:0/2329909696 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8aec01b020 con 0x7f8af40cd0d0 2024-04-20T21:20:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.654+0000 7f8af0c00640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8ad406c8f0 0x7f8ad406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.654+0000 7f8af0c00640 1 -- 172.21.15.71:0/2329909696 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f8aec08c070 con 0x7f8af40cd0d0 2024-04-20T21:20:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.654+0000 7f8af9000640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8ad406c8f0 0x7f8ad406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.655+0000 7f8af9000640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8ad406c8f0 0x7f8ad406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8036000 tx=0x7f8ae8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.659+0000 7f8af0c00640 1 -- 172.21.15.71:0/2329909696 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8af406b900 con 0x7f8af40cd0d0 2024-04-20T21:20:37.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.857+0000 7f8afa400640 1 -- 172.21.15.71:0/2329909696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8af4075b30 con 0x7f8af40cd0d0 2024-04-20T21:20:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.858+0000 7f8af0c00640 1 -- 172.21.15.71:0/2329909696 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f8aec05a070 con 0x7f8af40cd0d0 2024-04-20T21:20:37.858 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:37.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.861+0000 7f8afa400640 1 -- 172.21.15.71:0/2329909696 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8ad406c8f0 msgr2=0x7f8ad406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.861+0000 7f8afa400640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8ad406c8f0 0x7f8ad406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8036000 tx=0x7f8ae8030000 comp rx=0 tx=0).stop 2024-04-20T21:20:37.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.861+0000 7f8afa400640 1 -- 172.21.15.71:0/2329909696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40cd0d0 msgr2=0x7f8af4152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:37.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.861+0000 7f8afa400640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40cd0d0 0x7f8af4152eb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8aec007c40 tx=0x7f8aec00b4a0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.861+0000 7f8afa400640 1 -- 172.21.15.71:0/2329909696 shutdown_connections 2024-04-20T21:20:37.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.861+0000 7f8afa400640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8ad406c8f0 0x7f8ad406edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.861+0000 7f8afa400640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8af40cd0d0 0x7f8af4152eb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.861+0000 7f8afa400640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8af4159df0 0x7f8af40ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.861+0000 7f8afa400640 1 --2- 172.21.15.71:0/2329909696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8adc0039b0 0x7f8af41590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:37.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.861+0000 7f8afa400640 1 -- 172.21.15.71:0/2329909696 >> 172.21.15.71:0/2329909696 conn(0x7f8af40b5270 msgr2=0x7f8af415cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:37.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.861+0000 7f8afa400640 1 -- 172.21.15.71:0/2329909696 shutdown_connections 2024-04-20T21:20:37.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:37.862+0000 7f8afa400640 1 -- 172.21.15.71:0/2329909696 wait complete. 2024-04-20T21:20:37.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:38.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.082+0000 7f2792400640 1 Processor -- start 2024-04-20T21:20:38.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.082+0000 7f2792400640 1 -- start start 2024-04-20T21:20:38.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.084+0000 7f2792400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f278c15abb0 0x7f278c0725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.084+0000 7f2792400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c071b50 0x7f278c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.084+0000 7f2792400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278c06e840 con 0x7f278c0af800 2024-04-20T21:20:38.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.084+0000 7f2792400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f278c06eb00 con 0x7f278c15abb0 2024-04-20T21:20:38.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.084+0000 7f2792400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f278c15bf60 con 0x7f278c071b50 2024-04-20T21:20:38.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.084+0000 7f278b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f278c15abb0 0x7f278c0725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.084+0000 7f2782a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c071b50 0x7f278c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.085+0000 7f278b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f278c15abb0 0x7f278c0725b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.71:43322/0 (socket says 172.21.15.71:43322) 2024-04-20T21:20:38.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.085+0000 7f278b400640 1 -- 172.21.15.71:0/734959089 learned_addr learned my addr 172.21.15.71:0/734959089 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:38.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.085+0000 7f2782a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c071b50 0x7f278c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:51816/0 (socket says 172.21.15.71:51816) 2024-04-20T21:20:38.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.085+0000 7f2782a00640 1 -- 172.21.15.71:0/734959089 >> v2:172.21.15.137:3300/0 conn(0x7f278c15abb0 msgr2=0x7f278c0725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:38.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.085+0000 7f2782a00640 1 --2- 172.21.15.71:0/734959089 >> v2:172.21.15.137:3300/0 conn(0x7f278c15abb0 0x7f278c0725b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.085+0000 7f2782a00640 1 -- 172.21.15.71:0/734959089 >> v1:172.21.15.137:6789/0 conn(0x7f278c0af800 legacy=0x7f278c15e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.085+0000 7f2782a00640 1 -- 172.21.15.71:0/734959089 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c15b350 con 0x7f278c071b50 2024-04-20T21:20:38.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.085+0000 7f278b400640 1 --2- 172.21.15.71:0/734959089 >> v2:172.21.15.137:3300/0 conn(0x7f278c15abb0 0x7f278c0725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:20:38.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.085+0000 7f278aa00640 1 -- 172.21.15.71:0/734959089 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716198986 0 0) 0x7f278c06e840 con 0x7f278c0af800 2024-04-20T21:20:38.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.087+0000 7f2782a00640 1 --2- 172.21.15.71:0/734959089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c071b50 0x7f278c072af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27740097a0 tx=0x7f277402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f93ccb9ba7c780e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:38.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.087+0000 7f278aa00640 1 -- 172.21.15.71:0/734959089 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774035020 con 0x7f278c071b50 2024-04-20T21:20:38.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.087+0000 7f278aa00640 1 -- 172.21.15.71:0/734959089 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2774031810 con 0x7f278c071b50 2024-04-20T21:20:38.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.087+0000 7f278aa00640 1 -- 172.21.15.71:0/734959089 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774031be0 con 0x7f278c071b50 2024-04-20T21:20:38.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.088+0000 7f2792400640 1 -- 172.21.15.71:0/734959089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c071b50 msgr2=0x7f278c072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.088+0000 7f2792400640 1 --2- 172.21.15.71:0/734959089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c071b50 0x7f278c072af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27740097a0 tx=0x7f277402b8b0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.088+0000 7f2792400640 1 -- 172.21.15.71:0/734959089 shutdown_connections 2024-04-20T21:20:38.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.088+0000 7f2792400640 1 --2- 172.21.15.71:0/734959089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c071b50 0x7f278c072af0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.088+0000 7f2792400640 1 --2- 172.21.15.71:0/734959089 >> v2:172.21.15.137:3300/0 conn(0x7f278c15abb0 0x7f278c0725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.088+0000 7f2792400640 1 -- 172.21.15.71:0/734959089 >> 172.21.15.71:0/734959089 conn(0x7f278c0b3350 msgr2=0x7f278c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:38.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.088+0000 7f2792400640 1 -- 172.21.15.71:0/734959089 shutdown_connections 2024-04-20T21:20:38.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.088+0000 7f2792400640 1 -- 172.21.15.71:0/734959089 wait complete. 2024-04-20T21:20:38.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.090+0000 7f2792400640 1 Processor -- start 2024-04-20T21:20:38.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.090+0000 7f2792400640 1 -- start start 2024-04-20T21:20:38.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.091+0000 7f2792400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f278c071b50 0x7f278c15dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.091+0000 7f2792400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f278c0af800 0x7f278c1eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.091+0000 7f2792400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c15abb0 0x7f278c1f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.091+0000 7f2792400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f278c15bbf0 con 0x7f278c071b50 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.091+0000 7f2792400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f278c15b910 con 0x7f278c0af800 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.091+0000 7f2792400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f278c15af90 con 0x7f278c15abb0 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.091+0000 7f278b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f278c071b50 0x7f278c15dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.091+0000 7f278b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f278c071b50 0x7f278c15dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57662/0 (socket says 172.21.15.71:57662) 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.091+0000 7f278b400640 1 -- 172.21.15.71:0/4245998517 learned_addr learned my addr 172.21.15.71:0/4245998517 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f2782a00640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f278c0af800 0x7f278c1eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f278be00640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c15abb0 0x7f278c1f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f278b400640 1 -- 172.21.15.71:0/4245998517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c15abb0 msgr2=0x7f278c1f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f278b400640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c15abb0 0x7f278c1f4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f278b400640 1 -- 172.21.15.71:0/4245998517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f278c0af800 msgr2=0x7f278c1eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f278b400640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f278c0af800 0x7f278c1eeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f278b400640 1 -- 172.21.15.71:0/4245998517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c1f5700 con 0x7f278c071b50 2024-04-20T21:20:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f278b400640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f278c071b50 0x7f278c15dbe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f277c00dd20 tx=0x7f277c0094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f2783e00640 1 -- 172.21.15.71:0/4245998517 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c01c070 con 0x7f278c071b50 2024-04-20T21:20:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f2783e00640 1 -- 172.21.15.71:0/4245998517 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c00de10 con 0x7f278c071b50 2024-04-20T21:20:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f2783e00640 1 -- 172.21.15.71:0/4245998517 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c017610 con 0x7f278c071b50 2024-04-20T21:20:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.092+0000 7f2792400640 1 -- 172.21.15.71:0/4245998517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278c1f59e0 con 0x7f278c071b50 2024-04-20T21:20:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.093+0000 7f2792400640 1 -- 172.21.15.71:0/4245998517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278c15d6c0 con 0x7f278c071b50 2024-04-20T21:20:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.094+0000 7f2792400640 1 -- 172.21.15.71:0/4245998517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278c068980 con 0x7f278c071b50 2024-04-20T21:20:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.095+0000 7f2783e00640 1 -- 172.21.15.71:0/4245998517 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f277c01f070 con 0x7f278c071b50 2024-04-20T21:20:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.096+0000 7f2783e00640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f276806c8f0 0x7f276806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.096+0000 7f2783e00640 1 -- 172.21.15.71:0/4245998517 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f277c08bb90 con 0x7f278c071b50 2024-04-20T21:20:38.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.096+0000 7f2782a00640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f276806c8f0 0x7f276806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.097+0000 7f2782a00640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f276806c8f0 0x7f276806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2774036000 tx=0x7f2774008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:38.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.101+0000 7f2783e00640 1 -- 172.21.15.71:0/4245998517 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f277c0595e0 con 0x7f278c071b50 2024-04-20T21:20:38.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.299+0000 7f2792400640 1 -- 172.21.15.71:0/4245998517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f278c0cfe90 con 0x7f278c071b50 2024-04-20T21:20:38.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.300+0000 7f2783e00640 1 -- 172.21.15.71:0/4245998517 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f277c05d8e0 con 0x7f278c071b50 2024-04-20T21:20:38.300 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:38.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 -- 172.21.15.71:0/4245998517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f276806c8f0 msgr2=0x7f276806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f276806c8f0 0x7f276806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2774036000 tx=0x7f2774008030 comp rx=0 tx=0).stop 2024-04-20T21:20:38.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 -- 172.21.15.71:0/4245998517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f278c071b50 msgr2=0x7f278c15dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f278c071b50 0x7f278c15dbe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f277c00dd20 tx=0x7f277c0094f0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 -- 172.21.15.71:0/4245998517 shutdown_connections 2024-04-20T21:20:38.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f276806c8f0 0x7f276806edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f278c15abb0 0x7f278c1f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f278c0af800 0x7f278c1eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 --2- 172.21.15.71:0/4245998517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f278c071b50 0x7f278c15dbe0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 -- 172.21.15.71:0/4245998517 >> 172.21.15.71:0/4245998517 conn(0x7f278c0b3350 msgr2=0x7f278c155970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:38.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 -- 172.21.15.71:0/4245998517 shutdown_connections 2024-04-20T21:20:38.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.303+0000 7f2792400640 1 -- 172.21.15.71:0/4245998517 wait complete. 2024-04-20T21:20:38.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:38.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.522+0000 7fdf78800640 1 Processor -- start 2024-04-20T21:20:38.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.522+0000 7fdf78800640 1 -- start start 2024-04-20T21:20:38.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.524+0000 7fdf78800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf7006dcb0 0x7fdf70071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.524+0000 7fdf78800640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf700ade40 con 0x7fdf7015b3b0 2024-04-20T21:20:38.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.524+0000 7fdf78800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf700ae0e0 con 0x7fdf70072090 2024-04-20T21:20:38.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.524+0000 7fdf78800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fdf7006f1b0 con 0x7fdf7006dcb0 2024-04-20T21:20:38.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.524+0000 7fdf75400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf7006dcb0 0x7fdf70071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.524+0000 7fdf75e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdf7015b3b0 0x7fdf7006eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43256/0 (socket says 172.21.15.71:43256) 2024-04-20T21:20:38.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.524+0000 7fdf75e00640 1 -- 172.21.15.71:0/1875444132 learned_addr learned my addr 172.21.15.71:0/1875444132 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.525+0000 7fdf75400640 1 -- 172.21.15.71:0/1875444132 >> v1:172.21.15.137:6789/0 conn(0x7fdf70072090 legacy=0x7fdf700d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.525+0000 7fdf75400640 1 -- 172.21.15.71:0/1875444132 >> v1:172.21.15.71:6789/0 conn(0x7fdf7015b3b0 legacy=0x7fdf7006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.525+0000 7fdf74a00640 1 -- 172.21.15.71:0/1875444132 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 175460351 0 0) 0x7fdf700ade40 con 0x7fdf7015b3b0 2024-04-20T21:20:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.525+0000 7fdf75400640 1 -- 172.21.15.71:0/1875444132 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7015b790 con 0x7fdf7006dcb0 2024-04-20T21:20:38.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.526+0000 7fdf75400640 1 --2- 172.21.15.71:0/1875444132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7006dcb0 0x7fdf70071b50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdf700ad8d0 tx=0x7fdf6002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07317e306816683 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:38.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.526+0000 7fdf74a00640 1 -- 172.21.15.71:0/1875444132 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60035020 con 0x7fdf7006dcb0 2024-04-20T21:20:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.526+0000 7fdf74a00640 1 -- 172.21.15.71:0/1875444132 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf60031800 con 0x7fdf7006dcb0 2024-04-20T21:20:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.526+0000 7fdf74a00640 1 -- 172.21.15.71:0/1875444132 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60031bd0 con 0x7fdf7006dcb0 2024-04-20T21:20:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.527+0000 7fdf78800640 1 -- 172.21.15.71:0/1875444132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7006dcb0 msgr2=0x7fdf70071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.527+0000 7fdf78800640 1 --2- 172.21.15.71:0/1875444132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7006dcb0 0x7fdf70071b50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdf700ad8d0 tx=0x7fdf6002b8a0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.527+0000 7fdf78800640 1 -- 172.21.15.71:0/1875444132 shutdown_connections 2024-04-20T21:20:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.527+0000 7fdf78800640 1 --2- 172.21.15.71:0/1875444132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7006dcb0 0x7fdf70071b50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.527+0000 7fdf78800640 1 -- 172.21.15.71:0/1875444132 >> 172.21.15.71:0/1875444132 conn(0x7fdf700b3350 msgr2=0x7fdf700b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.527+0000 7fdf78800640 1 -- 172.21.15.71:0/1875444132 shutdown_connections 2024-04-20T21:20:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.527+0000 7fdf78800640 1 -- 172.21.15.71:0/1875444132 wait complete. 2024-04-20T21:20:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.528+0000 7fdf78800640 1 Processor -- start 2024-04-20T21:20:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.529+0000 7fdf78800640 1 -- start start 2024-04-20T21:20:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.529+0000 7fdf78800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7006dcb0 0x7fdf701520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.529+0000 7fdf78800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf7015b3b0 0x7fdf70153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.529+0000 7fdf78800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf70150ce0 0x7fdf70151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.529+0000 7fdf78800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf700aec20 con 0x7fdf70150ce0 2024-04-20T21:20:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.529+0000 7fdf78800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdf700ae940 con 0x7fdf7006dcb0 2024-04-20T21:20:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.529+0000 7fdf78800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdf700d0a70 con 0x7fdf7015b3b0 2024-04-20T21:20:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.530+0000 7fdf76800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf70150ce0 0x7fdf70151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.530+0000 7fdf76800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf70150ce0 0x7fdf70151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57672/0 (socket says 172.21.15.71:57672) 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.530+0000 7fdf76800640 1 -- 172.21.15.71:0/3952696673 learned_addr learned my addr 172.21.15.71:0/3952696673 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.530+0000 7fdf75400640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf7015b3b0 0x7fdf70153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.530+0000 7fdf75e00640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7006dcb0 0x7fdf701520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.530+0000 7fdf76800640 1 -- 172.21.15.71:0/3952696673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf7015b3b0 msgr2=0x7fdf70153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.530+0000 7fdf76800640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf7015b3b0 0x7fdf70153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.530+0000 7fdf76800640 1 -- 172.21.15.71:0/3952696673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7006dcb0 msgr2=0x7fdf701520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.530+0000 7fdf76800640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7006dcb0 0x7fdf701520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.530+0000 7fdf76800640 1 -- 172.21.15.71:0/3952696673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf70152610 con 0x7fdf70150ce0 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.530+0000 7fdf75e00640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7006dcb0 0x7fdf701520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.531+0000 7fdf76800640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf70150ce0 0x7fdf70151190 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00c780 tx=0x7fdf6c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.531+0000 7fdf6a000640 1 -- 172.21.15.71:0/3952696673 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c004b10 con 0x7fdf70150ce0 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.531+0000 7fdf6a000640 1 -- 172.21.15.71:0/3952696673 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf6c004cb0 con 0x7fdf70150ce0 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.531+0000 7fdf6a000640 1 -- 172.21.15.71:0/3952696673 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c004e60 con 0x7fdf70150ce0 2024-04-20T21:20:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.531+0000 7fdf78800640 1 -- 172.21.15.71:0/3952696673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf70153fc0 con 0x7fdf70150ce0 2024-04-20T21:20:38.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.531+0000 7fdf78800640 1 -- 172.21.15.71:0/3952696673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf70154540 con 0x7fdf70150ce0 2024-04-20T21:20:38.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.532+0000 7fdf78800640 1 -- 172.21.15.71:0/3952696673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf70068980 con 0x7fdf70150ce0 2024-04-20T21:20:38.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.533+0000 7fdf6a000640 1 -- 172.21.15.71:0/3952696673 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdf6c00aa90 con 0x7fdf70150ce0 2024-04-20T21:20:38.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.534+0000 7fdf6a000640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdf5406c8f0 0x7fdf5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.534+0000 7fdf6a000640 1 -- 172.21.15.71:0/3952696673 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fdf6c08c1c0 con 0x7fdf70150ce0 2024-04-20T21:20:38.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.534+0000 7fdf75e00640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdf5406c8f0 0x7fdf5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.535+0000 7fdf75e00640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdf5406c8f0 0x7fdf5406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdf64000f60 tx=0x7fdf64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:38.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.538+0000 7fdf6a000640 1 -- 172.21.15.71:0/3952696673 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fdf6c020070 con 0x7fdf70150ce0 2024-04-20T21:20:38.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.736+0000 7fdf78800640 1 -- 172.21.15.71:0/3952696673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdf700d0460 con 0x7fdf70150ce0 2024-04-20T21:20:38.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.737+0000 7fdf6a000640 1 -- 172.21.15.71:0/3952696673 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fdf6c05a130 con 0x7fdf70150ce0 2024-04-20T21:20:38.736 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:38.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.739+0000 7fdf78800640 1 -- 172.21.15.71:0/3952696673 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdf5406c8f0 msgr2=0x7fdf5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.739+0000 7fdf78800640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdf5406c8f0 0x7fdf5406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdf64000f60 tx=0x7fdf64009040 comp rx=0 tx=0).stop 2024-04-20T21:20:38.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.739+0000 7fdf78800640 1 -- 172.21.15.71:0/3952696673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf70150ce0 msgr2=0x7fdf70151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.739+0000 7fdf78800640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf70150ce0 0x7fdf70151190 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00c780 tx=0x7fdf6c00cc40 comp rx=0 tx=0).stop 2024-04-20T21:20:38.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.739+0000 7fdf78800640 1 -- 172.21.15.71:0/3952696673 shutdown_connections 2024-04-20T21:20:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.739+0000 7fdf78800640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdf5406c8f0 0x7fdf5406edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.739+0000 7fdf78800640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf70150ce0 0x7fdf70151190 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.739+0000 7fdf78800640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf7015b3b0 0x7fdf70153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.739+0000 7fdf78800640 1 --2- 172.21.15.71:0/3952696673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7006dcb0 0x7fdf701520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.739+0000 7fdf78800640 1 -- 172.21.15.71:0/3952696673 >> 172.21.15.71:0/3952696673 conn(0x7fdf700b3350 msgr2=0x7fdf70072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.739+0000 7fdf78800640 1 -- 172.21.15.71:0/3952696673 shutdown_connections 2024-04-20T21:20:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.740+0000 7fdf78800640 1 -- 172.21.15.71:0/3952696673 wait complete. 2024-04-20T21:20:38.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T21:20:38.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.963+0000 7f6574a00640 1 Processor -- start 2024-04-20T21:20:38.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.963+0000 7f6574a00640 1 -- start start 2024-04-20T21:20:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.965+0000 7f6574a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6570159e10 0x7f6570071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.965+0000 7f6574a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f657015a1f0 0x7f6570071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.965+0000 7f6574a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657015cc90 con 0x7f657006da90 2024-04-20T21:20:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.965+0000 7f6574a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6570072900 con 0x7f657015a1f0 2024-04-20T21:20:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.965+0000 7f6574a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f657015ca40 con 0x7f6570159e10 2024-04-20T21:20:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.965+0000 7f6567e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f657015a1f0 0x7f6570071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.965+0000 7f6567e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f657015a1f0 0x7f6570071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57686/0 (socket says 172.21.15.71:57686) 2024-04-20T21:20:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.965+0000 7f6567e00640 1 -- 172.21.15.71:0/3409062406 learned_addr learned my addr 172.21.15.71:0/3409062406 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.966+0000 7f656f400640 1 --2- 172.21.15.71:0/3409062406 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6570159e10 0x7f6570071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.966+0000 7f6567e00640 1 -- 172.21.15.71:0/3409062406 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6570159e10 msgr2=0x7f6570071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:38.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.966+0000 7f6567e00640 1 --2- 172.21.15.71:0/3409062406 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6570159e10 0x7f6570071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.966+0000 7f6567e00640 1 -- 172.21.15.71:0/3409062406 >> v1:172.21.15.137:6789/0 conn(0x7f657006da90 legacy=0x7f6570160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:38.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.966+0000 7f6567e00640 1 -- 172.21.15.71:0/3409062406 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657015cf70 con 0x7f657015a1f0 2024-04-20T21:20:38.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.967+0000 7f6567e00640 1 --2- 172.21.15.71:0/3409062406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f657015a1f0 0x7f6570071fc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f657015cbc0 tx=0x7f655802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4869a864ffee8de server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:38.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.967+0000 7f656ea00640 1 -- 172.21.15.71:0/3409062406 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558035020 con 0x7f657015a1f0 2024-04-20T21:20:38.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.967+0000 7f656ea00640 1 -- 172.21.15.71:0/3409062406 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6558031640 con 0x7f657015a1f0 2024-04-20T21:20:38.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.967+0000 7f656ea00640 1 -- 172.21.15.71:0/3409062406 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655802d040 con 0x7f657015a1f0 2024-04-20T21:20:38.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.968+0000 7f6574a00640 1 -- 172.21.15.71:0/3409062406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f657015a1f0 msgr2=0x7f6570071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.968+0000 7f6574a00640 1 --2- 172.21.15.71:0/3409062406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f657015a1f0 0x7f6570071fc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f657015cbc0 tx=0x7f655802b8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.968+0000 7f6574a00640 1 -- 172.21.15.71:0/3409062406 shutdown_connections 2024-04-20T21:20:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.968+0000 7f6574a00640 1 --2- 172.21.15.71:0/3409062406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f657015a1f0 0x7f6570071fc0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.968+0000 7f6574a00640 1 --2- 172.21.15.71:0/3409062406 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6570159e10 0x7f6570071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.968+0000 7f6574a00640 1 -- 172.21.15.71:0/3409062406 >> 172.21.15.71:0/3409062406 conn(0x7f65700d0040 msgr2=0x7f65700d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.968+0000 7f6574a00640 1 -- 172.21.15.71:0/3409062406 shutdown_connections 2024-04-20T21:20:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.968+0000 7f6574a00640 1 -- 172.21.15.71:0/3409062406 wait complete. 2024-04-20T21:20:38.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.970+0000 7f6574a00640 1 Processor -- start 2024-04-20T21:20:38.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.970+0000 7f6574a00640 1 -- start start 2024-04-20T21:20:38.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.971+0000 7f6574a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f657006da90 0x7f6570151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.971+0000 7f6574a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6570159e10 0x7f65701541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.971+0000 7f6574a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657015a1f0 0x7f657015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.971+0000 7f6574a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f657015d810 con 0x7f657006da90 2024-04-20T21:20:38.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.971+0000 7f6574a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f657015d530 con 0x7f657015a1f0 2024-04-20T21:20:38.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.971+0000 7f6574a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f657006b900 con 0x7f6570159e10 2024-04-20T21:20:38.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.971+0000 7f656f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f657006da90 0x7f6570151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.971+0000 7f656f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f657006da90 0x7f6570151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57690/0 (socket says 172.21.15.71:57690) 2024-04-20T21:20:38.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.971+0000 7f656f400640 1 -- 172.21.15.71:0/1291370640 learned_addr learned my addr 172.21.15.71:0/1291370640 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:38.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f656f400640 1 -- 172.21.15.71:0/1291370640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6570159e10 msgr2=0x7f65701541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f656f400640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6570159e10 0x7f65701541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f656f400640 1 -- 172.21.15.71:0/1291370640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657015a1f0 msgr2=0x7f657015ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:38.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f656fe00640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657015a1f0 0x7f657015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f656f400640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657015a1f0 0x7f657015ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:38.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f656f400640 1 -- 172.21.15.71:0/1291370640 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6570158d00 con 0x7f657006da90 2024-04-20T21:20:38.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f656fe00640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657015a1f0 0x7f657015ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:38.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f656f400640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f657006da90 0x7f6570151d90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f656000d800 tx=0x7f656000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:38.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f6567400640 1 -- 172.21.15.71:0/1291370640 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656000b6c0 con 0x7f657006da90 2024-04-20T21:20:38.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f6567400640 1 -- 172.21.15.71:0/1291370640 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6560019070 con 0x7f657006da90 2024-04-20T21:20:38.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f6567400640 1 -- 172.21.15.71:0/1291370640 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656000ba80 con 0x7f657006da90 2024-04-20T21:20:38.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.972+0000 7f6574a00640 1 -- 172.21.15.71:0/1291370640 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6570158fa0 con 0x7f657006da90 2024-04-20T21:20:38.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.973+0000 7f6574a00640 1 -- 172.21.15.71:0/1291370640 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6570159560 con 0x7f657006da90 2024-04-20T21:20:38.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.974+0000 7f6574a00640 1 -- 172.21.15.71:0/1291370640 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6570075b60 con 0x7f657006da90 2024-04-20T21:20:38.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.975+0000 7f6567400640 1 -- 172.21.15.71:0/1291370640 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f656000bc20 con 0x7f657006da90 2024-04-20T21:20:38.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.976+0000 7f6567400640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f654c06c8f0 0x7f654c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:38.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.976+0000 7f6567400640 1 -- 172.21.15.71:0/1291370640 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f656008c4c0 con 0x7f657006da90 2024-04-20T21:20:38.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.976+0000 7f6567e00640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f654c06c8f0 0x7f654c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:38.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.977+0000 7f6567e00640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f654c06c8f0 0x7f654c06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6558036000 tx=0x7f6558030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:38.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:38.980+0000 7f6567400640 1 -- 172.21.15.71:0/1291370640 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6560011340 con 0x7f657006da90 2024-04-20T21:20:39.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.194+0000 7f6574a00640 1 -- 172.21.15.71:0/1291370640 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f65700679a0 con 0x7f657006da90 2024-04-20T21:20:39.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.195+0000 7f6567400640 1 -- 172.21.15.71:0/1291370640 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f656005a430 con 0x7f657006da90 2024-04-20T21:20:39.195 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2024-04-20T21:20:39.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 -- 172.21.15.71:0/1291370640 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f654c06c8f0 msgr2=0x7f654c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:39.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f654c06c8f0 0x7f654c06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6558036000 tx=0x7f6558030000 comp rx=0 tx=0).stop 2024-04-20T21:20:39.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 -- 172.21.15.71:0/1291370640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f657006da90 msgr2=0x7f6570151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:39.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f657006da90 0x7f6570151d90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f656000d800 tx=0x7f656000dcc0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 -- 172.21.15.71:0/1291370640 shutdown_connections 2024-04-20T21:20:39.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f654c06c8f0 0x7f654c06edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657015a1f0 0x7f657015ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6570159e10 0x7f65701541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 --2- 172.21.15.71:0/1291370640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f657006da90 0x7f6570151d90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 -- 172.21.15.71:0/1291370640 >> 172.21.15.71:0/1291370640 conn(0x7f65700d0040 msgr2=0x7f657006c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:39.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 -- 172.21.15.71:0/1291370640 shutdown_connections 2024-04-20T21:20:39.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.198+0000 7f6574a00640 1 -- 172.21.15.71:0/1291370640 wait complete. 2024-04-20T21:20:39.216 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2024-04-20T21:20:39.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:39.216 DEBUG:teuthology.orchestra.run.smithi071:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-20T21:20:39.294 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T21:20:39.295 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2024-04-20T21:20:39.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:39.295 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-20T21:20:39.346 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:20:39.347 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:39.404 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:20:39.404 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:39.452 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:39.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.660+0000 7fab6be00640 1 Processor -- start 2024-04-20T21:20:39.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.660+0000 7fab6be00640 1 -- start start 2024-04-20T21:20:39.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.662+0000 7fab6be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fab6c15a1f0 0x7fab6c072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:39.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.662+0000 7fab6be00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6c15cc90 con 0x7fab6c072190 2024-04-20T21:20:39.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.662+0000 7fab6be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6c15cf70 con 0x7fab6c159e10 2024-04-20T21:20:39.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.662+0000 7fab6be00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fab6c072900 con 0x7fab6c15a1f0 2024-04-20T21:20:39.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.663+0000 7fab6b400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fab6c072190 0x7fab6c073420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43268/0 (socket says 172.21.15.71:43268) 2024-04-20T21:20:39.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.663+0000 7fab6b400640 1 -- 172.21.15.71:0/2337994895 learned_addr learned my addr 172.21.15.71:0/2337994895 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.663+0000 7fab62000640 1 --2- 172.21.15.71:0/2337994895 >> v2:172.21.15.137:3300/0 conn(0x7fab6c15a1f0 0x7fab6c072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.663+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374599517 0 0) 0x7fab6c15cc90 con 0x7fab6c072190 2024-04-20T21:20:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.663+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab50003520 con 0x7fab6c072190 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.663+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3901761283 0 0) 0x7fab50003520 con 0x7fab6c072190 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.663+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 >> v2:172.21.15.137:3300/0 conn(0x7fab6c15a1f0 msgr2=0x7fab6c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.663+0000 7fab6a000640 1 --2- 172.21.15.71:0/2337994895 >> v2:172.21.15.137:3300/0 conn(0x7fab6c15a1f0 0x7fab6c072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.663+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 >> v1:172.21.15.137:6789/0 conn(0x7fab6c159e10 legacy=0x7fab6c071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c15d250 con 0x7fab6c072190 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fab640019f0 con 0x7fab6c072190 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 >> v1:172.21.15.71:6789/0 conn(0x7fab6c072190 legacy=0x7fab6c073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6a000640 1 --2- 172.21.15.71:0/2337994895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab500039b0 0x7fab50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6a000640 1 --2- 172.21.15.71:0/2337994895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab50004800 0x7fab50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6a000640 1 --2- 172.21.15.71:0/2337994895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab500051c0 0x7fab5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fab5000c030 con 0x7fab500039b0 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fab5000c1e0 con 0x7fab500051c0 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fab5000c3e0 con 0x7fab50004800 2024-04-20T21:20:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6aa00640 1 --2- 172.21.15.71:0/2337994895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab500039b0 0x7fab50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6b400640 1 --2- 172.21.15.71:0/2337994895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab500051c0 0x7fab5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab62000640 1 --2- 172.21.15.71:0/2337994895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab50004800 0x7fab50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6aa00640 1 -- 172.21.15.71:0/2337994895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab50004800 msgr2=0x7fab50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6aa00640 1 --2- 172.21.15.71:0/2337994895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab50004800 0x7fab50004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6aa00640 1 -- 172.21.15.71:0/2337994895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab500051c0 msgr2=0x7fab5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6aa00640 1 --2- 172.21.15.71:0/2337994895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab500051c0 0x7fab5000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.664+0000 7fab6aa00640 1 -- 172.21.15.71:0/2337994895 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab50003520 con 0x7fab500039b0 2024-04-20T21:20:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.665+0000 7fab6b400640 1 -- 172.21.15.71:0/2337994895 reap_dead start 2024-04-20T21:20:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.666+0000 7fab6aa00640 1 --2- 172.21.15.71:0/2337994895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab500039b0 0x7fab50003dd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fab5c001750 tx=0x7fab50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f15a9baf25806c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.666+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c001370 con 0x7fab500039b0 2024-04-20T21:20:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.666+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5c0052d0 con 0x7fab500039b0 2024-04-20T21:20:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.666+0000 7fab6a000640 1 -- 172.21.15.71:0/2337994895 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c003830 con 0x7fab500039b0 2024-04-20T21:20:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.666+0000 7fab6be00640 1 -- 172.21.15.71:0/2337994895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab500039b0 msgr2=0x7fab50003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.666+0000 7fab6be00640 1 --2- 172.21.15.71:0/2337994895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab500039b0 0x7fab50003dd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fab5c001750 tx=0x7fab50005830 comp rx=0 tx=0).stop 2024-04-20T21:20:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.666+0000 7fab6be00640 1 -- 172.21.15.71:0/2337994895 shutdown_connections 2024-04-20T21:20:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.666+0000 7fab6be00640 1 --2- 172.21.15.71:0/2337994895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab500039b0 0x7fab50003dd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.666+0000 7fab6be00640 1 -- 172.21.15.71:0/2337994895 >> 172.21.15.71:0/2337994895 conn(0x7fab6c0d0040 msgr2=0x7fab6c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.667+0000 7fab6be00640 1 -- 172.21.15.71:0/2337994895 shutdown_connections 2024-04-20T21:20:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.667+0000 7fab6be00640 1 -- 172.21.15.71:0/2337994895 wait complete. 2024-04-20T21:20:39.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.668+0000 7fab6be00640 1 Processor -- start 2024-04-20T21:20:39.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.669+0000 7fab6be00640 1 -- start start 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.669+0000 7fab6be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab500039b0 0x7fab6c14eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.669+0000 7fab6be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c09b090 0x7fab6c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab6be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab6c15a9c0 0x7fab6c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab6be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c15d810 con 0x7fab6c09b090 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab6be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c15ca40 con 0x7fab6c15a9c0 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab6be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fab6c06da90 con 0x7fab500039b0 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab62000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c09b090 0x7fab6c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab62000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c09b090 0x7fab6c15ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57712/0 (socket says 172.21.15.71:57712) 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab62000640 1 -- 172.21.15.71:0/2991844053 learned_addr learned my addr 172.21.15.71:0/2991844053 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab6aa00640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab500039b0 0x7fab6c14eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab6b400640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab6c15a9c0 0x7fab6c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab62000640 1 -- 172.21.15.71:0/2991844053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab500039b0 msgr2=0x7fab6c14eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab62000640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab500039b0 0x7fab6c14eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab62000640 1 -- 172.21.15.71:0/2991844053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab6c15a9c0 msgr2=0x7fab6c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab62000640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab6c15a9c0 0x7fab6c0c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.670+0000 7fab62000640 1 -- 172.21.15.71:0/2991844053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c14f080 con 0x7fab6c09b090 2024-04-20T21:20:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.671+0000 7fab62000640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c09b090 0x7fab6c15ba60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fab540108d0 tx=0x7fab54010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.671+0000 7fab63400640 1 -- 172.21.15.71:0/2991844053 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5400f040 con 0x7fab6c09b090 2024-04-20T21:20:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.671+0000 7fab63400640 1 -- 172.21.15.71:0/2991844053 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5400eb00 con 0x7fab6c09b090 2024-04-20T21:20:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.671+0000 7fab63400640 1 -- 172.21.15.71:0/2991844053 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5401c400 con 0x7fab6c09b090 2024-04-20T21:20:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.671+0000 7fab6be00640 1 -- 172.21.15.71:0/2991844053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6c15c300 con 0x7fab6c09b090 2024-04-20T21:20:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.671+0000 7fab6be00640 1 -- 172.21.15.71:0/2991844053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6c0b3110 con 0x7fab6c09b090 2024-04-20T21:20:39.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.672+0000 7fab6be00640 1 -- 172.21.15.71:0/2991844053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6c075b60 con 0x7fab6c09b090 2024-04-20T21:20:39.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.673+0000 7fab63400640 1 -- 172.21.15.71:0/2991844053 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab5401c5a0 con 0x7fab6c09b090 2024-04-20T21:20:39.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.674+0000 7fab63400640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fab4806c920 0x7fab4806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:39.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.674+0000 7fab63400640 1 -- 172.21.15.71:0/2991844053 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fab5408c4f0 con 0x7fab6c09b090 2024-04-20T21:20:39.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.674+0000 7fab6aa00640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fab4806c920 0x7fab4806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:39.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.675+0000 7fab6aa00640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fab4806c920 0x7fab4806ede0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fab5c033000 tx=0x7fab5c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.679+0000 7fab63400640 1 -- 172.21.15.71:0/2991844053 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fab6c14f080 con 0x7fab6c09b090 2024-04-20T21:20:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.880+0000 7fab6be00640 1 -- 172.21.15.71:0/2991844053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab6c159480 con 0x7fab6c09b090 2024-04-20T21:20:39.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.883+0000 7fab63400640 1 -- 172.21.15.71:0/2991844053 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7fab54018030 con 0x7fab6c09b090 2024-04-20T21:20:39.883 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:39.883 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.885+0000 7fab6be00640 1 -- 172.21.15.71:0/2991844053 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fab4806c920 msgr2=0x7fab4806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.885+0000 7fab6be00640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fab4806c920 0x7fab4806ede0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fab5c033000 tx=0x7fab5c009030 comp rx=0 tx=0).stop 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.885+0000 7fab6be00640 1 -- 172.21.15.71:0/2991844053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c09b090 msgr2=0x7fab6c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.886+0000 7fab6be00640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c09b090 0x7fab6c15ba60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fab540108d0 tx=0x7fab54010d90 comp rx=0 tx=0).stop 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.886+0000 7fab6be00640 1 -- 172.21.15.71:0/2991844053 shutdown_connections 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.886+0000 7fab6be00640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fab4806c920 0x7fab4806ede0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.886+0000 7fab6be00640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab6c15a9c0 0x7fab6c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.886+0000 7fab6be00640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c09b090 0x7fab6c15ba60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.886+0000 7fab6be00640 1 --2- 172.21.15.71:0/2991844053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab500039b0 0x7fab6c14eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.886+0000 7fab6be00640 1 -- 172.21.15.71:0/2991844053 >> 172.21.15.71:0/2991844053 conn(0x7fab6c0d0040 msgr2=0x7fab6c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.886+0000 7fab6be00640 1 -- 172.21.15.71:0/2991844053 shutdown_connections 2024-04-20T21:20:39.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:39.886+0000 7fab6be00640 1 -- 172.21.15.71:0/2991844053 wait complete. 2024-04-20T21:20:39.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:39.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.112+0000 7fc32b000640 1 Processor -- start 2024-04-20T21:20:40.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.113+0000 7fc32b000640 1 -- start start 2024-04-20T21:20:40.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.114+0000 7fc32b000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc32415e9c0 0x7fc3240d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.114+0000 7fc32b000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3240d4930 0x7fc3240d4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.114+0000 7fc32b000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3240d23b0 con 0x7fc3240b11c0 2024-04-20T21:20:40.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.114+0000 7fc32b000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc3240d0f20 con 0x7fc32415e9c0 2024-04-20T21:20:40.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.114+0000 7fc32b000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc3240d2ce0 con 0x7fc3240d4930 2024-04-20T21:20:40.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.115+0000 7fc323e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc32415e9c0 0x7fc3240d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:40.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.115+0000 7fc323e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc32415e9c0 0x7fc3240d1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57724/0 (socket says 172.21.15.71:57724) 2024-04-20T21:20:40.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.115+0000 7fc31b400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc3240b11c0 0x7fc3240d0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43270/0 (socket says 172.21.15.71:43270) 2024-04-20T21:20:40.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.115+0000 7fc323e00640 1 -- 172.21.15.71:0/3065247494 learned_addr learned my addr 172.21.15.71:0/3065247494 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:40.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.115+0000 7fc329000640 1 --2- 172.21.15.71:0/3065247494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3240d4930 0x7fc3240d4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:40.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.115+0000 7fc323e00640 1 -- 172.21.15.71:0/3065247494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3240d4930 msgr2=0x7fc3240d4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:40.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.115+0000 7fc323e00640 1 --2- 172.21.15.71:0/3065247494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3240d4930 0x7fc3240d4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.115+0000 7fc323e00640 1 -- 172.21.15.71:0/3065247494 >> v1:172.21.15.71:6789/0 conn(0x7fc3240b11c0 legacy=0x7fc3240d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.115+0000 7fc323e00640 1 -- 172.21.15.71:0/3065247494 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3240d2690 con 0x7fc32415e9c0 2024-04-20T21:20:40.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.115+0000 7fc323400640 1 -- 172.21.15.71:0/3065247494 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 305074281 0 0) 0x7fc3240d23b0 con 0x7fc3240b11c0 2024-04-20T21:20:40.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.116+0000 7fc323e00640 1 --2- 172.21.15.71:0/3065247494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc32415e9c0 0x7fc3240d1ba0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc314009870 tx=0x7fc31402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a1a1feb8a0c313 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:40.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.117+0000 7fc323400640 1 -- 172.21.15.71:0/3065247494 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314035020 con 0x7fc32415e9c0 2024-04-20T21:20:40.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.117+0000 7fc323400640 1 -- 172.21.15.71:0/3065247494 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc314031640 con 0x7fc32415e9c0 2024-04-20T21:20:40.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.117+0000 7fc323400640 1 -- 172.21.15.71:0/3065247494 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31402d040 con 0x7fc32415e9c0 2024-04-20T21:20:40.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.117+0000 7fc32b000640 1 -- 172.21.15.71:0/3065247494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc32415e9c0 msgr2=0x7fc3240d1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.117+0000 7fc32b000640 1 --2- 172.21.15.71:0/3065247494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc32415e9c0 0x7fc3240d1ba0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc314009870 tx=0x7fc31402b8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.117+0000 7fc32b000640 1 -- 172.21.15.71:0/3065247494 shutdown_connections 2024-04-20T21:20:40.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.117+0000 7fc32b000640 1 --2- 172.21.15.71:0/3065247494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3240d4930 0x7fc3240d4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.117+0000 7fc32b000640 1 --2- 172.21.15.71:0/3065247494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc32415e9c0 0x7fc3240d1ba0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.117+0000 7fc32b000640 1 -- 172.21.15.71:0/3065247494 >> 172.21.15.71:0/3065247494 conn(0x7fc3240b9600 msgr2=0x7fc3240b9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:40.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.117+0000 7fc32b000640 1 -- 172.21.15.71:0/3065247494 shutdown_connections 2024-04-20T21:20:40.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.117+0000 7fc32b000640 1 -- 172.21.15.71:0/3065247494 wait complete. 2024-04-20T21:20:40.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.119+0000 7fc32b000640 1 Processor -- start 2024-04-20T21:20:40.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.119+0000 7fc32b000640 1 -- start start 2024-04-20T21:20:40.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.120+0000 7fc32b000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3240b11c0 0x7fc32415c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.120+0000 7fc32b000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3240d4930 0x7fc3240c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.120+0000 7fc32b000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc32415e9c0 0x7fc3240cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.120+0000 7fc32b000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3240d32f0 con 0x7fc3240d4930 2024-04-20T21:20:40.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.120+0000 7fc32b000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3240d3170 con 0x7fc32415e9c0 2024-04-20T21:20:40.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.120+0000 7fc32b000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc3240d3470 con 0x7fc3240b11c0 2024-04-20T21:20:40.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.121+0000 7fc31b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3240d4930 0x7fc3240c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:40.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.121+0000 7fc31b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3240d4930 0x7fc3240c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57732/0 (socket says 172.21.15.71:57732) 2024-04-20T21:20:40.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.121+0000 7fc31b400640 1 -- 172.21.15.71:0/2082517759 learned_addr learned my addr 172.21.15.71:0/2082517759 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:40.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.121+0000 7fc31b400640 1 -- 172.21.15.71:0/2082517759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3240b11c0 msgr2=0x7fc32415c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.121+0000 7fc31b400640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3240b11c0 0x7fc32415c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.121+0000 7fc31b400640 1 -- 172.21.15.71:0/2082517759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc32415e9c0 msgr2=0x7fc3240cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.121+0000 7fc31b400640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc32415e9c0 0x7fc3240cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.121+0000 7fc31b400640 1 -- 172.21.15.71:0/2082517759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32415cc50 con 0x7fc3240d4930 2024-04-20T21:20:40.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.121+0000 7fc31b400640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3240d4930 0x7fc3240c9ef0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c4b0 tx=0x7fc30c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:40.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.122+0000 7fc320c00640 1 -- 172.21.15.71:0/2082517759 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c018070 con 0x7fc3240d4930 2024-04-20T21:20:40.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.122+0000 7fc320c00640 1 -- 172.21.15.71:0/2082517759 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30c007500 con 0x7fc3240d4930 2024-04-20T21:20:40.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.122+0000 7fc320c00640 1 -- 172.21.15.71:0/2082517759 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c004a20 con 0x7fc3240d4930 2024-04-20T21:20:40.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.122+0000 7fc32b000640 1 -- 172.21.15.71:0/2082517759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32415ef20 con 0x7fc3240d4930 2024-04-20T21:20:40.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.122+0000 7fc32b000640 1 -- 172.21.15.71:0/2082517759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc32415f4e0 con 0x7fc3240d4930 2024-04-20T21:20:40.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.123+0000 7fc32b000640 1 -- 172.21.15.71:0/2082517759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc324068980 con 0x7fc3240d4930 2024-04-20T21:20:40.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.124+0000 7fc320c00640 1 -- 172.21.15.71:0/2082517759 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc30c01b070 con 0x7fc3240d4930 2024-04-20T21:20:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.125+0000 7fc320c00640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc30006c8f0 0x7fc30006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.125+0000 7fc320c00640 1 -- 172.21.15.71:0/2082517759 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fc30c08b200 con 0x7fc3240d4930 2024-04-20T21:20:40.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.125+0000 7fc323e00640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc30006c8f0 0x7fc30006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:40.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.126+0000 7fc323e00640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc30006c8f0 0x7fc30006edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc314036000 tx=0x7fc314030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:40.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.129+0000 7fc320c00640 1 -- 172.21.15.71:0/2082517759 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc30c059360 con 0x7fc3240d4930 2024-04-20T21:20:40.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.329+0000 7fc32b000640 1 -- 172.21.15.71:0/2082517759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc32406efb0 con 0x7fc3240d4930 2024-04-20T21:20:40.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.330+0000 7fc320c00640 1 -- 172.21.15.71:0/2082517759 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fc30c058c60 con 0x7fc3240d4930 2024-04-20T21:20:40.329 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:40.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 -- 172.21.15.71:0/2082517759 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc30006c8f0 msgr2=0x7fc30006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc30006c8f0 0x7fc30006edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc314036000 tx=0x7fc314030000 comp rx=0 tx=0).stop 2024-04-20T21:20:40.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 -- 172.21.15.71:0/2082517759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3240d4930 msgr2=0x7fc3240c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3240d4930 0x7fc3240c9ef0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c4b0 tx=0x7fc30c00c970 comp rx=0 tx=0).stop 2024-04-20T21:20:40.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 -- 172.21.15.71:0/2082517759 shutdown_connections 2024-04-20T21:20:40.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc30006c8f0 0x7fc30006edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc32415e9c0 0x7fc3240cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3240d4930 0x7fc3240c9ef0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 --2- 172.21.15.71:0/2082517759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3240b11c0 0x7fc32415c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 -- 172.21.15.71:0/2082517759 >> 172.21.15.71:0/2082517759 conn(0x7fc3240b9600 msgr2=0x7fc32415dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:40.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 -- 172.21.15.71:0/2082517759 shutdown_connections 2024-04-20T21:20:40.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.332+0000 7fc32b000640 1 -- 172.21.15.71:0/2082517759 wait complete. 2024-04-20T21:20:40.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:40.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.554+0000 7f218f200640 1 Processor -- start 2024-04-20T21:20:40.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.555+0000 7f218f200640 1 -- start start 2024-04-20T21:20:40.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.556+0000 7f218f200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2190161a50 0x7f21900b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.556+0000 7f218f200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f21900d3b20 0x7f219006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.556+0000 7f218f200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21900d0980 con 0x7f21900d0480 2024-04-20T21:20:40.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.556+0000 7f218f200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f21900d0c60 con 0x7f2190161a50 2024-04-20T21:20:40.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.556+0000 7f218f200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2190162ae0 con 0x7f21900d3b20 2024-04-20T21:20:40.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.557+0000 7f218de00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2190161a50 0x7f21900b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:40.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.557+0000 7f218de00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2190161a50 0x7f21900b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57746/0 (socket says 172.21.15.71:57746) 2024-04-20T21:20:40.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.557+0000 7f218de00640 1 -- 172.21.15.71:0/303031757 learned_addr learned my addr 172.21.15.71:0/303031757 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:40.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.557+0000 7f218d400640 1 --2- 172.21.15.71:0/303031757 >> v2:172.21.15.137:3300/0 conn(0x7f21900d3b20 0x7f219006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:40.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.557+0000 7f218de00640 1 -- 172.21.15.71:0/303031757 >> v2:172.21.15.137:3300/0 conn(0x7f21900d3b20 msgr2=0x7f219006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:40.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.557+0000 7f218de00640 1 --2- 172.21.15.71:0/303031757 >> v2:172.21.15.137:3300/0 conn(0x7f21900d3b20 0x7f219006b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.557+0000 7f218de00640 1 -- 172.21.15.71:0/303031757 >> v1:172.21.15.137:6789/0 conn(0x7f21900d0480 legacy=0x7f219006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.557+0000 7f218de00640 1 -- 172.21.15.71:0/303031757 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2190162490 con 0x7f2190161a50 2024-04-20T21:20:40.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.559+0000 7f218de00640 1 --2- 172.21.15.71:0/303031757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2190161a50 0x7f21900b3180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f21900b7590 tx=0x7f218802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77a6ea070038969 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:40.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.559+0000 7f218ca00640 1 -- 172.21.15.71:0/303031757 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218802cb20 con 0x7f2190161a50 2024-04-20T21:20:40.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.559+0000 7f218ca00640 1 -- 172.21.15.71:0/303031757 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f218802ccc0 con 0x7f2190161a50 2024-04-20T21:20:40.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.559+0000 7f218ca00640 1 -- 172.21.15.71:0/303031757 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188034610 con 0x7f2190161a50 2024-04-20T21:20:40.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.559+0000 7f218f200640 1 -- 172.21.15.71:0/303031757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2190161a50 msgr2=0x7f21900b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.559+0000 7f218f200640 1 --2- 172.21.15.71:0/303031757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2190161a50 0x7f21900b3180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f21900b7590 tx=0x7f218802bf80 comp rx=0 tx=0).stop 2024-04-20T21:20:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.560+0000 7f218f200640 1 -- 172.21.15.71:0/303031757 shutdown_connections 2024-04-20T21:20:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.560+0000 7f218f200640 1 --2- 172.21.15.71:0/303031757 >> v2:172.21.15.137:3300/0 conn(0x7f21900d3b20 0x7f219006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.560+0000 7f218f200640 1 --2- 172.21.15.71:0/303031757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2190161a50 0x7f21900b3180 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.560+0000 7f218f200640 1 -- 172.21.15.71:0/303031757 >> 172.21.15.71:0/303031757 conn(0x7f21900d0ed0 msgr2=0x7f21900d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.560+0000 7f218f200640 1 -- 172.21.15.71:0/303031757 shutdown_connections 2024-04-20T21:20:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.560+0000 7f218f200640 1 -- 172.21.15.71:0/303031757 wait complete. 2024-04-20T21:20:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.562+0000 7f218f200640 1 Processor -- start 2024-04-20T21:20:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.562+0000 7f218f200640 1 -- start start 2024-04-20T21:20:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.563+0000 7f218f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21900d0480 0x7f2190155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.563+0000 7f218f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2190161a50 0x7f21900b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.563+0000 7f218f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21900b2950 0x7f21900d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.563+0000 7f218f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2190161fb0 con 0x7f2190161a50 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.563+0000 7f218f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2190161e30 con 0x7f21900d0480 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.563+0000 7f218f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2190162130 con 0x7f21900b2950 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.564+0000 7f218d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2190161a50 0x7f21900b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.564+0000 7f218d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2190161a50 0x7f21900b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57750/0 (socket says 172.21.15.71:57750) 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.564+0000 7f218d400640 1 -- 172.21.15.71:0/3972157732 learned_addr learned my addr 172.21.15.71:0/3972157732 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.564+0000 7f218de00640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21900d0480 0x7f2190155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.564+0000 7f218e800640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21900b2950 0x7f21900d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.564+0000 7f218d400640 1 -- 172.21.15.71:0/3972157732 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21900b2950 msgr2=0x7f21900d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.564+0000 7f218d400640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21900b2950 0x7f21900d2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.564+0000 7f218d400640 1 -- 172.21.15.71:0/3972157732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21900d0480 msgr2=0x7f2190155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.564+0000 7f218d400640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21900d0480 0x7f2190155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.564+0000 7f218d400640 1 -- 172.21.15.71:0/3972157732 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2190159e10 con 0x7f2190161a50 2024-04-20T21:20:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.564+0000 7f218d400640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2190161a50 0x7f21900b2410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f217800e980 tx=0x7f217800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.565+0000 7f2186000640 1 -- 172.21.15.71:0/3972157732 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178017070 con 0x7f2190161a50 2024-04-20T21:20:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.565+0000 7f2186000640 1 -- 172.21.15.71:0/3972157732 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f217800ca00 con 0x7f2190161a50 2024-04-20T21:20:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.565+0000 7f2186000640 1 -- 172.21.15.71:0/3972157732 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217800cdd0 con 0x7f2190161a50 2024-04-20T21:20:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.565+0000 7f218f200640 1 -- 172.21.15.71:0/3972157732 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219015a0f0 con 0x7f2190161a50 2024-04-20T21:20:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.565+0000 7f218f200640 1 -- 172.21.15.71:0/3972157732 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219015a6b0 con 0x7f2190161a50 2024-04-20T21:20:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.566+0000 7f218f200640 1 -- 172.21.15.71:0/3972157732 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2190075b30 con 0x7f2190161a50 2024-04-20T21:20:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.567+0000 7f2186000640 1 -- 172.21.15.71:0/3972157732 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f217801a070 con 0x7f2190161a50 2024-04-20T21:20:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.568+0000 7f2186000640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f216c06c8f0 0x7f216c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.569+0000 7f2186000640 1 -- 172.21.15.71:0/3972157732 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f217808c010 con 0x7f2190161a50 2024-04-20T21:20:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.569+0000 7f218de00640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f216c06c8f0 0x7f216c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.569+0000 7f218de00640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f216c06c8f0 0x7f216c06edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2188035000 tx=0x7f2188030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.573+0000 7f2186000640 1 -- 172.21.15.71:0/3972157732 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2178059f80 con 0x7f2190161a50 2024-04-20T21:20:40.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.772+0000 7f218f200640 1 -- 172.21.15.71:0/3972157732 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f21900d2640 con 0x7f2190161a50 2024-04-20T21:20:40.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.773+0000 7f2186000640 1 -- 172.21.15.71:0/3972157732 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f2178059880 con 0x7f2190161a50 2024-04-20T21:20:40.773 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:40.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 -- 172.21.15.71:0/3972157732 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f216c06c8f0 msgr2=0x7f216c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f216c06c8f0 0x7f216c06edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2188035000 tx=0x7f2188030000 comp rx=0 tx=0).stop 2024-04-20T21:20:40.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 -- 172.21.15.71:0/3972157732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2190161a50 msgr2=0x7f21900b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:40.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2190161a50 0x7f21900b2410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f217800e980 tx=0x7f217800ee40 comp rx=0 tx=0).stop 2024-04-20T21:20:40.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 -- 172.21.15.71:0/3972157732 shutdown_connections 2024-04-20T21:20:40.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f216c06c8f0 0x7f216c06edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21900b2950 0x7f21900d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2190161a50 0x7f21900b2410 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 --2- 172.21.15.71:0/3972157732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21900d0480 0x7f2190155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:40.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 -- 172.21.15.71:0/3972157732 >> 172.21.15.71:0/3972157732 conn(0x7f21900d0ed0 msgr2=0x7f2190160cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:40.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 -- 172.21.15.71:0/3972157732 shutdown_connections 2024-04-20T21:20:40.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.776+0000 7f218f200640 1 -- 172.21.15.71:0/3972157732 wait complete. 2024-04-20T21:20:40.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:40.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.997+0000 7f5a17400640 1 Processor -- start 2024-04-20T21:20:40.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.998+0000 7f5a17400640 1 -- start start 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.999+0000 7f5a17400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5a1015e8a0 0x7f5a1006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.999+0000 7f5a17400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5a1006dbb0 0x7f5a100d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.999+0000 7f5a17400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a100d08a0 0x7f5a1006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.999+0000 7f5a17400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1006f060 con 0x7f5a1015e8a0 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.999+0000 7f5a17400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1006e7c0 con 0x7f5a1006dbb0 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.999+0000 7f5a17400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1006eaa0 con 0x7f5a100d08a0 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:40.999+0000 7f5a14a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5a1015e8a0 0x7f5a1006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.000+0000 7f5a14a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5a1015e8a0 0x7f5a1006e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57762/0 (socket says 172.21.15.71:57762) 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.000+0000 7f5a14a00640 1 -- 172.21.15.71:0/2396218115 learned_addr learned my addr 172.21.15.71:0/2396218115 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.000+0000 7f5a07e00640 1 --2- 172.21.15.71:0/2396218115 >> v2:172.21.15.137:3300/0 conn(0x7f5a1006dbb0 0x7f5a100d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.000+0000 7f5a15400640 1 --2- 172.21.15.71:0/2396218115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a100d08a0 0x7f5a1006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.000+0000 7f5a14a00640 1 -- 172.21.15.71:0/2396218115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a100d08a0 msgr2=0x7f5a1006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:41.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.000+0000 7f5a14a00640 1 --2- 172.21.15.71:0/2396218115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a100d08a0 0x7f5a1006b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.000+0000 7f5a14a00640 1 -- 172.21.15.71:0/2396218115 >> v2:172.21.15.137:3300/0 conn(0x7f5a1006dbb0 msgr2=0x7f5a100d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:41.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.000+0000 7f5a14a00640 1 --2- 172.21.15.71:0/2396218115 >> v2:172.21.15.137:3300/0 conn(0x7f5a1006dbb0 0x7f5a100d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.000+0000 7f5a14a00640 1 -- 172.21.15.71:0/2396218115 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1006ed80 con 0x7f5a1015e8a0 2024-04-20T21:20:41.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.000+0000 7f5a15400640 1 --2- 172.21.15.71:0/2396218115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a100d08a0 0x7f5a1006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:41.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.001+0000 7f5a14a00640 1 --2- 172.21.15.71:0/2396218115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a1015e8a0 0x7f5a1006e1e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5a100d0f10 tx=0x7f59f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71f5ebcbc8f86c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:41.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.001+0000 7f5a0fe00640 1 -- 172.21.15.71:0/2396218115 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8035020 con 0x7f5a1015e8a0 2024-04-20T21:20:41.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.002+0000 7f5a0fe00640 1 -- 172.21.15.71:0/2396218115 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8031870 con 0x7f5a1015e8a0 2024-04-20T21:20:41.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.002+0000 7f5a0fe00640 1 -- 172.21.15.71:0/2396218115 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8031c40 con 0x7f5a1015e8a0 2024-04-20T21:20:41.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.002+0000 7f5a17400640 1 -- 172.21.15.71:0/2396218115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a1015e8a0 msgr2=0x7f5a1006e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.002+0000 7f5a17400640 1 --2- 172.21.15.71:0/2396218115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a1015e8a0 0x7f5a1006e1e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5a100d0f10 tx=0x7f59f802b910 comp rx=0 tx=0).stop 2024-04-20T21:20:41.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.002+0000 7f5a17400640 1 -- 172.21.15.71:0/2396218115 shutdown_connections 2024-04-20T21:20:41.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.002+0000 7f5a17400640 1 --2- 172.21.15.71:0/2396218115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a100d08a0 0x7f5a1006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.002+0000 7f5a17400640 1 --2- 172.21.15.71:0/2396218115 >> v2:172.21.15.137:3300/0 conn(0x7f5a1006dbb0 0x7f5a100d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.002+0000 7f5a17400640 1 --2- 172.21.15.71:0/2396218115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a1015e8a0 0x7f5a1006e1e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.002+0000 7f5a17400640 1 -- 172.21.15.71:0/2396218115 >> 172.21.15.71:0/2396218115 conn(0x7f5a100b3350 msgr2=0x7f5a100b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:41.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.002+0000 7f5a17400640 1 -- 172.21.15.71:0/2396218115 shutdown_connections 2024-04-20T21:20:41.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.002+0000 7f5a17400640 1 -- 172.21.15.71:0/2396218115 wait complete. 2024-04-20T21:20:41.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.004+0000 7f5a17400640 1 Processor -- start 2024-04-20T21:20:41.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.004+0000 7f5a17400640 1 -- start start 2024-04-20T21:20:41.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.005+0000 7f5a17400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a1006dbb0 0x7f5a101e9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.005+0000 7f5a17400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a100d08a0 0x7f5a10142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.005+0000 7f5a17400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a1015e8a0 0x7f5a101f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.005+0000 7f5a17400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1006fef0 con 0x7f5a1015e8a0 2024-04-20T21:20:41.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.005+0000 7f5a17400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1006fd70 con 0x7f5a100d08a0 2024-04-20T21:20:41.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.005+0000 7f5a17400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1006be40 con 0x7f5a1006dbb0 2024-04-20T21:20:41.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.006+0000 7f5a15400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a1015e8a0 0x7f5a101f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.006+0000 7f5a15400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a1015e8a0 0x7f5a101f4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57772/0 (socket says 172.21.15.71:57772) 2024-04-20T21:20:41.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.006+0000 7f5a15400640 1 -- 172.21.15.71:0/1122042258 learned_addr learned my addr 172.21.15.71:0/1122042258 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:41.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.006+0000 7f5a14a00640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a1006dbb0 0x7f5a101e9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.006+0000 7f5a07e00640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a100d08a0 0x7f5a10142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.006+0000 7f5a15400640 1 -- 172.21.15.71:0/1122042258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a1006dbb0 msgr2=0x7f5a101e9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.006+0000 7f5a15400640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a1006dbb0 0x7f5a101e9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.006+0000 7f5a15400640 1 -- 172.21.15.71:0/1122042258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a100d08a0 msgr2=0x7f5a10142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.006+0000 7f5a15400640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a100d08a0 0x7f5a10142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.006+0000 7f5a15400640 1 -- 172.21.15.71:0/1122042258 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a10142d20 con 0x7f5a1015e8a0 2024-04-20T21:20:41.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.007+0000 7f5a15400640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a1015e8a0 0x7f5a101f4080 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800ce40 tx=0x7f5a0800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:41.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.007+0000 7f5a0d600640 1 -- 172.21.15.71:0/1122042258 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0801a070 con 0x7f5a1015e8a0 2024-04-20T21:20:41.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.007+0000 7f5a0d600640 1 -- 172.21.15.71:0/1122042258 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0800d840 con 0x7f5a1015e8a0 2024-04-20T21:20:41.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.007+0000 7f5a17400640 1 -- 172.21.15.71:0/1122042258 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a10143000 con 0x7f5a1015e8a0 2024-04-20T21:20:41.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.007+0000 7f5a0d600640 1 -- 172.21.15.71:0/1122042258 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0800dc30 con 0x7f5a1015e8a0 2024-04-20T21:20:41.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.007+0000 7f5a17400640 1 -- 172.21.15.71:0/1122042258 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a101435c0 con 0x7f5a1015e8a0 2024-04-20T21:20:41.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.008+0000 7f5a17400640 1 -- 172.21.15.71:0/1122042258 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a10068980 con 0x7f5a1015e8a0 2024-04-20T21:20:41.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.009+0000 7f5a0d600640 1 -- 172.21.15.71:0/1122042258 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a0801d070 con 0x7f5a1015e8a0 2024-04-20T21:20:41.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.010+0000 7f5a0d600640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f59ec06c8f0 0x7f59ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.010+0000 7f5a0d600640 1 -- 172.21.15.71:0/1122042258 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f5a0808c820 con 0x7f5a1015e8a0 2024-04-20T21:20:41.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.011+0000 7f5a14a00640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f59ec06c8f0 0x7f59ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.011+0000 7f5a14a00640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f59ec06c8f0 0x7f59ec06edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f59f8036000 tx=0x7f59f803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:41.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.014+0000 7f5a0d600640 1 -- 172.21.15.71:0/1122042258 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5a0805a790 con 0x7f5a1015e8a0 2024-04-20T21:20:41.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.211+0000 7f5a17400640 1 -- 172.21.15.71:0/1122042258 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5a10155b80 con 0x7f5a1015e8a0 2024-04-20T21:20:41.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.212+0000 7f5a0d600640 1 -- 172.21.15.71:0/1122042258 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f5a0805a090 con 0x7f5a1015e8a0 2024-04-20T21:20:41.212 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:41.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.214+0000 7f5a17400640 1 -- 172.21.15.71:0/1122042258 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f59ec06c8f0 msgr2=0x7f59ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.214+0000 7f5a17400640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f59ec06c8f0 0x7f59ec06edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f59f8036000 tx=0x7f59f803c040 comp rx=0 tx=0).stop 2024-04-20T21:20:41.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.214+0000 7f5a17400640 1 -- 172.21.15.71:0/1122042258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a1015e8a0 msgr2=0x7f5a101f4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.214+0000 7f5a17400640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a1015e8a0 0x7f5a101f4080 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800ce40 tx=0x7f5a0800a710 comp rx=0 tx=0).stop 2024-04-20T21:20:41.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.215+0000 7f5a17400640 1 -- 172.21.15.71:0/1122042258 shutdown_connections 2024-04-20T21:20:41.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.215+0000 7f5a17400640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f59ec06c8f0 0x7f59ec06edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.215+0000 7f5a17400640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a1015e8a0 0x7f5a101f4080 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.215+0000 7f5a17400640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a100d08a0 0x7f5a10142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.215+0000 7f5a17400640 1 --2- 172.21.15.71:0/1122042258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a1006dbb0 0x7f5a101e9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.215+0000 7f5a17400640 1 -- 172.21.15.71:0/1122042258 >> 172.21.15.71:0/1122042258 conn(0x7f5a100b3350 msgr2=0x7f5a1009a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:41.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.215+0000 7f5a17400640 1 -- 172.21.15.71:0/1122042258 shutdown_connections 2024-04-20T21:20:41.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.215+0000 7f5a17400640 1 -- 172.21.15.71:0/1122042258 wait complete. 2024-04-20T21:20:41.232 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.423+0000 7f888d200640 1 Processor -- start 2024-04-20T21:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.424+0000 7f888d200640 1 -- start start 2024-04-20T21:20:41.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.425+0000 7f888d200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8888156c20 0x7f888806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.425+0000 7f888d200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f88880d0360 0x7f88880d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.425+0000 7f888d200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8888141c60 con 0x7f888815ca40 2024-04-20T21:20:41.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.425+0000 7f888d200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f88880adab0 con 0x7f88880d0360 2024-04-20T21:20:41.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.425+0000 7f888d200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f888815cf90 con 0x7f8888156c20 2024-04-20T21:20:41.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.425+0000 7f8886800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f88880d0360 0x7f88880d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.425+0000 7f887fe00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f888815ca40 0x7f88880ad3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43282/0 (socket says 172.21.15.71:43282) 2024-04-20T21:20:41.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.425+0000 7f887fe00640 1 -- 172.21.15.71:0/2416878175 learned_addr learned my addr 172.21.15.71:0/2416878175 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:41.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.426+0000 7f8885e00640 1 --2- 172.21.15.71:0/2416878175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8888156c20 0x7f888806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.426+0000 7f8885400640 1 -- 172.21.15.71:0/2416878175 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327930667 0 0) 0x7f8888141c60 con 0x7f888815ca40 2024-04-20T21:20:41.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.426+0000 7f8886800640 1 -- 172.21.15.71:0/2416878175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8888156c20 msgr2=0x7f888806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:41.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.426+0000 7f8886800640 1 --2- 172.21.15.71:0/2416878175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8888156c20 0x7f888806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.426+0000 7f8886800640 1 -- 172.21.15.71:0/2416878175 >> v1:172.21.15.71:6789/0 conn(0x7f888815ca40 legacy=0x7f88880ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.426+0000 7f8886800640 1 -- 172.21.15.71:0/2416878175 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888815d270 con 0x7f88880d0360 2024-04-20T21:20:41.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.427+0000 7f8886800640 1 --2- 172.21.15.71:0/2416878175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88880d0360 0x7f88880d07f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8880009d90 tx=0x7f888002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae41e08015130bc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:41.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.427+0000 7f8885400640 1 -- 172.21.15.71:0/2416878175 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8880039070 con 0x7f88880d0360 2024-04-20T21:20:41.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.427+0000 7f8885400640 1 -- 172.21.15.71:0/2416878175 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888002cc50 con 0x7f88880d0360 2024-04-20T21:20:41.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.427+0000 7f8885400640 1 -- 172.21.15.71:0/2416878175 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8880034440 con 0x7f88880d0360 2024-04-20T21:20:41.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.428+0000 7f888d200640 1 -- 172.21.15.71:0/2416878175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88880d0360 msgr2=0x7f88880d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.428+0000 7f888d200640 1 --2- 172.21.15.71:0/2416878175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88880d0360 0x7f88880d07f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8880009d90 tx=0x7f888002bea0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.428+0000 7f888d200640 1 -- 172.21.15.71:0/2416878175 shutdown_connections 2024-04-20T21:20:41.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.428+0000 7f888d200640 1 --2- 172.21.15.71:0/2416878175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88880d0360 0x7f88880d07f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.428+0000 7f888d200640 1 --2- 172.21.15.71:0/2416878175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8888156c20 0x7f888806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.428+0000 7f888d200640 1 -- 172.21.15.71:0/2416878175 >> 172.21.15.71:0/2416878175 conn(0x7f88880b3350 msgr2=0x7f88880b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:41.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.428+0000 7f888d200640 1 -- 172.21.15.71:0/2416878175 shutdown_connections 2024-04-20T21:20:41.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.428+0000 7f888d200640 1 -- 172.21.15.71:0/2416878175 wait complete. 2024-04-20T21:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.430+0000 7f888d200640 1 Processor -- start 2024-04-20T21:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.430+0000 7f888d200640 1 -- start start 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.431+0000 7f888d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88880d0360 0x7f88880cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.431+0000 7f888d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888156c20 0x7f88881515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.431+0000 7f888d200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f888815ca40 0x7f8888151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.431+0000 7f888d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f888806be40 con 0x7f8888156c20 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.431+0000 7f888d200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f888815d830 con 0x7f88880d0360 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.431+0000 7f888d200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f888806bfc0 con 0x7f888815ca40 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.431+0000 7f887fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888156c20 0x7f88881515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.431+0000 7f887fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888156c20 0x7f88881515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57784/0 (socket says 172.21.15.71:57784) 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.431+0000 7f887fe00640 1 -- 172.21.15.71:0/276688016 learned_addr learned my addr 172.21.15.71:0/276688016 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f8885e00640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88880d0360 0x7f88880cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f887fe00640 1 -- 172.21.15.71:0/276688016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f888815ca40 msgr2=0x7f8888151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f887fe00640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f888815ca40 0x7f8888151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f887fe00640 1 -- 172.21.15.71:0/276688016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88880d0360 msgr2=0x7f88880cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f887fe00640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88880d0360 0x7f88880cead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f887fe00640 1 -- 172.21.15.71:0/276688016 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8888072b60 con 0x7f8888156c20 2024-04-20T21:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f887fe00640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888156c20 0x7f88881515f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f887000c4d0 tx=0x7f887000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f887e000640 1 -- 172.21.15.71:0/276688016 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870018070 con 0x7f8888156c20 2024-04-20T21:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f887e000640 1 -- 172.21.15.71:0/276688016 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8870007500 con 0x7f8888156c20 2024-04-20T21:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f887e000640 1 -- 172.21.15.71:0/276688016 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870004a20 con 0x7f8888156c20 2024-04-20T21:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f888d200640 1 -- 172.21.15.71:0/276688016 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8888071fe0 con 0x7f8888156c20 2024-04-20T21:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.432+0000 7f888d200640 1 -- 172.21.15.71:0/276688016 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88880725a0 con 0x7f8888156c20 2024-04-20T21:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.434+0000 7f888d200640 1 -- 172.21.15.71:0/276688016 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8888068980 con 0x7f8888156c20 2024-04-20T21:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.435+0000 7f887e000640 1 -- 172.21.15.71:0/276688016 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8870004bc0 con 0x7f8888156c20 2024-04-20T21:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.435+0000 7f887e000640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f886406c8f0 0x7f886406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.436+0000 7f887e000640 1 -- 172.21.15.71:0/276688016 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f887008b220 con 0x7f8888156c20 2024-04-20T21:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.436+0000 7f8885e00640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f886406c8f0 0x7f886406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.436+0000 7f8885e00640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f886406c8f0 0x7f886406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8878006fd0 tx=0x7f8878008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:41.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.440+0000 7f887e000640 1 -- 172.21.15.71:0/276688016 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8870059220 con 0x7f8888156c20 2024-04-20T21:20:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.624+0000 7f888d200640 1 -- 172.21.15.71:0/276688016 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f88880cfd90 con 0x7f8888156c20 2024-04-20T21:20:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.625+0000 7f887e000640 1 -- 172.21.15.71:0/276688016 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f8870058b20 con 0x7f8888156c20 2024-04-20T21:20:41.625 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 -- 172.21.15.71:0/276688016 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f886406c8f0 msgr2=0x7f886406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f886406c8f0 0x7f886406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8878006fd0 tx=0x7f8878008040 comp rx=0 tx=0).stop 2024-04-20T21:20:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 -- 172.21.15.71:0/276688016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888156c20 msgr2=0x7f88881515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888156c20 0x7f88881515f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f887000c4d0 tx=0x7f887000c990 comp rx=0 tx=0).stop 2024-04-20T21:20:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 -- 172.21.15.71:0/276688016 shutdown_connections 2024-04-20T21:20:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f886406c8f0 0x7f886406edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f888815ca40 0x7f8888151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8888156c20 0x7f88881515f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 --2- 172.21.15.71:0/276688016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88880d0360 0x7f88880cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 -- 172.21.15.71:0/276688016 >> 172.21.15.71:0/276688016 conn(0x7f88880b3350 msgr2=0x7f888815f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 -- 172.21.15.71:0/276688016 shutdown_connections 2024-04-20T21:20:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.627+0000 7f888d200640 1 -- 172.21.15.71:0/276688016 wait complete. 2024-04-20T21:20:41.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T21:20:41.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.845+0000 7f4737200640 1 Processor -- start 2024-04-20T21:20:41.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.845+0000 7f4737200640 1 -- start start 2024-04-20T21:20:41.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.847+0000 7f4737200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4738159e10 0x7f4738071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.847+0000 7f4737200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473815a1f0 0x7f4738071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.847+0000 7f4737200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f473806da90 0x7f4738160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.847+0000 7f4737200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4738072900 con 0x7f4738159e10 2024-04-20T21:20:41.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.847+0000 7f4737200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f473815ca40 con 0x7f473806da90 2024-04-20T21:20:41.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.847+0000 7f4737200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f473815cc90 con 0x7f473815a1f0 2024-04-20T21:20:41.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.847+0000 7f4735e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4738159e10 0x7f4738071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.847+0000 7f4735e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4738159e10 0x7f4738071a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57792/0 (socket says 172.21.15.71:57792) 2024-04-20T21:20:41.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.847+0000 7f4735e00640 1 -- 172.21.15.71:0/2375080709 learned_addr learned my addr 172.21.15.71:0/2375080709 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:41.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.848+0000 7f4735400640 1 --2- 172.21.15.71:0/2375080709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473815a1f0 0x7f4738071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.848+0000 7f4736800640 1 --2- 172.21.15.71:0/2375080709 >> v2:172.21.15.137:3300/0 conn(0x7f473806da90 0x7f4738160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.848+0000 7f4735e00640 1 -- 172.21.15.71:0/2375080709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473815a1f0 msgr2=0x7f4738071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:41.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.848+0000 7f4735e00640 1 --2- 172.21.15.71:0/2375080709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473815a1f0 0x7f4738071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.848+0000 7f4735e00640 1 -- 172.21.15.71:0/2375080709 >> v2:172.21.15.137:3300/0 conn(0x7f473806da90 msgr2=0x7f4738160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:41.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.848+0000 7f4735e00640 1 --2- 172.21.15.71:0/2375080709 >> v2:172.21.15.137:3300/0 conn(0x7f473806da90 0x7f4738160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.848+0000 7f4735e00640 1 -- 172.21.15.71:0/2375080709 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473815cf70 con 0x7f4738159e10 2024-04-20T21:20:41.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.848+0000 7f4735400640 1 --2- 172.21.15.71:0/2375080709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473815a1f0 0x7f4738071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:20:41.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.849+0000 7f4735e00640 1 --2- 172.21.15.71:0/2375080709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4738159e10 0x7f4738071a80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f47380cffe0 tx=0x7f472802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449054c4ad1a5b3a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:41.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.850+0000 7f4734a00640 1 -- 172.21.15.71:0/2375080709 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728035020 con 0x7f4738159e10 2024-04-20T21:20:41.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.850+0000 7f4734a00640 1 -- 172.21.15.71:0/2375080709 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472802d040 con 0x7f4738159e10 2024-04-20T21:20:41.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.850+0000 7f4734a00640 1 -- 172.21.15.71:0/2375080709 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728031a80 con 0x7f4738159e10 2024-04-20T21:20:41.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.851+0000 7f4737200640 1 -- 172.21.15.71:0/2375080709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4738159e10 msgr2=0x7f4738071a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.851+0000 7f4737200640 1 --2- 172.21.15.71:0/2375080709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4738159e10 0x7f4738071a80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f47380cffe0 tx=0x7f472802b900 comp rx=0 tx=0).stop 2024-04-20T21:20:41.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.851+0000 7f4737200640 1 -- 172.21.15.71:0/2375080709 shutdown_connections 2024-04-20T21:20:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.851+0000 7f4737200640 1 --2- 172.21.15.71:0/2375080709 >> v2:172.21.15.137:3300/0 conn(0x7f473806da90 0x7f4738160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.851+0000 7f4737200640 1 --2- 172.21.15.71:0/2375080709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473815a1f0 0x7f4738071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.851+0000 7f4737200640 1 --2- 172.21.15.71:0/2375080709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4738159e10 0x7f4738071a80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.851+0000 7f4737200640 1 -- 172.21.15.71:0/2375080709 >> 172.21.15.71:0/2375080709 conn(0x7f47380d0040 msgr2=0x7f47380d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.851+0000 7f4737200640 1 -- 172.21.15.71:0/2375080709 shutdown_connections 2024-04-20T21:20:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.851+0000 7f4737200640 1 -- 172.21.15.71:0/2375080709 wait complete. 2024-04-20T21:20:41.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.852+0000 7f4737200640 1 Processor -- start 2024-04-20T21:20:41.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.853+0000 7f4737200640 1 -- start start 2024-04-20T21:20:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.853+0000 7f4737200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473806da90 0x7f47381f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.853+0000 7f4737200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4738159e10 0x7f4738151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.853+0000 7f4737200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473815a1f0 0x7f47380b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.853+0000 7f4737200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f473815d810 con 0x7f473806da90 2024-04-20T21:20:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.853+0000 7f4737200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f473815d530 con 0x7f4738159e10 2024-04-20T21:20:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.853+0000 7f4737200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f473806b900 con 0x7f473815a1f0 2024-04-20T21:20:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.854+0000 7f4735e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473806da90 0x7f47381f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.854+0000 7f4735e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473806da90 0x7f47381f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57808/0 (socket says 172.21.15.71:57808) 2024-04-20T21:20:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.854+0000 7f4735e00640 1 -- 172.21.15.71:0/1966759646 learned_addr learned my addr 172.21.15.71:0/1966759646 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:41.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.854+0000 7f4736800640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473815a1f0 0x7f47380b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.854+0000 7f4735e00640 1 -- 172.21.15.71:0/1966759646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473815a1f0 msgr2=0x7f47380b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.854+0000 7f4735400640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4738159e10 0x7f4738151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.854+0000 7f4735e00640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473815a1f0 0x7f47380b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.854+0000 7f4735e00640 1 -- 172.21.15.71:0/1966759646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4738159e10 msgr2=0x7f4738151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.854+0000 7f4735e00640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4738159e10 0x7f4738151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.854+0000 7f4735e00640 1 -- 172.21.15.71:0/1966759646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47380b4800 con 0x7f473806da90 2024-04-20T21:20:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.854+0000 7f4735400640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4738159e10 0x7f4738151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.855+0000 7f4735e00640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473806da90 0x7f47381f56a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f472802b940 tx=0x7f47280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.855+0000 7f472e000640 1 -- 172.21.15.71:0/1966759646 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728040070 con 0x7f473806da90 2024-04-20T21:20:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.855+0000 7f472e000640 1 -- 172.21.15.71:0/1966759646 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4728039c10 con 0x7f473806da90 2024-04-20T21:20:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.855+0000 7f472e000640 1 -- 172.21.15.71:0/1966759646 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728035040 con 0x7f473806da90 2024-04-20T21:20:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.855+0000 7f4737200640 1 -- 172.21.15.71:0/1966759646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47381f4bc0 con 0x7f473806da90 2024-04-20T21:20:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.855+0000 7f4737200640 1 -- 172.21.15.71:0/1966759646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47381f5180 con 0x7f473806da90 2024-04-20T21:20:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.856+0000 7f4737200640 1 -- 172.21.15.71:0/1966759646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f473809dc50 con 0x7f473806da90 2024-04-20T21:20:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.857+0000 7f472e000640 1 -- 172.21.15.71:0/1966759646 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f472804b060 con 0x7f473806da90 2024-04-20T21:20:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.858+0000 7f472e000640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f471806c920 0x7f471806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.858+0000 7f472e000640 1 -- 172.21.15.71:0/1966759646 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f47280adbb0 con 0x7f473806da90 2024-04-20T21:20:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.858+0000 7f4735400640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f471806c920 0x7f471806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.859+0000 7f4735400640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f471806c920 0x7f471806ede0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4724006fd0 tx=0x7f4724008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:41.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:41.862+0000 7f472e000640 1 -- 172.21.15.71:0/1966759646 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f473809dc50 con 0x7f473806da90 2024-04-20T21:20:42.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.076+0000 7f4737200640 1 -- 172.21.15.71:0/1966759646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f47381f5350 con 0x7f473806da90 2024-04-20T21:20:42.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.077+0000 7f472e000640 1 -- 172.21.15.71:0/1966759646 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f472807bb20 con 0x7f473806da90 2024-04-20T21:20:42.076 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.079+0000 7f4737200640 1 -- 172.21.15.71:0/1966759646 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f471806c920 msgr2=0x7f471806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.080+0000 7f4737200640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f471806c920 0x7f471806ede0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4724006fd0 tx=0x7f4724008040 comp rx=0 tx=0).stop 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.080+0000 7f4737200640 1 -- 172.21.15.71:0/1966759646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473806da90 msgr2=0x7f47381f56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.080+0000 7f4737200640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473806da90 0x7f47381f56a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f472802b940 tx=0x7f47280046c0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.080+0000 7f4737200640 1 -- 172.21.15.71:0/1966759646 shutdown_connections 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.080+0000 7f4737200640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f471806c920 0x7f471806ede0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.080+0000 7f4737200640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f473815a1f0 0x7f47380b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.080+0000 7f4737200640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4738159e10 0x7f4738151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.080+0000 7f4737200640 1 --2- 172.21.15.71:0/1966759646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473806da90 0x7f47381f56a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.080+0000 7f4737200640 1 -- 172.21.15.71:0/1966759646 >> 172.21.15.71:0/1966759646 conn(0x7f47380d0040 msgr2=0x7f4738159060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.080+0000 7f4737200640 1 -- 172.21.15.71:0/1966759646 shutdown_connections 2024-04-20T21:20:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.080+0000 7f4737200640 1 -- 172.21.15.71:0/1966759646 wait complete. 2024-04-20T21:20:42.099 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:20:42.099 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:42.154 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:42.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.359+0000 7f98ae800640 1 Processor -- start 2024-04-20T21:20:42.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.359+0000 7f98ae800640 1 -- start start 2024-04-20T21:20:42.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.361+0000 7f98ae800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98a815ca40 0x7f98a80ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.361+0000 7f98ae800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f98a80ad8e0 0x7f98a80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.361+0000 7f98ae800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a8141c60 con 0x7f98a8156c20 2024-04-20T21:20:42.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.361+0000 7f98ae800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f98a806c010 con 0x7f98a80ad8e0 2024-04-20T21:20:42.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.361+0000 7f98ae800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f98a815cf90 con 0x7f98a815ca40 2024-04-20T21:20:42.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.361+0000 7f98a7e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f98a80ad8e0 0x7f98a80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:42.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.361+0000 7f98a7e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f98a80ad8e0 0x7f98a80d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57816/0 (socket says 172.21.15.71:57816) 2024-04-20T21:20:42.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.361+0000 7f98a7e00640 1 -- 172.21.15.71:0/573486467 learned_addr learned my addr 172.21.15.71:0/573486467 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:42.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.362+0000 7f98a6a00640 1 --2- 172.21.15.71:0/573486467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98a815ca40 0x7f98a80ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:42.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.362+0000 7f98a7e00640 1 -- 172.21.15.71:0/573486467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98a815ca40 msgr2=0x7f98a80ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:42.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.362+0000 7f98a7e00640 1 --2- 172.21.15.71:0/573486467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98a815ca40 0x7f98a80ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.362+0000 7f98a7e00640 1 -- 172.21.15.71:0/573486467 >> v1:172.21.15.137:6789/0 conn(0x7f98a8156c20 legacy=0x7f98a806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:42.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.362+0000 7f98a7e00640 1 -- 172.21.15.71:0/573486467 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a815d270 con 0x7f98a80ad8e0 2024-04-20T21:20:42.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.362+0000 7f98a6a00640 1 --2- 172.21.15.71:0/573486467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98a815ca40 0x7f98a80ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:42.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.363+0000 7f98a7e00640 1 --2- 172.21.15.71:0/573486467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a80ad8e0 0x7f98a80d0360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009e50 tx=0x7f98a002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b46aade4bff14a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:42.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.363+0000 7f98a6000640 1 -- 172.21.15.71:0/573486467 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a002ca80 con 0x7f98a80ad8e0 2024-04-20T21:20:42.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.363+0000 7f98a6000640 1 -- 172.21.15.71:0/573486467 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a002cc20 con 0x7f98a80ad8e0 2024-04-20T21:20:42.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.363+0000 7f98a6000640 1 -- 172.21.15.71:0/573486467 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00343f0 con 0x7f98a80ad8e0 2024-04-20T21:20:42.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.364+0000 7f98ae800640 1 -- 172.21.15.71:0/573486467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a80ad8e0 msgr2=0x7f98a80d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:42.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.364+0000 7f98ae800640 1 --2- 172.21.15.71:0/573486467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a80ad8e0 0x7f98a80d0360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009e50 tx=0x7f98a002bee0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.364+0000 7f98ae800640 1 -- 172.21.15.71:0/573486467 shutdown_connections 2024-04-20T21:20:42.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.364+0000 7f98ae800640 1 --2- 172.21.15.71:0/573486467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98a815ca40 0x7f98a80ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.364+0000 7f98ae800640 1 --2- 172.21.15.71:0/573486467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a80ad8e0 0x7f98a80d0360 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.364+0000 7f98ae800640 1 -- 172.21.15.71:0/573486467 >> 172.21.15.71:0/573486467 conn(0x7f98a80b3350 msgr2=0x7f98a80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:42.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.364+0000 7f98ae800640 1 -- 172.21.15.71:0/573486467 shutdown_connections 2024-04-20T21:20:42.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.364+0000 7f98ae800640 1 -- 172.21.15.71:0/573486467 wait complete. 2024-04-20T21:20:42.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.366+0000 7f98ae800640 1 Processor -- start 2024-04-20T21:20:42.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.367+0000 7f98ae800640 1 -- start start 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98ae800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a80ad8e0 0x7f98a8099320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98ae800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a8156c20 0x7f98a80ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98ae800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98a815ca40 0x7f98a814e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98ae800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f98a80d08a0 con 0x7f98a80ad8e0 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98ae800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98a815d830 con 0x7f98a8156c20 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98ae800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f98a80d0a20 con 0x7f98a815ca40 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98a7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a80ad8e0 0x7f98a8099320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98a7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a80ad8e0 0x7f98a8099320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57824/0 (socket says 172.21.15.71:57824) 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98a7400640 1 -- 172.21.15.71:0/4115482706 learned_addr learned my addr 172.21.15.71:0/4115482706 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98a6a00640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a8156c20 0x7f98a80ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98a7400640 1 -- 172.21.15.71:0/4115482706 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98a815ca40 msgr2=0x7f98a814e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98a7400640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98a815ca40 0x7f98a814e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98a7400640 1 -- 172.21.15.71:0/4115482706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a8156c20 msgr2=0x7f98a80ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:42.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98a7400640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a8156c20 0x7f98a80ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.368+0000 7f98a7400640 1 -- 172.21.15.71:0/4115482706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a814d730 con 0x7f98a80ad8e0 2024-04-20T21:20:42.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.369+0000 7f98a7400640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a80ad8e0 0x7f98a8099320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f989800c430 tx=0x7f989800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:42.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.369+0000 7f989f400640 1 -- 172.21.15.71:0/4115482706 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898011790 con 0x7f98a80ad8e0 2024-04-20T21:20:42.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.369+0000 7f989f400640 1 -- 172.21.15.71:0/4115482706 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9898017070 con 0x7f98a80ad8e0 2024-04-20T21:20:42.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.369+0000 7f989f400640 1 -- 172.21.15.71:0/4115482706 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898011b70 con 0x7f98a80ad8e0 2024-04-20T21:20:42.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.369+0000 7f98ae800640 1 -- 172.21.15.71:0/4115482706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a814da10 con 0x7f98a80ad8e0 2024-04-20T21:20:42.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.369+0000 7f98ae800640 1 -- 172.21.15.71:0/4115482706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a814dfd0 con 0x7f98a80ad8e0 2024-04-20T21:20:42.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.371+0000 7f98ae800640 1 -- 172.21.15.71:0/4115482706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a8068980 con 0x7f98a80ad8e0 2024-04-20T21:20:42.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.371+0000 7f989f400640 1 -- 172.21.15.71:0/4115482706 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9898011d10 con 0x7f98a80ad8e0 2024-04-20T21:20:42.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.373+0000 7f989f400640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f988806c8f0 0x7f988806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.373+0000 7f989f400640 1 -- 172.21.15.71:0/4115482706 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f989808bed0 con 0x7f98a80ad8e0 2024-04-20T21:20:42.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.373+0000 7f98a6a00640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f988806c8f0 0x7f988806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:42.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.374+0000 7f98a6a00640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f988806c8f0 0x7f988806edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f98a81f6090 tx=0x7f9894008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:42.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.377+0000 7f989f400640 1 -- 172.21.15.71:0/4115482706 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9898059e50 con 0x7f98a80ad8e0 2024-04-20T21:20:42.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.575+0000 7f98ae800640 1 -- 172.21.15.71:0/4115482706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98a80af400 con 0x7f98a80ad8e0 2024-04-20T21:20:42.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.579+0000 7f989f400640 1 -- 172.21.15.71:0/4115482706 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7f9898059750 con 0x7f98a80ad8e0 2024-04-20T21:20:42.579 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:42.579 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.581+0000 7f98ae800640 1 -- 172.21.15.71:0/4115482706 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f988806c8f0 msgr2=0x7f988806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.581+0000 7f98ae800640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f988806c8f0 0x7f988806edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f98a81f6090 tx=0x7f9894008040 comp rx=0 tx=0).stop 2024-04-20T21:20:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.581+0000 7f98ae800640 1 -- 172.21.15.71:0/4115482706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a80ad8e0 msgr2=0x7f98a8099320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.581+0000 7f98ae800640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a80ad8e0 0x7f98a8099320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f989800c430 tx=0x7f989800c8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.581+0000 7f98ae800640 1 -- 172.21.15.71:0/4115482706 shutdown_connections 2024-04-20T21:20:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.581+0000 7f98ae800640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f988806c8f0 0x7f988806edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.581+0000 7f98ae800640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98a815ca40 0x7f98a814e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.581+0000 7f98ae800640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a8156c20 0x7f98a80ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.581+0000 7f98ae800640 1 --2- 172.21.15.71:0/4115482706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98a80ad8e0 0x7f98a8099320 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.581+0000 7f98ae800640 1 -- 172.21.15.71:0/4115482706 >> 172.21.15.71:0/4115482706 conn(0x7f98a80b3350 msgr2=0x7f98a815db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:42.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.581+0000 7f98ae800640 1 -- 172.21.15.71:0/4115482706 shutdown_connections 2024-04-20T21:20:42.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.582+0000 7f98ae800640 1 -- 172.21.15.71:0/4115482706 wait complete. 2024-04-20T21:20:42.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:42.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:42.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.794+0000 7fa708a00640 1 Processor -- start 2024-04-20T21:20:42.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.794+0000 7fa708a00640 1 -- start start 2024-04-20T21:20:42.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.796+0000 7fa708a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7041459b0 0x7fa7040b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.796+0000 7fa708a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa704071df0 0x7fa7040cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.796+0000 7fa708a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7040c7990 con 0x7fa7040c7220 2024-04-20T21:20:42.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.796+0000 7fa708a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa7040c7c70 con 0x7fa704071df0 2024-04-20T21:20:42.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.796+0000 7fa708a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa7040c7f50 con 0x7fa7041459b0 2024-04-20T21:20:42.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.796+0000 7fa702800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa704071df0 0x7fa7040cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:42.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.796+0000 7fa701e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7041459b0 0x7fa7040b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:42.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.797+0000 7fa701e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7041459b0 0x7fa7040b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:51996/0 (socket says 172.21.15.71:51996) 2024-04-20T21:20:42.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.797+0000 7fa701e00640 1 -- 172.21.15.71:0/1537169715 learned_addr learned my addr 172.21.15.71:0/1537169715 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:42.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.797+0000 7fa701e00640 1 -- 172.21.15.71:0/1537169715 >> v2:172.21.15.137:3300/0 conn(0x7fa704071df0 msgr2=0x7fa7040cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:42.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.797+0000 7fa701e00640 1 --2- 172.21.15.71:0/1537169715 >> v2:172.21.15.137:3300/0 conn(0x7fa704071df0 0x7fa7040cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.797+0000 7fa701e00640 1 -- 172.21.15.71:0/1537169715 >> v1:172.21.15.137:6789/0 conn(0x7fa7040c7220 legacy=0x7fa7040716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:42.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.797+0000 7fa701e00640 1 -- 172.21.15.71:0/1537169715 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7040c8230 con 0x7fa7041459b0 2024-04-20T21:20:42.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.797+0000 7fa702800640 1 --2- 172.21.15.71:0/1537169715 >> v2:172.21.15.137:3300/0 conn(0x7fa704071df0 0x7fa7040cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:20:42.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.799+0000 7fa701e00640 1 --2- 172.21.15.71:0/1537169715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7041459b0 0x7fa7040b3a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40098a0 tx=0x7fa6f402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e81cfb1aece32708 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:42.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.799+0000 7fa700a00640 1 -- 172.21.15.71:0/1537169715 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4034070 con 0x7fa7041459b0 2024-04-20T21:20:42.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.799+0000 7fa700a00640 1 -- 172.21.15.71:0/1537169715 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f4030840 con 0x7fa7041459b0 2024-04-20T21:20:42.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.799+0000 7fa700a00640 1 -- 172.21.15.71:0/1537169715 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4030c10 con 0x7fa7041459b0 2024-04-20T21:20:42.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.800+0000 7fa708a00640 1 -- 172.21.15.71:0/1537169715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7041459b0 msgr2=0x7fa7040b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:42.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.800+0000 7fa708a00640 1 --2- 172.21.15.71:0/1537169715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7041459b0 0x7fa7040b3a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40098a0 tx=0x7fa6f402b980 comp rx=0 tx=0).stop 2024-04-20T21:20:42.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.800+0000 7fa708a00640 1 -- 172.21.15.71:0/1537169715 shutdown_connections 2024-04-20T21:20:42.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.800+0000 7fa708a00640 1 --2- 172.21.15.71:0/1537169715 >> v2:172.21.15.137:3300/0 conn(0x7fa704071df0 0x7fa7040cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.800+0000 7fa708a00640 1 --2- 172.21.15.71:0/1537169715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7041459b0 0x7fa7040b3a60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.800+0000 7fa708a00640 1 -- 172.21.15.71:0/1537169715 >> 172.21.15.71:0/1537169715 conn(0x7fa7040d23a0 msgr2=0x7fa7040d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:42.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.800+0000 7fa708a00640 1 -- 172.21.15.71:0/1537169715 shutdown_connections 2024-04-20T21:20:42.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.800+0000 7fa708a00640 1 -- 172.21.15.71:0/1537169715 wait complete. 2024-04-20T21:20:42.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.802+0000 7fa708a00640 1 Processor -- start 2024-04-20T21:20:42.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.802+0000 7fa708a00640 1 -- start start 2024-04-20T21:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.803+0000 7fa708a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa704071df0 0x7fa704144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa708a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7040c7220 0x7fa7041e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa708a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7041459b0 0x7fa7041e6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa708a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7040cd140 con 0x7fa704071df0 2024-04-20T21:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa708a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa7040ccfc0 con 0x7fa7041459b0 2024-04-20T21:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa708a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa7040cd2c0 con 0x7fa7040c7220 2024-04-20T21:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa701e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa704071df0 0x7fa704144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa701e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa704071df0 0x7fa704144980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57828/0 (socket says 172.21.15.71:57828) 2024-04-20T21:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa701e00640 1 -- 172.21.15.71:0/2084292875 learned_addr learned my addr 172.21.15.71:0/2084292875 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa701400640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7040c7220 0x7fa7041e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa702800640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7041459b0 0x7fa7041e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa701e00640 1 -- 172.21.15.71:0/2084292875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7040c7220 msgr2=0x7fa7041e5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.804+0000 7fa701e00640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7040c7220 0x7fa7041e5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.805+0000 7fa701e00640 1 -- 172.21.15.71:0/2084292875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7041459b0 msgr2=0x7fa7041e6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.805+0000 7fa701e00640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7041459b0 0x7fa7041e6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.805+0000 7fa701e00640 1 -- 172.21.15.71:0/2084292875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70406f090 con 0x7fa704071df0 2024-04-20T21:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.805+0000 7fa701e00640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa704071df0 0x7fa704144980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4000c00 tx=0x7fa6f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.805+0000 7fa6fa000640 1 -- 172.21.15.71:0/2084292875 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4034040 con 0x7fa704071df0 2024-04-20T21:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.805+0000 7fa6fa000640 1 -- 172.21.15.71:0/2084292875 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f403ada0 con 0x7fa704071df0 2024-04-20T21:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.805+0000 7fa6fa000640 1 -- 172.21.15.71:0/2084292875 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4044630 con 0x7fa704071df0 2024-04-20T21:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.805+0000 7fa708a00640 1 -- 172.21.15.71:0/2084292875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7041e6940 con 0x7fa704071df0 2024-04-20T21:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.805+0000 7fa708a00640 1 -- 172.21.15.71:0/2084292875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7041e71e0 con 0x7fa704071df0 2024-04-20T21:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.807+0000 7fa708a00640 1 -- 172.21.15.71:0/2084292875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa704068980 con 0x7fa704071df0 2024-04-20T21:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.808+0000 7fa6fa000640 1 -- 172.21.15.71:0/2084292875 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa6f404b060 con 0x7fa704071df0 2024-04-20T21:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.808+0000 7fa6fa000640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa6e406c8f0 0x7fa6e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.809+0000 7fa6fa000640 1 -- 172.21.15.71:0/2084292875 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fa6f40adf70 con 0x7fa704071df0 2024-04-20T21:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.809+0000 7fa701400640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa6e406c8f0 0x7fa6e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.809+0000 7fa701400640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa6e406c8f0 0x7fa6e406edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0007fd0 tx=0x7fa6f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:42.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:42.813+0000 7fa6fa000640 1 -- 172.21.15.71:0/2084292875 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa6f403f070 con 0x7fa704071df0 2024-04-20T21:20:43.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.014+0000 7fa708a00640 1 -- 172.21.15.71:0/2084292875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa7041e6cd0 con 0x7fa704071df0 2024-04-20T21:20:43.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.015+0000 7fa6fa000640 1 -- 172.21.15.71:0/2084292875 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fa6f407bee0 con 0x7fa704071df0 2024-04-20T21:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 -- 172.21.15.71:0/2084292875 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa6e406c8f0 msgr2=0x7fa6e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa6e406c8f0 0x7fa6e406edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0007fd0 tx=0x7fa6f0009040 comp rx=0 tx=0).stop 2024-04-20T21:20:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 -- 172.21.15.71:0/2084292875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa704071df0 msgr2=0x7fa704144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa704071df0 0x7fa704144980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4000c00 tx=0x7fa6f40046c0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 -- 172.21.15.71:0/2084292875 shutdown_connections 2024-04-20T21:20:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa6e406c8f0 0x7fa6e406edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7041459b0 0x7fa7041e6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7040c7220 0x7fa7041e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 --2- 172.21.15.71:0/2084292875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa704071df0 0x7fa704144980 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 -- 172.21.15.71:0/2084292875 >> 172.21.15.71:0/2084292875 conn(0x7fa7040d23a0 msgr2=0x7fa7040716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 -- 172.21.15.71:0/2084292875 shutdown_connections 2024-04-20T21:20:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.018+0000 7fa708a00640 1 -- 172.21.15.71:0/2084292875 wait complete. 2024-04-20T21:20:43.043 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:43.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.224+0000 7f46ab200640 1 Processor -- start 2024-04-20T21:20:43.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.224+0000 7f46ab200640 1 -- start start 2024-04-20T21:20:43.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.226+0000 7f46ab200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f46ac15b1f0 0x7f46ac15f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.226+0000 7f46ab200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46ac0d0010 0x7f46ac0adc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.226+0000 7f46ab200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ac15b5d0 con 0x7f46ac0ae140 2024-04-20T21:20:43.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.226+0000 7f46ab200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f46ac06e730 con 0x7f46ac15b1f0 2024-04-20T21:20:43.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.226+0000 7f46ab200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f46ac0d05d0 con 0x7f46ac0d0010 2024-04-20T21:20:43.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.227+0000 7f46a9e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f46ac15b1f0 0x7f46ac15f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:43.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.227+0000 7f46a1400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46ac0d0010 0x7f46ac0adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.227+0000 7f46a1400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46ac0d0010 0x7f46ac0adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:48542/0 (socket says 172.21.15.71:48542) 2024-04-20T21:20:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.227+0000 7f46a1400640 1 -- 172.21.15.71:0/2085424163 learned_addr learned my addr 172.21.15.71:0/2085424163 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.227+0000 7f46a1400640 1 -- 172.21.15.71:0/2085424163 >> v2:172.21.15.137:3300/0 conn(0x7f46ac15b1f0 msgr2=0x7f46ac15f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.227+0000 7f46a1400640 1 --2- 172.21.15.71:0/2085424163 >> v2:172.21.15.137:3300/0 conn(0x7f46ac15b1f0 0x7f46ac15f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.227+0000 7f46a1400640 1 -- 172.21.15.71:0/2085424163 >> v1:172.21.15.137:6789/0 conn(0x7f46ac0ae140 legacy=0x7f46ac06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.227+0000 7f46a1400640 1 -- 172.21.15.71:0/2085424163 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac15fc70 con 0x7f46ac0d0010 2024-04-20T21:20:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.229+0000 7f46a1400640 1 --2- 172.21.15.71:0/2085424163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46ac0d0010 0x7f46ac0adc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4694009870 tx=0x7f469402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22b78acdf515eecf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.230+0000 7f46a9400640 1 -- 172.21.15.71:0/2085424163 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694034070 con 0x7f46ac0d0010 2024-04-20T21:20:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.230+0000 7f46a9400640 1 -- 172.21.15.71:0/2085424163 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4694030840 con 0x7f46ac0d0010 2024-04-20T21:20:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.230+0000 7f46a9400640 1 -- 172.21.15.71:0/2085424163 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694030c10 con 0x7f46ac0d0010 2024-04-20T21:20:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.230+0000 7f46ab200640 1 -- 172.21.15.71:0/2085424163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46ac0d0010 msgr2=0x7f46ac0adc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.230+0000 7f46ab200640 1 --2- 172.21.15.71:0/2085424163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46ac0d0010 0x7f46ac0adc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4694009870 tx=0x7f469402b980 comp rx=0 tx=0).stop 2024-04-20T21:20:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.230+0000 7f46ab200640 1 -- 172.21.15.71:0/2085424163 shutdown_connections 2024-04-20T21:20:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.230+0000 7f46ab200640 1 --2- 172.21.15.71:0/2085424163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46ac0d0010 0x7f46ac0adc00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.230+0000 7f46ab200640 1 --2- 172.21.15.71:0/2085424163 >> v2:172.21.15.137:3300/0 conn(0x7f46ac15b1f0 0x7f46ac15f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.230+0000 7f46ab200640 1 -- 172.21.15.71:0/2085424163 >> 172.21.15.71:0/2085424163 conn(0x7f46ac0b5270 msgr2=0x7f46ac0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:43.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.230+0000 7f46ab200640 1 -- 172.21.15.71:0/2085424163 shutdown_connections 2024-04-20T21:20:43.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.231+0000 7f46ab200640 1 -- 172.21.15.71:0/2085424163 wait complete. 2024-04-20T21:20:43.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.232+0000 7f46ab200640 1 Processor -- start 2024-04-20T21:20:43.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.232+0000 7f46ab200640 1 -- start start 2024-04-20T21:20:43.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.233+0000 7f46ab200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46ac0ae140 0x7f46ac1e5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.233+0000 7f46ab200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46ac0d0010 0x7f46ac150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.233+0000 7f46ab200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46ac15b1f0 0x7f46ac1e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.233+0000 7f46ab200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac0d0e70 con 0x7f46ac15b1f0 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.233+0000 7f46ab200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac0d0b90 con 0x7f46ac0d0010 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.233+0000 7f46ab200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f46ac06d120 con 0x7f46ac0ae140 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.234+0000 7f46aa800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46ac15b1f0 0x7f46ac1e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.234+0000 7f46aa800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46ac15b1f0 0x7f46ac1e66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51838/0 (socket says 172.21.15.71:51838) 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.234+0000 7f46aa800640 1 -- 172.21.15.71:0/2808232665 learned_addr learned my addr 172.21.15.71:0/2808232665 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.234+0000 7f46a1400640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46ac0d0010 0x7f46ac150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.234+0000 7f46aa800640 1 -- 172.21.15.71:0/2808232665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46ac0ae140 msgr2=0x7f46ac1e5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.234+0000 7f46aa800640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46ac0ae140 0x7f46ac1e5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.234+0000 7f46aa800640 1 -- 172.21.15.71:0/2808232665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46ac0d0010 msgr2=0x7f46ac150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.234+0000 7f46aa800640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46ac0d0010 0x7f46ac150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.234+0000 7f46aa800640 1 -- 172.21.15.71:0/2808232665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac1506c0 con 0x7f46ac15b1f0 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.234+0000 7f46a1400640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46ac0d0010 0x7f46ac150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.234+0000 7f46aa800640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46ac15b1f0 0x7f46ac1e66e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f46a400c760 tx=0x7f46a400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.235+0000 7f46a2a00640 1 -- 172.21.15.71:0/2808232665 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4003b70 con 0x7f46ac15b1f0 2024-04-20T21:20:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.235+0000 7f46a2a00640 1 -- 172.21.15.71:0/2808232665 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a4003d10 con 0x7f46ac15b1f0 2024-04-20T21:20:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.235+0000 7f46a2a00640 1 -- 172.21.15.71:0/2808232665 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a400aa90 con 0x7f46ac15b1f0 2024-04-20T21:20:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.235+0000 7f46ab200640 1 -- 172.21.15.71:0/2808232665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ac150960 con 0x7f46ac15b1f0 2024-04-20T21:20:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.235+0000 7f46ab200640 1 -- 172.21.15.71:0/2808232665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ac150f20 con 0x7f46ac15b1f0 2024-04-20T21:20:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.236+0000 7f46ab200640 1 -- 172.21.15.71:0/2808232665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ac075b30 con 0x7f46ac15b1f0 2024-04-20T21:20:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.237+0000 7f46a2a00640 1 -- 172.21.15.71:0/2808232665 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f46a400ac30 con 0x7f46ac15b1f0 2024-04-20T21:20:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.238+0000 7f46a2a00640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f468806c8f0 0x7f468806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.238+0000 7f46a2a00640 1 -- 172.21.15.71:0/2808232665 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f46a408bf70 con 0x7f46ac15b1f0 2024-04-20T21:20:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.238+0000 7f46a9e00640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f468806c8f0 0x7f468806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.239+0000 7f46a9e00640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f468806c8f0 0x7f468806edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f469c006a90 tx=0x7f469c006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:43.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.242+0000 7f46a2a00640 1 -- 172.21.15.71:0/2808232665 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f46a4059e50 con 0x7f46ac15b1f0 2024-04-20T21:20:43.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.424+0000 7f46ab200640 1 -- 172.21.15.71:0/2808232665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f46ac0b32b0 con 0x7f46ac15b1f0 2024-04-20T21:20:43.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.425+0000 7f46a2a00640 1 -- 172.21.15.71:0/2808232665 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f46a4059750 con 0x7f46ac15b1f0 2024-04-20T21:20:43.425 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 -- 172.21.15.71:0/2808232665 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f468806c8f0 msgr2=0x7f468806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f468806c8f0 0x7f468806edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f469c006a90 tx=0x7f469c006a20 comp rx=0 tx=0).stop 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 -- 172.21.15.71:0/2808232665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46ac15b1f0 msgr2=0x7f46ac1e66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46ac15b1f0 0x7f46ac1e66e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f46a400c760 tx=0x7f46a400cc20 comp rx=0 tx=0).stop 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 -- 172.21.15.71:0/2808232665 shutdown_connections 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f468806c8f0 0x7f468806edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46ac15b1f0 0x7f46ac1e66e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46ac0d0010 0x7f46ac150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 --2- 172.21.15.71:0/2808232665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46ac0ae140 0x7f46ac1e5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 -- 172.21.15.71:0/2808232665 >> 172.21.15.71:0/2808232665 conn(0x7f46ac0b5270 msgr2=0x7f46ac06eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 -- 172.21.15.71:0/2808232665 shutdown_connections 2024-04-20T21:20:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.428+0000 7f46ab200640 1 -- 172.21.15.71:0/2808232665 wait complete. 2024-04-20T21:20:43.445 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:43.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.644+0000 7fd817600640 1 Processor -- start 2024-04-20T21:20:43.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.645+0000 7fd817600640 1 -- start start 2024-04-20T21:20:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.646+0000 7fd817600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8100d0380 0x7fd8100d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.646+0000 7fd817600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8100d1e90 con 0x7fd8100d4270 2024-04-20T21:20:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.646+0000 7fd817600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8100d0d50 con 0x7fd8100d1a00 2024-04-20T21:20:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.646+0000 7fd817600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd8100d40c0 con 0x7fd8100d0380 2024-04-20T21:20:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd814c00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd8100d4270 0x7fd8100d4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33148/0 (socket says 172.21.15.71:33148) 2024-04-20T21:20:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd814c00640 1 -- 172.21.15.71:0/3824639784 learned_addr learned my addr 172.21.15.71:0/3824639784 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd815600640 1 --2- 172.21.15.71:0/3824639784 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8100d0380 0x7fd8100d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567193937 0 0) 0x7fd7f8001110 con 0x7fd8100d4270 2024-04-20T21:20:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7f4003520 con 0x7fd8100d4270 2024-04-20T21:20:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2725036597 0 0) 0x7fd7f4003520 con 0x7fd8100d4270 2024-04-20T21:20:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8100d0380 msgr2=0x7fd8100d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd80f400640 1 --2- 172.21.15.71:0/3824639784 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8100d0380 0x7fd8100d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 >> v1:172.21.15.137:6789/0 conn(0x7fd8100d1a00 legacy=0x7fd8100b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8100d3820 con 0x7fd8100d4270 2024-04-20T21:20:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fd7f8001840 con 0x7fd8100d4270 2024-04-20T21:20:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.647+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 >> v1:172.21.15.71:6789/0 conn(0x7fd8100d4270 legacy=0x7fd8100d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80f400640 1 --2- 172.21.15.71:0/3824639784 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8100d0380 0x7fd7f40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80f400640 1 --2- 172.21.15.71:0/3824639784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f4003fb0 0x7fd7f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80f400640 1 --2- 172.21.15.71:0/3824639784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7f4004d40 0x7fd7f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd8100d40c0 con 0x7fd7f4003fb0 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f400bb00 con 0x7fd7f4004d40 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd7f400bd00 con 0x7fd8100d0380 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80fe00640 1 --2- 172.21.15.71:0/3824639784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f4003fb0 0x7fd7f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80fe00640 1 -- 172.21.15.71:0/3824639784 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8100d0380 msgr2=0x7fd7f40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80fe00640 1 --2- 172.21.15.71:0/3824639784 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8100d0380 0x7fd7f40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80fe00640 1 -- 172.21.15.71:0/3824639784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7f4004d40 msgr2=0x7fd7f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80fe00640 1 --2- 172.21.15.71:0/3824639784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7f4004d40 0x7fd7f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.648+0000 7fd80fe00640 1 -- 172.21.15.71:0/3824639784 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f4003520 con 0x7fd7f4003fb0 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.649+0000 7fd80fe00640 1 --2- 172.21.15.71:0/3824639784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f4003fb0 0x7fd7f4004800 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd800001e50 tx=0x7fd7f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b283ad2d7bb11bf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.649+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800001a70 con 0x7fd7f4003fb0 2024-04-20T21:20:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.650+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd800003b70 con 0x7fd7f4003fb0 2024-04-20T21:20:43.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.650+0000 7fd80f400640 1 -- 172.21.15.71:0/3824639784 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8000050d0 con 0x7fd7f4003fb0 2024-04-20T21:20:43.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.650+0000 7fd817600640 1 -- 172.21.15.71:0/3824639784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f4003fb0 msgr2=0x7fd7f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.650+0000 7fd817600640 1 --2- 172.21.15.71:0/3824639784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f4003fb0 0x7fd7f4004800 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd800001e50 tx=0x7fd7f4005830 comp rx=0 tx=0).stop 2024-04-20T21:20:43.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.650+0000 7fd815600640 1 -- 172.21.15.71:0/3824639784 reap_dead start 2024-04-20T21:20:43.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.650+0000 7fd817600640 1 -- 172.21.15.71:0/3824639784 shutdown_connections 2024-04-20T21:20:43.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.650+0000 7fd817600640 1 -- 172.21.15.71:0/3824639784 >> 172.21.15.71:0/3824639784 conn(0x7fd8100b99c0 msgr2=0x7fd8100b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:43.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.650+0000 7fd817600640 1 -- 172.21.15.71:0/3824639784 shutdown_connections 2024-04-20T21:20:43.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.650+0000 7fd817600640 1 -- 172.21.15.71:0/3824639784 wait complete. 2024-04-20T21:20:43.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.652+0000 7fd817600640 1 Processor -- start 2024-04-20T21:20:43.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.652+0000 7fd817600640 1 -- start start 2024-04-20T21:20:43.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.653+0000 7fd817600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7f4003fb0 0x7fd8100cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.653+0000 7fd817600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd810158270 0x7fd810157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.653+0000 7fd817600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8100b5510 0x7fd8100b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.653+0000 7fd817600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd8100cfe60 con 0x7fd8100b5510 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.653+0000 7fd817600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd8100d3de0 con 0x7fd810158270 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.653+0000 7fd817600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd8100b19a0 con 0x7fd7f4003fb0 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.653+0000 7fd815600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8100b5510 0x7fd8100b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.653+0000 7fd815600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8100b5510 0x7fd8100b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51852/0 (socket says 172.21.15.71:51852) 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.653+0000 7fd815600640 1 -- 172.21.15.71:0/1408322509 learned_addr learned my addr 172.21.15.71:0/1408322509 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.654+0000 7fd815600640 1 -- 172.21.15.71:0/1408322509 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7f4003fb0 msgr2=0x7fd8100cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.654+0000 7fd815600640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7f4003fb0 0x7fd8100cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.654+0000 7fd815600640 1 -- 172.21.15.71:0/1408322509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd810158270 msgr2=0x7fd810157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.654+0000 7fd815600640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd810158270 0x7fd810157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.654+0000 7fd815600640 1 -- 172.21.15.71:0/1408322509 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8100ccf50 con 0x7fd8100b5510 2024-04-20T21:20:43.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.654+0000 7fd815600640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8100b5510 0x7fd8100b5990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd81008cc90 tx=0x7fd80800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.654+0000 7fd80cc00640 1 -- 172.21.15.71:0/1408322509 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd808004020 con 0x7fd8100b5510 2024-04-20T21:20:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.654+0000 7fd80cc00640 1 -- 172.21.15.71:0/1408322509 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8080041c0 con 0x7fd8100b5510 2024-04-20T21:20:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.654+0000 7fd817600640 1 -- 172.21.15.71:0/1408322509 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8100cd230 con 0x7fd8100b5510 2024-04-20T21:20:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.654+0000 7fd80cc00640 1 -- 172.21.15.71:0/1408322509 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8080043f0 con 0x7fd8100b5510 2024-04-20T21:20:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.654+0000 7fd817600640 1 -- 172.21.15.71:0/1408322509 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8100cd7f0 con 0x7fd8100b5510 2024-04-20T21:20:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.656+0000 7fd817600640 1 -- 172.21.15.71:0/1408322509 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd810068980 con 0x7fd8100b5510 2024-04-20T21:20:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.656+0000 7fd80cc00640 1 -- 172.21.15.71:0/1408322509 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd80801c030 con 0x7fd8100b5510 2024-04-20T21:20:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.657+0000 7fd80cc00640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd7ec06c920 0x7fd7ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.657+0000 7fd80cc00640 1 -- 172.21.15.71:0/1408322509 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fd80808b550 con 0x7fd8100b5510 2024-04-20T21:20:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.658+0000 7fd814c00640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd7ec06c920 0x7fd7ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.658+0000 7fd814c00640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd7ec06c920 0x7fd7ec06ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80013b0 tx=0x7fd7f80011c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.662+0000 7fd80cc00640 1 -- 172.21.15.71:0/1408322509 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd808023060 con 0x7fd8100b5510 2024-04-20T21:20:43.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.847+0000 7fd817600640 1 -- 172.21.15.71:0/1408322509 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd8100d0820 con 0x7fd8100b5510 2024-04-20T21:20:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.848+0000 7fd80cc00640 1 -- 172.21.15.71:0/1408322509 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fd808058e70 con 0x7fd8100b5510 2024-04-20T21:20:43.848 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:43.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.850+0000 7fd817600640 1 -- 172.21.15.71:0/1408322509 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd7ec06c920 msgr2=0x7fd7ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.850+0000 7fd817600640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd7ec06c920 0x7fd7ec06ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80013b0 tx=0x7fd7f80011c0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.851+0000 7fd817600640 1 -- 172.21.15.71:0/1408322509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8100b5510 msgr2=0x7fd8100b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:43.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.851+0000 7fd817600640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8100b5510 0x7fd8100b5990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd81008cc90 tx=0x7fd80800ec00 comp rx=0 tx=0).stop 2024-04-20T21:20:43.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.851+0000 7fd817600640 1 -- 172.21.15.71:0/1408322509 shutdown_connections 2024-04-20T21:20:43.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.851+0000 7fd817600640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd7ec06c920 0x7fd7ec06ede0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.851+0000 7fd817600640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8100b5510 0x7fd8100b5990 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.851+0000 7fd817600640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd810158270 0x7fd810157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.851+0000 7fd817600640 1 --2- 172.21.15.71:0/1408322509 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7f4003fb0 0x7fd8100cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:43.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.851+0000 7fd817600640 1 -- 172.21.15.71:0/1408322509 >> 172.21.15.71:0/1408322509 conn(0x7fd8100b99c0 msgr2=0x7fd8100b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:43.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.851+0000 7fd817600640 1 -- 172.21.15.71:0/1408322509 shutdown_connections 2024-04-20T21:20:43.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:43.851+0000 7fd817600640 1 -- 172.21.15.71:0/1408322509 wait complete. 2024-04-20T21:20:43.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:44.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.065+0000 7f486e200640 1 Processor -- start 2024-04-20T21:20:44.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.065+0000 7f486e200640 1 -- start start 2024-04-20T21:20:44.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.066+0000 7f486e200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4868156c20 0x7f486806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.067+0000 7f486e200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f486815ca40 0x7f48680ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.067+0000 7f486e200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4868141c60 con 0x7f48680ad8e0 2024-04-20T21:20:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.067+0000 7f486e200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f486815cf90 con 0x7f486815ca40 2024-04-20T21:20:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.067+0000 7f486e200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f486815d270 con 0x7f4868156c20 2024-04-20T21:20:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.067+0000 7f4867e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f48680ad8e0 0x7f48680d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33154/0 (socket says 172.21.15.71:33154) 2024-04-20T21:20:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.067+0000 7f4867e00640 1 -- 172.21.15.71:0/537438899 learned_addr learned my addr 172.21.15.71:0/537438899 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:44.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.067+0000 7f4866a00640 1 --2- 172.21.15.71:0/537438899 >> v2:172.21.15.71:3300/0 conn(0x7f486815ca40 0x7f48680ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.067+0000 7f4867400640 1 --2- 172.21.15.71:0/537438899 >> v2:172.21.15.137:3300/0 conn(0x7f4868156c20 0x7f486806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.067+0000 7f4866000640 1 -- 172.21.15.71:0/537438899 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3518269440 0 0) 0x7f4868141c60 con 0x7f48680ad8e0 2024-04-20T21:20:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.068+0000 7f4866000640 1 -- 172.21.15.71:0/537438899 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f484c003520 con 0x7f48680ad8e0 2024-04-20T21:20:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.068+0000 7f4866a00640 1 -- 172.21.15.71:0/537438899 >> v2:172.21.15.137:3300/0 conn(0x7f4868156c20 msgr2=0x7f486806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.068+0000 7f4866a00640 1 --2- 172.21.15.71:0/537438899 >> v2:172.21.15.137:3300/0 conn(0x7f4868156c20 0x7f486806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.068+0000 7f4866a00640 1 -- 172.21.15.71:0/537438899 >> v1:172.21.15.71:6789/0 conn(0x7f48680ad8e0 legacy=0x7f48680d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.068+0000 7f4866a00640 1 -- 172.21.15.71:0/537438899 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486815d550 con 0x7f486815ca40 2024-04-20T21:20:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.068+0000 7f4867400640 1 --2- 172.21.15.71:0/537438899 >> v2:172.21.15.137:3300/0 conn(0x7f4868156c20 0x7f486806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.069+0000 7f4866a00640 1 --2- 172.21.15.71:0/537438899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f486815ca40 0x7f48680ad3a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f486806fdc0 tx=0x7f485402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd61c2f46508db56 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.069+0000 7f4866000640 1 -- 172.21.15.71:0/537438899 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854035020 con 0x7f486815ca40 2024-04-20T21:20:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.069+0000 7f4866000640 1 -- 172.21.15.71:0/537438899 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4854031830 con 0x7f486815ca40 2024-04-20T21:20:44.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.069+0000 7f4866000640 1 -- 172.21.15.71:0/537438899 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854031c00 con 0x7f486815ca40 2024-04-20T21:20:44.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.070+0000 7f486e200640 1 -- 172.21.15.71:0/537438899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f486815ca40 msgr2=0x7f48680ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.070+0000 7f486e200640 1 --2- 172.21.15.71:0/537438899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f486815ca40 0x7f48680ad3a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f486806fdc0 tx=0x7f485402b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.070+0000 7f486e200640 1 -- 172.21.15.71:0/537438899 shutdown_connections 2024-04-20T21:20:44.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.070+0000 7f486e200640 1 --2- 172.21.15.71:0/537438899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f486815ca40 0x7f48680ad3a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.070+0000 7f486e200640 1 --2- 172.21.15.71:0/537438899 >> v2:172.21.15.137:3300/0 conn(0x7f4868156c20 0x7f486806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.070+0000 7f486e200640 1 -- 172.21.15.71:0/537438899 >> 172.21.15.71:0/537438899 conn(0x7f48680b3350 msgr2=0x7f48680b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:44.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.070+0000 7f486e200640 1 -- 172.21.15.71:0/537438899 shutdown_connections 2024-04-20T21:20:44.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.070+0000 7f486e200640 1 -- 172.21.15.71:0/537438899 wait complete. 2024-04-20T21:20:44.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.072+0000 7f486e200640 1 Processor -- start 2024-04-20T21:20:44.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.072+0000 7f486e200640 1 -- start start 2024-04-20T21:20:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.073+0000 7f486e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48680ad8e0 0x7f48681f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.073+0000 7f486e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4868156c20 0x7f48681605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.073+0000 7f486e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f486815ca40 0x7f4868072ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.073+0000 7f486e200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f486806bfc0 con 0x7f486815ca40 2024-04-20T21:20:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.073+0000 7f486e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f486806be40 con 0x7f48680ad8e0 2024-04-20T21:20:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.073+0000 7f486e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f48680d0a70 con 0x7f4868156c20 2024-04-20T21:20:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.073+0000 7f4867e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f486815ca40 0x7f4868072ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.073+0000 7f4867e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f486815ca40 0x7f4868072ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51866/0 (socket says 172.21.15.71:51866) 2024-04-20T21:20:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.073+0000 7f4867e00640 1 -- 172.21.15.71:0/647389906 learned_addr learned my addr 172.21.15.71:0/647389906 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.073+0000 7f4867400640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48680ad8e0 0x7f48681f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.074+0000 7f4867e00640 1 -- 172.21.15.71:0/647389906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4868156c20 msgr2=0x7f48681605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.074+0000 7f4867e00640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4868156c20 0x7f48681605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.074+0000 7f4867e00640 1 -- 172.21.15.71:0/647389906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48680ad8e0 msgr2=0x7f48681f7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.074+0000 7f4867e00640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48680ad8e0 0x7f48681f7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.074+0000 7f4867e00640 1 -- 172.21.15.71:0/647389906 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48680ccbd0 con 0x7f486815ca40 2024-04-20T21:20:44.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.074+0000 7f4867e00640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f486815ca40 0x7f4868072ba0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f486000caa0 tx=0x7f486000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:44.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.074+0000 7f485f400640 1 -- 172.21.15.71:0/647389906 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860017070 con 0x7f486815ca40 2024-04-20T21:20:44.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.074+0000 7f485f400640 1 -- 172.21.15.71:0/647389906 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486000ac00 con 0x7f486815ca40 2024-04-20T21:20:44.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.074+0000 7f485f400640 1 -- 172.21.15.71:0/647389906 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860012400 con 0x7f486815ca40 2024-04-20T21:20:44.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.074+0000 7f486e200640 1 -- 172.21.15.71:0/647389906 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48680cceb0 con 0x7f486815ca40 2024-04-20T21:20:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.074+0000 7f486e200640 1 -- 172.21.15.71:0/647389906 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48680cd470 con 0x7f486815ca40 2024-04-20T21:20:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.076+0000 7f486e200640 1 -- 172.21.15.71:0/647389906 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4868068980 con 0x7f486815ca40 2024-04-20T21:20:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.076+0000 7f485f400640 1 -- 172.21.15.71:0/647389906 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f486001a070 con 0x7f486815ca40 2024-04-20T21:20:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.077+0000 7f485f400640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f484806c8f0 0x7f484806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.077+0000 7f485f400640 1 -- 172.21.15.71:0/647389906 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f486008bc20 con 0x7f486815ca40 2024-04-20T21:20:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.077+0000 7f4867400640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f484806c8f0 0x7f484806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.078+0000 7f4867400640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f484806c8f0 0x7f484806edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4858008850 tx=0x7f4858008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:44.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.082+0000 7f485f400640 1 -- 172.21.15.71:0/647389906 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f48600595c0 con 0x7f486815ca40 2024-04-20T21:20:44.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.264+0000 7f486e200640 1 -- 172.21.15.71:0/647389906 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f48680cfd90 con 0x7f486815ca40 2024-04-20T21:20:44.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.265+0000 7f485f400640 1 -- 172.21.15.71:0/647389906 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f486005d8c0 con 0x7f486815ca40 2024-04-20T21:20:44.265 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 -- 172.21.15.71:0/647389906 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f484806c8f0 msgr2=0x7f484806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f484806c8f0 0x7f484806edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4858008850 tx=0x7f4858008040 comp rx=0 tx=0).stop 2024-04-20T21:20:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 -- 172.21.15.71:0/647389906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f486815ca40 msgr2=0x7f4868072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f486815ca40 0x7f4868072ba0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f486000caa0 tx=0x7f486000cf60 comp rx=0 tx=0).stop 2024-04-20T21:20:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 -- 172.21.15.71:0/647389906 shutdown_connections 2024-04-20T21:20:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f484806c8f0 0x7f484806edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f486815ca40 0x7f4868072ba0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4868156c20 0x7f48681605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 --2- 172.21.15.71:0/647389906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48680ad8e0 0x7f48681f7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 -- 172.21.15.71:0/647389906 >> 172.21.15.71:0/647389906 conn(0x7f48680b3350 msgr2=0x7f48681549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:44.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 -- 172.21.15.71:0/647389906 shutdown_connections 2024-04-20T21:20:44.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.268+0000 7f486e200640 1 -- 172.21.15.71:0/647389906 wait complete. 2024-04-20T21:20:44.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T21:20:44.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.479+0000 7f8fe5400640 1 Processor -- start 2024-04-20T21:20:44.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.480+0000 7f8fe5400640 1 -- start start 2024-04-20T21:20:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.481+0000 7f8fe5400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe0159e10 0x7f8fe0071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.481+0000 7f8fe5400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8fe006da90 0x7f8fe0071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.481+0000 7f8fe5400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe015cc90 con 0x7f8fe015a1f0 2024-04-20T21:20:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.481+0000 7f8fe5400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8fe0072900 con 0x7f8fe006da90 2024-04-20T21:20:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.481+0000 7f8fe5400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe015ca40 con 0x7f8fe0159e10 2024-04-20T21:20:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.482+0000 7f8fd7e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8fe015a1f0 0x7f8fe0160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33158/0 (socket says 172.21.15.71:33158) 2024-04-20T21:20:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.482+0000 7f8fd7e00640 1 -- 172.21.15.71:0/4209549555 learned_addr learned my addr 172.21.15.71:0/4209549555 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:44.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.482+0000 7f8fdfe00640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe0159e10 0x7f8fe0071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.482+0000 7f8fe4a00640 1 --2- 172.21.15.71:0/4209549555 >> v2:172.21.15.137:3300/0 conn(0x7f8fe006da90 0x7f8fe0071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.482+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808271217 0 0) 0x7f8fe015cc90 con 0x7f8fe015a1f0 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.482+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fc4003520 con 0x7f8fe015a1f0 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.482+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3289078072 0 0) 0x7f8fc4003520 con 0x7f8fe015a1f0 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe0159e10 msgr2=0x7f8fe0071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe0159e10 0x7f8fe0071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 >> v2:172.21.15.137:3300/0 conn(0x7f8fe006da90 msgr2=0x7f8fe0071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 --2- 172.21.15.71:0/4209549555 >> v2:172.21.15.137:3300/0 conn(0x7f8fe006da90 0x7f8fe0071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe015cf70 con 0x7f8fe015a1f0 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f8fc8001670 con 0x7f8fe015a1f0 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 >> v1:172.21.15.71:6789/0 conn(0x7f8fe015a1f0 legacy=0x7f8fe0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 0x7f8fc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc4004800 0x7f8fc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe0159e10 0x7f8fc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe015ca40 con 0x7f8fc40039b0 2024-04-20T21:20:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc400b9c0 con 0x7f8fc4004800 2024-04-20T21:20:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc400bb40 con 0x7f8fe0159e10 2024-04-20T21:20:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdfe00640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 0x7f8fc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fd7e00640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc4004800 0x7f8fc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdfe00640 1 -- 172.21.15.71:0/4209549555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe0159e10 msgr2=0x7f8fc40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdfe00640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe0159e10 0x7f8fc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdfe00640 1 -- 172.21.15.71:0/4209549555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc4004800 msgr2=0x7f8fc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.483+0000 7f8fdfe00640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc4004800 0x7f8fc4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.484+0000 7f8fdfe00640 1 -- 172.21.15.71:0/4209549555 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc4003520 con 0x7f8fc40039b0 2024-04-20T21:20:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.484+0000 7f8fd7e00640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc4004800 0x7f8fc4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:44.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.485+0000 7f8fdfe00640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 0x7f8fc4003dd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009ac0 tx=0x7f8fc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347d73a15e6fca53 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:44.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.485+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0039070 con 0x7f8fc40039b0 2024-04-20T21:20:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.485+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd002c710 con 0x7f8fc40039b0 2024-04-20T21:20:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.485+0000 7f8fdf400640 1 -- 172.21.15.71:0/4209549555 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0009690 con 0x7f8fc40039b0 2024-04-20T21:20:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.485+0000 7f8fe5400640 1 -- 172.21.15.71:0/4209549555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 msgr2=0x7f8fc4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.485+0000 7f8fe5400640 1 --2- 172.21.15.71:0/4209549555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 0x7f8fc4003dd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009ac0 tx=0x7f8fc4005830 comp rx=0 tx=0).stop 2024-04-20T21:20:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.485+0000 7f8fe4a00640 1 -- 172.21.15.71:0/4209549555 reap_dead start 2024-04-20T21:20:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.485+0000 7f8fe5400640 1 -- 172.21.15.71:0/4209549555 shutdown_connections 2024-04-20T21:20:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.485+0000 7f8fe5400640 1 -- 172.21.15.71:0/4209549555 >> 172.21.15.71:0/4209549555 conn(0x7f8fe00d0040 msgr2=0x7f8fe00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.486+0000 7f8fe5400640 1 -- 172.21.15.71:0/4209549555 shutdown_connections 2024-04-20T21:20:44.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.486+0000 7f8fe5400640 1 -- 172.21.15.71:0/4209549555 wait complete. 2024-04-20T21:20:44.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.487+0000 7f8fe5400640 1 Processor -- start 2024-04-20T21:20:44.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.487+0000 7f8fe5400640 1 -- start start 2024-04-20T21:20:44.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.488+0000 7f8fe5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 0x7f8fe0155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.488+0000 7f8fe5400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe014d6e0 0x7f8fe014f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.488+0000 7f8fe5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fe014f600 0x7f8fe015b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.488+0000 7f8fe5400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe015d810 con 0x7f8fc40039b0 2024-04-20T21:20:44.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.488+0000 7f8fe5400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe015d530 con 0x7f8fe014f600 2024-04-20T21:20:44.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.488+0000 7f8fe5400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe006b900 con 0x7f8fe014d6e0 2024-04-20T21:20:44.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.489+0000 7f8fdfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 0x7f8fe0155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.489+0000 7f8fdfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 0x7f8fe0155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51888/0 (socket says 172.21.15.71:51888) 2024-04-20T21:20:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.489+0000 7f8fdfe00640 1 -- 172.21.15.71:0/1577262067 learned_addr learned my addr 172.21.15.71:0/1577262067 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.489+0000 7f8fd7e00640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe014d6e0 0x7f8fe014f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.489+0000 7f8fe4a00640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fe014f600 0x7f8fe015b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.489+0000 7f8fdfe00640 1 -- 172.21.15.71:0/1577262067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe014d6e0 msgr2=0x7f8fe014f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.489+0000 7f8fdfe00640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe014d6e0 0x7f8fe014f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.489+0000 7f8fdfe00640 1 -- 172.21.15.71:0/1577262067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fe014f600 msgr2=0x7f8fe015b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.489+0000 7f8fdfe00640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fe014f600 0x7f8fe015b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.489+0000 7f8fdfe00640 1 -- 172.21.15.71:0/1577262067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe014ffe0 con 0x7f8fc40039b0 2024-04-20T21:20:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.489+0000 7f8fe4a00640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fe014f600 0x7f8fe015b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.490+0000 7f8fdfe00640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 0x7f8fe0155210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009be0 tx=0x7f8fd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.490+0000 7f8fdcc00640 1 -- 172.21.15.71:0/1577262067 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0039050 con 0x7f8fc40039b0 2024-04-20T21:20:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.490+0000 7f8fdcc00640 1 -- 172.21.15.71:0/1577262067 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd0045070 con 0x7f8fc40039b0 2024-04-20T21:20:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.490+0000 7f8fdcc00640 1 -- 172.21.15.71:0/1577262067 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0003a50 con 0x7f8fc40039b0 2024-04-20T21:20:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.490+0000 7f8fe5400640 1 -- 172.21.15.71:0/1577262067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe01502c0 con 0x7f8fc40039b0 2024-04-20T21:20:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.490+0000 7f8fe5400640 1 -- 172.21.15.71:0/1577262067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe009bc50 con 0x7f8fc40039b0 2024-04-20T21:20:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.491+0000 7f8fe5400640 1 -- 172.21.15.71:0/1577262067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe01507e0 con 0x7f8fc40039b0 2024-04-20T21:20:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.492+0000 7f8fdcc00640 1 -- 172.21.15.71:0/1577262067 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8fd0003bf0 con 0x7f8fc40039b0 2024-04-20T21:20:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.493+0000 7f8fdcc00640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8fbc06c920 0x7f8fbc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.493+0000 7f8fdcc00640 1 -- 172.21.15.71:0/1577262067 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f8fd00adb40 con 0x7f8fc40039b0 2024-04-20T21:20:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.493+0000 7f8fd7e00640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8fbc06c920 0x7f8fbc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.494+0000 7f8fd7e00640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8fbc06c920 0x7f8fbc06ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80017e0 tx=0x7f8fc8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.497+0000 7f8fdcc00640 1 -- 172.21.15.71:0/1577262067 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8fd004e020 con 0x7f8fc40039b0 2024-04-20T21:20:44.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.711+0000 7f8fe5400640 1 -- 172.21.15.71:0/1577262067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8fe009ba40 con 0x7f8fc40039b0 2024-04-20T21:20:44.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.712+0000 7f8fdcc00640 1 -- 172.21.15.71:0/1577262067 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f8fd007bab0 con 0x7f8fc40039b0 2024-04-20T21:20:44.712 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2024-04-20T21:20:44.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 -- 172.21.15.71:0/1577262067 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8fbc06c920 msgr2=0x7f8fbc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8fbc06c920 0x7f8fbc06ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80017e0 tx=0x7f8fc8009040 comp rx=0 tx=0).stop 2024-04-20T21:20:44.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 -- 172.21.15.71:0/1577262067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 msgr2=0x7f8fe0155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:44.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 0x7f8fe0155210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009be0 tx=0x7f8fd0004730 comp rx=0 tx=0).stop 2024-04-20T21:20:44.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 -- 172.21.15.71:0/1577262067 shutdown_connections 2024-04-20T21:20:44.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f8fbc06c920 0x7f8fbc06ede0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fe014f600 0x7f8fe015b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fe014d6e0 0x7f8fe014f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 --2- 172.21.15.71:0/1577262067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fc40039b0 0x7f8fe0155210 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:44.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 -- 172.21.15.71:0/1577262067 >> 172.21.15.71:0/1577262067 conn(0x7f8fe00d0040 msgr2=0x7f8fe0072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:44.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 -- 172.21.15.71:0/1577262067 shutdown_connections 2024-04-20T21:20:44.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:44.715+0000 7f8fe5400640 1 -- 172.21.15.71:0/1577262067 wait complete. 2024-04-20T21:20:44.733 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi137.front.sepia.ceph.com... 2024-04-20T21:20:44.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:44.733 DEBUG:teuthology.orchestra.run.smithi137:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-20T21:20:44.824 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T21:20:44.824 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-20T21:20:44.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:44.825 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-20T21:20:44.884 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:20:44.885 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:44.941 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:20:44.941 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:44.998 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.192+0000 7f0605600640 1 Processor -- start 2024-04-20T21:20:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.192+0000 7f0605600640 1 -- start start 2024-04-20T21:20:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.193+0000 7f0605600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f060015b3b0 0x7f060006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.193+0000 7f0605600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06000d0360 0x7f06000d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.194+0000 7f0605600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06000ade40 con 0x7f060006dcb0 2024-04-20T21:20:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.194+0000 7f0605600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f06000ae0e0 con 0x7f06000d0360 2024-04-20T21:20:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.194+0000 7f0605600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f06000d0cf0 con 0x7f060015b3b0 2024-04-20T21:20:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.194+0000 7f05ff400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06000d0360 0x7f06000d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.194+0000 7f05ff400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06000d0360 0x7f06000d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51904/0 (socket says 172.21.15.71:51904) 2024-04-20T21:20:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.194+0000 7f05ff400640 1 -- 172.21.15.71:0/3327603360 learned_addr learned my addr 172.21.15.71:0/3327603360 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.194+0000 7f05fea00640 1 --2- 172.21.15.71:0/3327603360 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f060015b3b0 0x7f060006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.195+0000 7f05ff400640 1 -- 172.21.15.71:0/3327603360 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f060015b3b0 msgr2=0x7f060006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.195+0000 7f05ff400640 1 --2- 172.21.15.71:0/3327603360 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f060015b3b0 0x7f060006eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.195+0000 7f05ff400640 1 -- 172.21.15.71:0/3327603360 >> v1:172.21.15.137:6789/0 conn(0x7f060006dcb0 legacy=0x7f0600071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.195+0000 7f05ff400640 1 -- 172.21.15.71:0/3327603360 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060015b790 con 0x7f06000d0360 2024-04-20T21:20:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.196+0000 7f05ff400640 1 --2- 172.21.15.71:0/3327603360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06000d0360 0x7f06000d07b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f05f800bb10 tx=0x7f05f802e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568e0743b2c84bb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.196+0000 7f05fe000640 1 -- 172.21.15.71:0/3327603360 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f803b070 con 0x7f06000d0360 2024-04-20T21:20:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.196+0000 7f05fe000640 1 -- 172.21.15.71:0/3327603360 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f8036440 con 0x7f06000d0360 2024-04-20T21:20:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.196+0000 7f05fe000640 1 -- 172.21.15.71:0/3327603360 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8036810 con 0x7f06000d0360 2024-04-20T21:20:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.197+0000 7f0605600640 1 -- 172.21.15.71:0/3327603360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06000d0360 msgr2=0x7f06000d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:45.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.197+0000 7f0605600640 1 --2- 172.21.15.71:0/3327603360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06000d0360 0x7f06000d07b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f05f800bb10 tx=0x7f05f802e0c0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.197+0000 7f0605600640 1 -- 172.21.15.71:0/3327603360 shutdown_connections 2024-04-20T21:20:45.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.197+0000 7f0605600640 1 --2- 172.21.15.71:0/3327603360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06000d0360 0x7f06000d07b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.197+0000 7f0605600640 1 --2- 172.21.15.71:0/3327603360 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f060015b3b0 0x7f060006eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.197+0000 7f0605600640 1 -- 172.21.15.71:0/3327603360 >> 172.21.15.71:0/3327603360 conn(0x7f06000b3350 msgr2=0x7f06000b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:45.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.197+0000 7f0605600640 1 -- 172.21.15.71:0/3327603360 shutdown_connections 2024-04-20T21:20:45.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.197+0000 7f0605600640 1 -- 172.21.15.71:0/3327603360 wait complete. 2024-04-20T21:20:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.199+0000 7f0605600640 1 Processor -- start 2024-04-20T21:20:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.199+0000 7f0605600640 1 -- start start 2024-04-20T21:20:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.200+0000 7f0605600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f060006dcb0 0x7f06001f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.200+0000 7f0605600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06000d0360 0x7f060015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.200+0000 7f0605600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f060015b3b0 0x7f0600152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.200+0000 7f0605600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06000ae660 con 0x7f06000d0360 2024-04-20T21:20:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.200+0000 7f0605600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06000ae380 con 0x7f060006dcb0 2024-04-20T21:20:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.200+0000 7f0605600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f06000ae940 con 0x7f060015b3b0 2024-04-20T21:20:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.200+0000 7f05ff400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f060015b3b0 0x7f0600152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.200+0000 7f05f6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06000d0360 0x7f060015cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.200+0000 7f05f6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06000d0360 0x7f060015cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51908/0 (socket says 172.21.15.71:51908) 2024-04-20T21:20:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.200+0000 7f05ff400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f060015b3b0 0x7f0600152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:48662/0 (socket says 172.21.15.71:48662) 2024-04-20T21:20:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.200+0000 7f05f6000640 1 -- 172.21.15.71:0/4134405456 learned_addr learned my addr 172.21.15.71:0/4134405456 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.201+0000 7f05fea00640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f060006dcb0 0x7f06001f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.201+0000 7f05f6000640 1 -- 172.21.15.71:0/4134405456 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f060015b3b0 msgr2=0x7f0600152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.201+0000 7f05f6000640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f060015b3b0 0x7f0600152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.201+0000 7f05f6000640 1 -- 172.21.15.71:0/4134405456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f060006dcb0 msgr2=0x7f06001f8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.201+0000 7f05f6000640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f060006dcb0 0x7f06001f8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.201+0000 7f05f6000640 1 -- 172.21.15.71:0/4134405456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0600153200 con 0x7f06000d0360 2024-04-20T21:20:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.201+0000 7f05f6000640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06000d0360 0x7f060015cfd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f05e800ba80 tx=0x7f05e800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.201+0000 7f05f7400640 1 -- 172.21.15.71:0/4134405456 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e800cc00 con 0x7f06000d0360 2024-04-20T21:20:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.201+0000 7f05f7400640 1 -- 172.21.15.71:0/4134405456 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e800cda0 con 0x7f06000d0360 2024-04-20T21:20:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.201+0000 7f05f7400640 1 -- 172.21.15.71:0/4134405456 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8003bb0 con 0x7f06000d0360 2024-04-20T21:20:45.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.201+0000 7f0605600640 1 -- 172.21.15.71:0/4134405456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06001f8110 con 0x7f06000d0360 2024-04-20T21:20:45.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.202+0000 7f0605600640 1 -- 172.21.15.71:0/4134405456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06001f86d0 con 0x7f06000d0360 2024-04-20T21:20:45.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.203+0000 7f0605600640 1 -- 172.21.15.71:0/4134405456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06001f88d0 con 0x7f06000d0360 2024-04-20T21:20:45.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.204+0000 7f05f7400640 1 -- 172.21.15.71:0/4134405456 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05e8014440 con 0x7f06000d0360 2024-04-20T21:20:45.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.204+0000 7f05f7400640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05dc06c8f0 0x7f05dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.205+0000 7f05f7400640 1 -- 172.21.15.71:0/4134405456 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f05e808beb0 con 0x7f06000d0360 2024-04-20T21:20:45.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.205+0000 7f05fea00640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05dc06c8f0 0x7f05dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.205+0000 7f05fea00640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05dc06c8f0 0x7f05dc06edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05f0006fd0 tx=0x7f05f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.209+0000 7f05f7400640 1 -- 172.21.15.71:0/4134405456 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f06001f88d0 con 0x7f06000d0360 2024-04-20T21:20:45.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.409+0000 7f0605600640 1 -- 172.21.15.71:0/4134405456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0600068980 con 0x7f06000d0360 2024-04-20T21:20:45.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.411+0000 7f05f7400640 1 -- 172.21.15.71:0/4134405456 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7f05e80597d0 con 0x7f06000d0360 2024-04-20T21:20:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:45.411 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:45.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 -- 172.21.15.71:0/4134405456 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05dc06c8f0 msgr2=0x7f05dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05dc06c8f0 0x7f05dc06edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05f0006fd0 tx=0x7f05f0008040 comp rx=0 tx=0).stop 2024-04-20T21:20:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 -- 172.21.15.71:0/4134405456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06000d0360 msgr2=0x7f060015cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06000d0360 0x7f060015cfd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f05e800ba80 tx=0x7f05e800bf40 comp rx=0 tx=0).stop 2024-04-20T21:20:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 -- 172.21.15.71:0/4134405456 shutdown_connections 2024-04-20T21:20:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f05dc06c8f0 0x7f05dc06edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f060015b3b0 0x7f0600152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06000d0360 0x7f060015cfd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 --2- 172.21.15.71:0/4134405456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f060006dcb0 0x7f06001f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 -- 172.21.15.71:0/4134405456 >> 172.21.15.71:0/4134405456 conn(0x7f06000b3350 msgr2=0x7f06000b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 -- 172.21.15.71:0/4134405456 shutdown_connections 2024-04-20T21:20:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.414+0000 7f0605600640 1 -- 172.21.15.71:0/4134405456 wait complete. 2024-04-20T21:20:45.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:45.433 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:45.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.643+0000 7f5bdbe00640 1 Processor -- start 2024-04-20T21:20:45.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.643+0000 7f5bdbe00640 1 -- start start 2024-04-20T21:20:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.644+0000 7f5bdbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5bdc0b49f0 0x7f5bdc15d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.644+0000 7f5bdbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bdc15d5c0 0x7f5bdc072a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.644+0000 7f5bdbe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bdc160690 con 0x7f5bdc0b4610 2024-04-20T21:20:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.644+0000 7f5bdbe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5bdc160970 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.644+0000 7f5bdbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5bdc160c50 con 0x7f5bdc15d5c0 2024-04-20T21:20:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.645+0000 7f5bdaa00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5bdc0b4610 0x7f5bdc15fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:39064/0 (socket says 172.21.15.71:39064) 2024-04-20T21:20:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.645+0000 7f5bdaa00640 1 -- 172.21.15.71:0/1119424351 learned_addr learned my addr 172.21.15.71:0/1119424351 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:45.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.645+0000 7f5bdb400640 1 --2- 172.21.15.71:0/1119424351 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bdc15d5c0 0x7f5bdc072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.645+0000 7f5bd3e00640 1 --2- 172.21.15.71:0/1119424351 >> v2:172.21.15.137:3300/0 conn(0x7f5bdc0b49f0 0x7f5bdc15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.646+0000 7f5bdb400640 1 -- 172.21.15.71:0/1119424351 >> v2:172.21.15.137:3300/0 conn(0x7f5bdc0b49f0 msgr2=0x7f5bdc15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:45.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.646+0000 7f5bdb400640 1 --2- 172.21.15.71:0/1119424351 >> v2:172.21.15.137:3300/0 conn(0x7f5bdc0b49f0 0x7f5bdc15d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.646+0000 7f5bdb400640 1 -- 172.21.15.71:0/1119424351 >> v1:172.21.15.137:6789/0 conn(0x7f5bdc0b4610 legacy=0x7f5bdc15fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:45.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.646+0000 7f5bdb400640 1 -- 172.21.15.71:0/1119424351 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bdc15cb60 con 0x7f5bdc15d5c0 2024-04-20T21:20:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.647+0000 7f5bdb400640 1 --2- 172.21.15.71:0/1119424351 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bdc15d5c0 0x7f5bdc072a20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009d90 tx=0x7f5bd402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b0f7ad55e5571af server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.648+0000 7f5bda000640 1 -- 172.21.15.71:0/1119424351 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4039070 con 0x7f5bdc15d5c0 2024-04-20T21:20:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.648+0000 7f5bda000640 1 -- 172.21.15.71:0/1119424351 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd402cc50 con 0x7f5bdc15d5c0 2024-04-20T21:20:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.648+0000 7f5bda000640 1 -- 172.21.15.71:0/1119424351 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4034440 con 0x7f5bdc15d5c0 2024-04-20T21:20:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.648+0000 7f5bdbe00640 1 -- 172.21.15.71:0/1119424351 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bdc15d5c0 msgr2=0x7f5bdc072a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.648+0000 7f5bdbe00640 1 --2- 172.21.15.71:0/1119424351 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bdc15d5c0 0x7f5bdc072a20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009d90 tx=0x7f5bd402bea0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.649+0000 7f5bdbe00640 1 -- 172.21.15.71:0/1119424351 shutdown_connections 2024-04-20T21:20:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.649+0000 7f5bdbe00640 1 --2- 172.21.15.71:0/1119424351 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bdc15d5c0 0x7f5bdc072a20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.649+0000 7f5bdbe00640 1 --2- 172.21.15.71:0/1119424351 >> v2:172.21.15.137:3300/0 conn(0x7f5bdc0b49f0 0x7f5bdc15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.649+0000 7f5bdbe00640 1 -- 172.21.15.71:0/1119424351 >> 172.21.15.71:0/1119424351 conn(0x7f5bdc0cdbc0 msgr2=0x7f5bdc0cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.649+0000 7f5bdbe00640 1 -- 172.21.15.71:0/1119424351 shutdown_connections 2024-04-20T21:20:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.649+0000 7f5bdbe00640 1 -- 172.21.15.71:0/1119424351 wait complete. 2024-04-20T21:20:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.650+0000 7f5bdbe00640 1 Processor -- start 2024-04-20T21:20:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.651+0000 7f5bdbe00640 1 -- start start 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.651+0000 7f5bdbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bdc0b4610 0x7f5bdc142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.651+0000 7f5bdbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bdc0b49f0 0x7f5bdc14f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bdbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bdc15d5c0 0x7f5bdc15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bdbe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc0b5020 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bdbe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc0b4ea0 con 0x7f5bdc15d5c0 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bdbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5bdc072f60 con 0x7f5bdc0b4610 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bd3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bdc0b49f0 0x7f5bdc14f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bd3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bdc0b49f0 0x7f5bdc14f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51916/0 (socket says 172.21.15.71:51916) 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bd3e00640 1 -- 172.21.15.71:0/3409026735 learned_addr learned my addr 172.21.15.71:0/3409026735 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bdb400640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bdc15d5c0 0x7f5bdc15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bdaa00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bdc0b4610 0x7f5bdc142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bd3e00640 1 -- 172.21.15.71:0/3409026735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bdc0b4610 msgr2=0x7f5bdc142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bd3e00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bdc0b4610 0x7f5bdc142bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bd3e00640 1 -- 172.21.15.71:0/3409026735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bdc15d5c0 msgr2=0x7f5bdc15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bd3e00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bdc15d5c0 0x7f5bdc15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bd3e00640 1 -- 172.21.15.71:0/3409026735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bdc152060 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.652+0000 7f5bdb400640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bdc15d5c0 0x7f5bdc15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.653+0000 7f5bd3e00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bdc0b49f0 0x7f5bdc14f690 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400e9b0 tx=0x7f5bc400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.653+0000 7f5bd3400640 1 -- 172.21.15.71:0/3409026735 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4017070 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.653+0000 7f5bd3400640 1 -- 172.21.15.71:0/3409026735 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc400c9a0 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.653+0000 7f5bdbe00640 1 -- 172.21.15.71:0/3409026735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bdc14fbd0 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.653+0000 7f5bd3400640 1 -- 172.21.15.71:0/3409026735 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc400cd90 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.653+0000 7f5bdbe00640 1 -- 172.21.15.71:0/3409026735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bdc151730 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.654+0000 7f5bdbe00640 1 -- 172.21.15.71:0/3409026735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bdc075b30 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.655+0000 7f5bd3400640 1 -- 172.21.15.71:0/3409026735 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5bc401a070 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.656+0000 7f5bd3400640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5bb806c8f0 0x7f5bb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.656+0000 7f5bd3400640 1 -- 172.21.15.71:0/3409026735 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f5bc408bf30 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.657+0000 7f5bdaa00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5bb806c8f0 0x7f5bb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:45.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.657+0000 7f5bdaa00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5bb806c8f0 0x7f5bb806edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc000f60 tx=0x7f5bcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.661+0000 7f5bd3400640 1 -- 172.21.15.71:0/3409026735 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5bc4059fd0 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.860+0000 7f5bdbe00640 1 -- 172.21.15.71:0/3409026735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5bdc0b5280 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.861+0000 7f5bd3400640 1 -- 172.21.15.71:0/3409026735 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f5bc40598d0 con 0x7f5bdc0b49f0 2024-04-20T21:20:45.861 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:45.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 -- 172.21.15.71:0/3409026735 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5bb806c8f0 msgr2=0x7f5bb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:45.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5bb806c8f0 0x7f5bb806edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc000f60 tx=0x7f5bcc009040 comp rx=0 tx=0).stop 2024-04-20T21:20:45.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 -- 172.21.15.71:0/3409026735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bdc0b49f0 msgr2=0x7f5bdc14f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:45.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bdc0b49f0 0x7f5bdc14f690 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400e9b0 tx=0x7f5bc400ee70 comp rx=0 tx=0).stop 2024-04-20T21:20:45.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 -- 172.21.15.71:0/3409026735 shutdown_connections 2024-04-20T21:20:45.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5bb806c8f0 0x7f5bb806edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bdc15d5c0 0x7f5bdc15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bdc0b49f0 0x7f5bdc14f690 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 --2- 172.21.15.71:0/3409026735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bdc0b4610 0x7f5bdc142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:45.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 -- 172.21.15.71:0/3409026735 >> 172.21.15.71:0/3409026735 conn(0x7f5bdc0cdbc0 msgr2=0x7f5bdc06c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:45.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 -- 172.21.15.71:0/3409026735 shutdown_connections 2024-04-20T21:20:45.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:45.864+0000 7f5bdbe00640 1 -- 172.21.15.71:0/3409026735 wait complete. 2024-04-20T21:20:45.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:46.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.084+0000 7f3863e00640 1 Processor -- start 2024-04-20T21:20:46.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.084+0000 7f3863e00640 1 -- start start 2024-04-20T21:20:46.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.085+0000 7f3863e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f386415b1f0 0x7f386415f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.085+0000 7f3863e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f38640d0010 0x7f38640adc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.085+0000 7f3863e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386415b5d0 con 0x7f38640ae140 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.085+0000 7f3863e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f386406e730 con 0x7f386415b1f0 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.085+0000 7f3863e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f38640d05d0 con 0x7f38640d0010 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.086+0000 7f3862a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f386415b1f0 0x7f386415f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.086+0000 7f3862a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f386415b1f0 0x7f386415f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51924/0 (socket says 172.21.15.71:51924) 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.086+0000 7f3862a00640 1 -- 172.21.15.71:0/2511643546 learned_addr learned my addr 172.21.15.71:0/2511643546 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.086+0000 7f3862000640 1 --2- 172.21.15.71:0/2511643546 >> v2:172.21.15.137:3300/0 conn(0x7f38640d0010 0x7f38640adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.086+0000 7f3862a00640 1 -- 172.21.15.71:0/2511643546 >> v2:172.21.15.137:3300/0 conn(0x7f38640d0010 msgr2=0x7f38640adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.086+0000 7f3862a00640 1 --2- 172.21.15.71:0/2511643546 >> v2:172.21.15.137:3300/0 conn(0x7f38640d0010 0x7f38640adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.086+0000 7f3862a00640 1 -- 172.21.15.71:0/2511643546 >> v1:172.21.15.137:6789/0 conn(0x7f38640ae140 legacy=0x7f386406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.086+0000 7f3862a00640 1 -- 172.21.15.71:0/2511643546 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386415fc70 con 0x7f386415b1f0 2024-04-20T21:20:46.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.087+0000 7f3862a00640 1 --2- 172.21.15.71:0/2511643546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f386415b1f0 0x7f386415f730 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f385400bb10 tx=0x7f385402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59dad054f20eda3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.090+0000 7f3861600640 1 -- 172.21.15.71:0/2511643546 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385403b070 con 0x7f386415b1f0 2024-04-20T21:20:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.090+0000 7f3861600640 1 -- 172.21.15.71:0/2511643546 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385402ee00 con 0x7f386415b1f0 2024-04-20T21:20:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.090+0000 7f3861600640 1 -- 172.21.15.71:0/2511643546 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854036660 con 0x7f386415b1f0 2024-04-20T21:20:46.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.090+0000 7f3863e00640 1 -- 172.21.15.71:0/2511643546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f386415b1f0 msgr2=0x7f386415f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.090+0000 7f3863e00640 1 --2- 172.21.15.71:0/2511643546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f386415b1f0 0x7f386415f730 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f385400bb10 tx=0x7f385402e050 comp rx=0 tx=0).stop 2024-04-20T21:20:46.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.091+0000 7f3863e00640 1 -- 172.21.15.71:0/2511643546 shutdown_connections 2024-04-20T21:20:46.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.091+0000 7f3863e00640 1 --2- 172.21.15.71:0/2511643546 >> v2:172.21.15.137:3300/0 conn(0x7f38640d0010 0x7f38640adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.091+0000 7f3863e00640 1 --2- 172.21.15.71:0/2511643546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f386415b1f0 0x7f386415f730 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.091+0000 7f3863e00640 1 -- 172.21.15.71:0/2511643546 >> 172.21.15.71:0/2511643546 conn(0x7f38640b5270 msgr2=0x7f38640b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:46.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.091+0000 7f3863e00640 1 -- 172.21.15.71:0/2511643546 shutdown_connections 2024-04-20T21:20:46.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.091+0000 7f3863e00640 1 -- 172.21.15.71:0/2511643546 wait complete. 2024-04-20T21:20:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.092+0000 7f3863e00640 1 Processor -- start 2024-04-20T21:20:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.092+0000 7f3863e00640 1 -- start start 2024-04-20T21:20:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.093+0000 7f3863e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38640ae140 0x7f3864147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.093+0000 7f3863e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38640d0010 0x7f386409d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.093+0000 7f3863e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f386415b1f0 0x7f3864099580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.093+0000 7f3863e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f38640d0e70 con 0x7f386415b1f0 2024-04-20T21:20:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.093+0000 7f3863e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f38640d0b90 con 0x7f38640d0010 2024-04-20T21:20:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.093+0000 7f3863e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f386406d120 con 0x7f38640ae140 2024-04-20T21:20:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.094+0000 7f3863400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f386415b1f0 0x7f3864099580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.094+0000 7f3863400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f386415b1f0 0x7f3864099580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51926/0 (socket says 172.21.15.71:51926) 2024-04-20T21:20:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.094+0000 7f3863400640 1 -- 172.21.15.71:0/2798590207 learned_addr learned my addr 172.21.15.71:0/2798590207 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.094+0000 7f3862a00640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38640ae140 0x7f3864147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.094+0000 7f3862000640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38640d0010 0x7f386409d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.094+0000 7f3863400640 1 -- 172.21.15.71:0/2798590207 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38640ae140 msgr2=0x7f3864147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.094+0000 7f3863400640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38640ae140 0x7f3864147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.094+0000 7f3863400640 1 -- 172.21.15.71:0/2798590207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38640d0010 msgr2=0x7f386409d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.094+0000 7f3863400640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38640d0010 0x7f386409d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.094+0000 7f3863400640 1 -- 172.21.15.71:0/2798590207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386409c480 con 0x7f386415b1f0 2024-04-20T21:20:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.094+0000 7f3862000640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38640d0010 0x7f386409d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.095+0000 7f3863400640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f386415b1f0 0x7f3864099580 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c780 tx=0x7f385c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.095+0000 7f385b400640 1 -- 172.21.15.71:0/2798590207 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c017070 con 0x7f386415b1f0 2024-04-20T21:20:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.095+0000 7f385b400640 1 -- 172.21.15.71:0/2798590207 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c003da0 con 0x7f386415b1f0 2024-04-20T21:20:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.095+0000 7f385b400640 1 -- 172.21.15.71:0/2798590207 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c0052b0 con 0x7f386415b1f0 2024-04-20T21:20:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.095+0000 7f3863e00640 1 -- 172.21.15.71:0/2798590207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386409c760 con 0x7f386415b1f0 2024-04-20T21:20:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.095+0000 7f3863e00640 1 -- 172.21.15.71:0/2798590207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386409cd20 con 0x7f386415b1f0 2024-04-20T21:20:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.096+0000 7f3863e00640 1 -- 172.21.15.71:0/2798590207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3864075b30 con 0x7f386415b1f0 2024-04-20T21:20:46.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.097+0000 7f385b400640 1 -- 172.21.15.71:0/2798590207 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f385c005450 con 0x7f386415b1f0 2024-04-20T21:20:46.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.098+0000 7f385b400640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384406c8f0 0x7f384406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.098+0000 7f385b400640 1 -- 172.21.15.71:0/2798590207 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f385c08b5e0 con 0x7f386415b1f0 2024-04-20T21:20:46.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.098+0000 7f3862a00640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384406c8f0 0x7f384406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.099+0000 7f3862a00640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384406c8f0 0x7f384406edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3854038000 tx=0x7f3854008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:46.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.104+0000 7f385b400640 1 -- 172.21.15.71:0/2798590207 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f385c059550 con 0x7f386415b1f0 2024-04-20T21:20:46.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.307+0000 7f3863e00640 1 -- 172.21.15.71:0/2798590207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f38640b29a0 con 0x7f386415b1f0 2024-04-20T21:20:46.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.308+0000 7f385b400640 1 -- 172.21.15.71:0/2798590207 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f385c058e50 con 0x7f386415b1f0 2024-04-20T21:20:46.307 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:46.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.310+0000 7f3863e00640 1 -- 172.21.15.71:0/2798590207 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384406c8f0 msgr2=0x7f384406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.310+0000 7f3863e00640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384406c8f0 0x7f384406edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3854038000 tx=0x7f3854008040 comp rx=0 tx=0).stop 2024-04-20T21:20:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.310+0000 7f3863e00640 1 -- 172.21.15.71:0/2798590207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f386415b1f0 msgr2=0x7f3864099580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.310+0000 7f3863e00640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f386415b1f0 0x7f3864099580 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c780 tx=0x7f385c00cc40 comp rx=0 tx=0).stop 2024-04-20T21:20:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.311+0000 7f3863e00640 1 -- 172.21.15.71:0/2798590207 shutdown_connections 2024-04-20T21:20:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.311+0000 7f3863e00640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384406c8f0 0x7f384406edb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.311+0000 7f3863e00640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f386415b1f0 0x7f3864099580 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.311+0000 7f3863e00640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38640d0010 0x7f386409d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.311+0000 7f3863e00640 1 --2- 172.21.15.71:0/2798590207 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38640ae140 0x7f3864147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.311+0000 7f3863e00640 1 -- 172.21.15.71:0/2798590207 >> 172.21.15.71:0/2798590207 conn(0x7f38640b5270 msgr2=0x7f38640b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.311+0000 7f3863e00640 1 -- 172.21.15.71:0/2798590207 shutdown_connections 2024-04-20T21:20:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.311+0000 7f3863e00640 1 -- 172.21.15.71:0/2798590207 wait complete. 2024-04-20T21:20:46.329 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:46.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.535+0000 7f4c2be00640 1 Processor -- start 2024-04-20T21:20:46.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.535+0000 7f4c2be00640 1 -- start start 2024-04-20T21:20:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.536+0000 7f4c2be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c15af80 0x7f4c2c071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.536+0000 7f4c2be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4c2c0cb570 0x7f4c2c06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.537+0000 7f4c2be00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c2c06f3b0 con 0x7f4c2c15b360 2024-04-20T21:20:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.537+0000 7f4c2be00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4c2c09e150 con 0x7f4c2c0cb570 2024-04-20T21:20:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.537+0000 7f4c2be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2c06f180 con 0x7f4c2c15af80 2024-04-20T21:20:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.537+0000 7f4c23e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4c2c15b360 0x7f4c2c0cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33162/0 (socket says 172.21.15.71:33162) 2024-04-20T21:20:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.537+0000 7f4c23e00640 1 -- 172.21.15.71:0/810979734 learned_addr learned my addr 172.21.15.71:0/810979734 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.537+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2204832866 0 0) 0x7f4c2c06f3b0 con 0x7f4c2c15b360 2024-04-20T21:20:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.537+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c10005730 con 0x7f4c2c15b360 2024-04-20T21:20:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.537+0000 7f4c2aa00640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c15af80 0x7f4c2c071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.537+0000 7f4c2b400640 1 --2- 172.21.15.71:0/810979734 >> v2:172.21.15.137:3300/0 conn(0x7f4c2c0cb570 0x7f4c2c06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 298442906 0 0) 0x7f4c10005730 con 0x7f4c2c15b360 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c15af80 msgr2=0x7f4c2c071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c15af80 0x7f4c2c071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 >> v2:172.21.15.137:3300/0 conn(0x7f4c2c0cb570 msgr2=0x7f4c2c06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 --2- 172.21.15.71:0/810979734 >> v2:172.21.15.137:3300/0 conn(0x7f4c2c0cb570 0x7f4c2c06ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2c06f690 con 0x7f4c2c15b360 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f4c14001670 con 0x7f4c2c15b360 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 >> v1:172.21.15.71:6789/0 conn(0x7f4c2c15b360 legacy=0x7f4c2c0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c15af80 0x7f4c10005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c10006240 0x7f4c10006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c10006f50 0x7f4c100073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c09e150 con 0x7f4c10006f50 2024-04-20T21:20:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1000dd60 con 0x7f4c10006240 2024-04-20T21:20:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1000df60 con 0x7f4c2c15af80 2024-04-20T21:20:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2b400640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c10006f50 0x7f4c100073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.538+0000 7f4c2aa00640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c15af80 0x7f4c10005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.539+0000 7f4c23e00640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c10006240 0x7f4c10006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.539+0000 7f4c2b400640 1 -- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c15af80 msgr2=0x7f4c10005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.539+0000 7f4c2b400640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c15af80 0x7f4c10005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.539+0000 7f4c2b400640 1 -- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c10006240 msgr2=0x7f4c10006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.539+0000 7f4c2b400640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c10006240 0x7f4c10006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.539+0000 7f4c2b400640 1 -- 172.21.15.71:0/810979734 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c10005730 con 0x7f4c10006f50 2024-04-20T21:20:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.539+0000 7f4c23e00640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c10006240 0x7f4c10006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.540+0000 7f4c2b400640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c10006f50 0x7f4c100073d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4c24007330 tx=0x7f4c10007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d77c2452d2a650 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.540+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24039070 con 0x7f4c10006f50 2024-04-20T21:20:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.540+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2402ccd0 con 0x7f4c10006f50 2024-04-20T21:20:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.540+0000 7f4c2a000640 1 -- 172.21.15.71:0/810979734 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24009be0 con 0x7f4c10006f50 2024-04-20T21:20:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.541+0000 7f4c2be00640 1 -- 172.21.15.71:0/810979734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c10006f50 msgr2=0x7f4c100073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.541+0000 7f4c2be00640 1 --2- 172.21.15.71:0/810979734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c10006f50 0x7f4c100073d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4c24007330 tx=0x7f4c10007a40 comp rx=0 tx=0).stop 2024-04-20T21:20:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.541+0000 7f4c2b400640 1 -- 172.21.15.71:0/810979734 reap_dead start 2024-04-20T21:20:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.541+0000 7f4c2be00640 1 -- 172.21.15.71:0/810979734 shutdown_connections 2024-04-20T21:20:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.541+0000 7f4c2be00640 1 -- 172.21.15.71:0/810979734 >> 172.21.15.71:0/810979734 conn(0x7f4c2c0cffa0 msgr2=0x7f4c2c0d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.541+0000 7f4c2be00640 1 -- 172.21.15.71:0/810979734 shutdown_connections 2024-04-20T21:20:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.541+0000 7f4c2be00640 1 -- 172.21.15.71:0/810979734 wait complete. 2024-04-20T21:20:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.542+0000 7f4c2be00640 1 Processor -- start 2024-04-20T21:20:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.543+0000 7f4c2be00640 1 -- start start 2024-04-20T21:20:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.543+0000 7f4c2be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c10006f50 0x7f4c2c148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c158e00 0x7f4c2c0b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c159280 0x7f4c2c0b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c0ad480 con 0x7f4c2c159280 2024-04-20T21:20:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c0acf50 con 0x7f4c10006f50 2024-04-20T21:20:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2c0ca910 con 0x7f4c2c158e00 2024-04-20T21:20:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c159280 0x7f4c2c0b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c159280 0x7f4c2c0b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51942/0 (socket says 172.21.15.71:51942) 2024-04-20T21:20:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2b400640 1 -- 172.21.15.71:0/815706975 learned_addr learned my addr 172.21.15.71:0/815706975 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2b400640 1 -- 172.21.15.71:0/815706975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c158e00 msgr2=0x7f4c2c0b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2aa00640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c10006f50 0x7f4c2c148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c23e00640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c158e00 0x7f4c2c0b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2b400640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c158e00 0x7f4c2c0b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2b400640 1 -- 172.21.15.71:0/815706975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c10006f50 msgr2=0x7f4c2c148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2b400640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c10006f50 0x7f4c2c148a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.544+0000 7f4c2b400640 1 -- 172.21.15.71:0/815706975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2c148f80 con 0x7f4c2c159280 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.545+0000 7f4c2b400640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c159280 0x7f4c2c0b4bc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4c24007450 tx=0x7f4c24004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.545+0000 7f4c22a00640 1 -- 172.21.15.71:0/815706975 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24039070 con 0x7f4c2c159280 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.545+0000 7f4c22a00640 1 -- 172.21.15.71:0/815706975 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c24044070 con 0x7f4c2c159280 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.545+0000 7f4c22a00640 1 -- 172.21.15.71:0/815706975 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24009be0 con 0x7f4c2c159280 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.545+0000 7f4c2be00640 1 -- 172.21.15.71:0/815706975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2c157600 con 0x7f4c2c159280 2024-04-20T21:20:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.545+0000 7f4c2be00640 1 -- 172.21.15.71:0/815706975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c2c157bc0 con 0x7f4c2c159280 2024-04-20T21:20:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.546+0000 7f4c2be00640 1 -- 172.21.15.71:0/815706975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c2c075b30 con 0x7f4c2c159280 2024-04-20T21:20:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.547+0000 7f4c22a00640 1 -- 172.21.15.71:0/815706975 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c2403e850 con 0x7f4c2c159280 2024-04-20T21:20:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.548+0000 7f4c22a00640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4c0806c8f0 0x7f4c0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.548+0000 7f4c22a00640 1 -- 172.21.15.71:0/815706975 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f4c240adcd0 con 0x7f4c2c159280 2024-04-20T21:20:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.548+0000 7f4c2aa00640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4c0806c8f0 0x7f4c0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.549+0000 7f4c2aa00640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4c0806c8f0 0x7f4c0806edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c006fd0 tx=0x7f4c1c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:46.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.553+0000 7f4c22a00640 1 -- 172.21.15.71:0/815706975 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4c2404d020 con 0x7f4c2c159280 2024-04-20T21:20:46.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.752+0000 7f4c2be00640 1 -- 172.21.15.71:0/815706975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4c2c157390 con 0x7f4c2c159280 2024-04-20T21:20:46.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.753+0000 7f4c22a00640 1 -- 172.21.15.71:0/815706975 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f4c2c148f80 con 0x7f4c2c159280 2024-04-20T21:20:46.753 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:46.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.755+0000 7f4c2be00640 1 -- 172.21.15.71:0/815706975 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4c0806c8f0 msgr2=0x7f4c0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.755+0000 7f4c2be00640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4c0806c8f0 0x7f4c0806edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c006fd0 tx=0x7f4c1c008040 comp rx=0 tx=0).stop 2024-04-20T21:20:46.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.755+0000 7f4c2be00640 1 -- 172.21.15.71:0/815706975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c159280 msgr2=0x7f4c2c0b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.755+0000 7f4c2be00640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c159280 0x7f4c2c0b4bc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4c24007450 tx=0x7f4c24004ab0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.756+0000 7f4c2be00640 1 -- 172.21.15.71:0/815706975 shutdown_connections 2024-04-20T21:20:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.756+0000 7f4c2be00640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4c0806c8f0 0x7f4c0806edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.756+0000 7f4c2be00640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c159280 0x7f4c2c0b4bc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.756+0000 7f4c2be00640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c158e00 0x7f4c2c0b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.756+0000 7f4c2be00640 1 --2- 172.21.15.71:0/815706975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c10006f50 0x7f4c2c148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.756+0000 7f4c2be00640 1 -- 172.21.15.71:0/815706975 >> 172.21.15.71:0/815706975 conn(0x7f4c2c0cffa0 msgr2=0x7f4c2c0677e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.756+0000 7f4c2be00640 1 -- 172.21.15.71:0/815706975 shutdown_connections 2024-04-20T21:20:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.756+0000 7f4c2be00640 1 -- 172.21.15.71:0/815706975 wait complete. 2024-04-20T21:20:46.774 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.982+0000 7f2b17e00640 1 Processor -- start 2024-04-20T21:20:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.983+0000 7f2b17e00640 1 -- start start 2024-04-20T21:20:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.984+0000 7f2b17e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2b10163060 0x7f2b100b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.984+0000 7f2b17e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2b1006d8f0 0x7f2b100cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.984+0000 7f2b17e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b100b1c60 con 0x7f2b1006d510 2024-04-20T21:20:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.984+0000 7f2b17e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2b100b2d00 con 0x7f2b1006d8f0 2024-04-20T21:20:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.984+0000 7f2b17e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2b100b1f40 con 0x7f2b10163060 2024-04-20T21:20:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.985+0000 7f2b15e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2b1006d8f0 0x7f2b100cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.985+0000 7f2b15e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2b1006d8f0 0x7f2b100cf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51950/0 (socket says 172.21.15.71:51950) 2024-04-20T21:20:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.985+0000 7f2b15e00640 1 -- 172.21.15.71:0/3128633112 learned_addr learned my addr 172.21.15.71:0/3128633112 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.985+0000 7f2b14a00640 1 --2- 172.21.15.71:0/3128633112 >> v2:172.21.15.137:3300/0 conn(0x7f2b10163060 0x7f2b100b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.985+0000 7f2b15e00640 1 -- 172.21.15.71:0/3128633112 >> v2:172.21.15.137:3300/0 conn(0x7f2b10163060 msgr2=0x7f2b100b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.985+0000 7f2b15e00640 1 --2- 172.21.15.71:0/3128633112 >> v2:172.21.15.137:3300/0 conn(0x7f2b10163060 0x7f2b100b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.985+0000 7f2b15e00640 1 -- 172.21.15.71:0/3128633112 >> v1:172.21.15.137:6789/0 conn(0x7f2b1006d510 legacy=0x7f2b100ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.985+0000 7f2b15e00640 1 -- 172.21.15.71:0/3128633112 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b100b2220 con 0x7f2b1006d8f0 2024-04-20T21:20:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.986+0000 7f2b15e00640 1 --2- 172.21.15.71:0/3128633112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b1006d8f0 0x7f2b100cf0f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2b10147ef0 tx=0x7f2b0802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3943c0de39489b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.987+0000 7f2b0fe00640 1 -- 172.21.15.71:0/3128633112 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0802ca80 con 0x7f2b1006d8f0 2024-04-20T21:20:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.987+0000 7f2b0fe00640 1 -- 172.21.15.71:0/3128633112 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0802cc20 con 0x7f2b1006d8f0 2024-04-20T21:20:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.987+0000 7f2b0fe00640 1 -- 172.21.15.71:0/3128633112 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b080343f0 con 0x7f2b1006d8f0 2024-04-20T21:20:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.987+0000 7f2b17e00640 1 -- 172.21.15.71:0/3128633112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b1006d8f0 msgr2=0x7f2b100cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.987+0000 7f2b17e00640 1 --2- 172.21.15.71:0/3128633112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b1006d8f0 0x7f2b100cf0f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2b10147ef0 tx=0x7f2b0802bee0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.987+0000 7f2b17e00640 1 -- 172.21.15.71:0/3128633112 shutdown_connections 2024-04-20T21:20:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.987+0000 7f2b17e00640 1 --2- 172.21.15.71:0/3128633112 >> v2:172.21.15.137:3300/0 conn(0x7f2b10163060 0x7f2b100b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.987+0000 7f2b17e00640 1 --2- 172.21.15.71:0/3128633112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b1006d8f0 0x7f2b100cf0f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.987+0000 7f2b17e00640 1 -- 172.21.15.71:0/3128633112 >> 172.21.15.71:0/3128633112 conn(0x7f2b10071800 msgr2=0x7f2b10071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.988+0000 7f2b17e00640 1 -- 172.21.15.71:0/3128633112 shutdown_connections 2024-04-20T21:20:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.988+0000 7f2b17e00640 1 -- 172.21.15.71:0/3128633112 wait complete. 2024-04-20T21:20:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.989+0000 7f2b17e00640 1 Processor -- start 2024-04-20T21:20:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.989+0000 7f2b17e00640 1 -- start start 2024-04-20T21:20:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.990+0000 7f2b17e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b1006d510 0x7f2b100c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.990+0000 7f2b17e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b1006d8f0 0x7f2b101e81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.990+0000 7f2b17e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b10163060 0x7f2b101e8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.990+0000 7f2b17e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b100cf630 con 0x7f2b1006d8f0 2024-04-20T21:20:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.990+0000 7f2b17e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2b100b27e0 con 0x7f2b10163060 2024-04-20T21:20:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.990+0000 7f2b17e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2b10142f30 con 0x7f2b1006d510 2024-04-20T21:20:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.991+0000 7f2b14a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b1006d8f0 0x7f2b101e81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.991+0000 7f2b14a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b1006d8f0 0x7f2b101e81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51960/0 (socket says 172.21.15.71:51960) 2024-04-20T21:20:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.991+0000 7f2b14a00640 1 -- 172.21.15.71:0/1241174466 learned_addr learned my addr 172.21.15.71:0/1241174466 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.991+0000 7f2b15400640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b1006d510 0x7f2b100c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.991+0000 7f2b15e00640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b10163060 0x7f2b101e8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.991+0000 7f2b14a00640 1 -- 172.21.15.71:0/1241174466 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b1006d510 msgr2=0x7f2b100c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.991+0000 7f2b14a00640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b1006d510 0x7f2b100c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.991+0000 7f2b14a00640 1 -- 172.21.15.71:0/1241174466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b10163060 msgr2=0x7f2b101e8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.991+0000 7f2b14a00640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b10163060 0x7f2b101e8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.991+0000 7f2b14a00640 1 -- 172.21.15.71:0/1241174466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b100c8610 con 0x7f2b1006d8f0 2024-04-20T21:20:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.992+0000 7f2b14a00640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b1006d8f0 0x7f2b101e81f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00d800 tx=0x7f2afc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.992+0000 7f2b0d600640 1 -- 172.21.15.71:0/1241174466 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00b6c0 con 0x7f2b1006d8f0 2024-04-20T21:20:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.992+0000 7f2b0d600640 1 -- 172.21.15.71:0/1241174466 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2afc019070 con 0x7f2b1006d8f0 2024-04-20T21:20:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.992+0000 7f2b0d600640 1 -- 172.21.15.71:0/1241174466 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00ba80 con 0x7f2b1006d8f0 2024-04-20T21:20:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.992+0000 7f2b17e00640 1 -- 172.21.15.71:0/1241174466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b100c9b20 con 0x7f2b1006d8f0 2024-04-20T21:20:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.992+0000 7f2b17e00640 1 -- 172.21.15.71:0/1241174466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b100c7900 con 0x7f2b1006d8f0 2024-04-20T21:20:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.993+0000 7f2b17e00640 1 -- 172.21.15.71:0/1241174466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b10068980 con 0x7f2b1006d8f0 2024-04-20T21:20:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.994+0000 7f2b0d600640 1 -- 172.21.15.71:0/1241174466 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2afc00bc20 con 0x7f2b1006d8f0 2024-04-20T21:20:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.995+0000 7f2b0d600640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2af006c8f0 0x7f2af006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.995+0000 7f2b0d600640 1 -- 172.21.15.71:0/1241174466 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f2afc08c470 con 0x7f2b1006d8f0 2024-04-20T21:20:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.995+0000 7f2b15400640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2af006c8f0 0x7f2af006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:46.996+0000 7f2b15400640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2af006c8f0 0x7f2af006edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400a750 tx=0x7f2b04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.000+0000 7f2b0d600640 1 -- 172.21.15.71:0/1241174466 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2afc01c360 con 0x7f2b1006d8f0 2024-04-20T21:20:47.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.201+0000 7f2b17e00640 1 -- 172.21.15.71:0/1241174466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2b1015eba0 con 0x7f2b1006d8f0 2024-04-20T21:20:47.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.202+0000 7f2b0d600640 1 -- 172.21.15.71:0/1241174466 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f2afc05a470 con 0x7f2b1006d8f0 2024-04-20T21:20:47.202 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:47.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 -- 172.21.15.71:0/1241174466 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2af006c8f0 msgr2=0x7f2af006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:47.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2af006c8f0 0x7f2af006edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400a750 tx=0x7f2b04008040 comp rx=0 tx=0).stop 2024-04-20T21:20:47.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 -- 172.21.15.71:0/1241174466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b1006d8f0 msgr2=0x7f2b101e81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:47.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b1006d8f0 0x7f2b101e81f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00d800 tx=0x7f2afc00dcc0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 -- 172.21.15.71:0/1241174466 shutdown_connections 2024-04-20T21:20:47.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2af006c8f0 0x7f2af006edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b10163060 0x7f2b101e8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b1006d8f0 0x7f2b101e81f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 --2- 172.21.15.71:0/1241174466 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b1006d510 0x7f2b100c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 -- 172.21.15.71:0/1241174466 >> 172.21.15.71:0/1241174466 conn(0x7f2b10071800 msgr2=0x7f2b10160230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:47.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 -- 172.21.15.71:0/1241174466 shutdown_connections 2024-04-20T21:20:47.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.205+0000 7f2b17e00640 1 -- 172.21.15.71:0/1241174466 wait complete. 2024-04-20T21:20:47.224 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T21:20:47.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.426+0000 7f2913200640 1 Processor -- start 2024-04-20T21:20:47.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.426+0000 7f2913200640 1 -- start start 2024-04-20T21:20:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.427+0000 7f2913200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29140d1e00 0x7f29140d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.427+0000 7f2913200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f29140d1400 0x7f29140cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.427+0000 7f2913200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29141623c0 con 0x7f291415e680 2024-04-20T21:20:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.427+0000 7f2913200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f29140d1870 con 0x7f29140d1400 2024-04-20T21:20:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.427+0000 7f2913200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2914162fd0 con 0x7f29140d1e00 2024-04-20T21:20:47.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.428+0000 7f2911400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29140d1e00 0x7f29140d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:47.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.428+0000 7f2912800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f29140d1400 0x7f29140cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:47.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.428+0000 7f2911400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29140d1e00 0x7f29140d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:48746/0 (socket says 172.21.15.71:48746) 2024-04-20T21:20:47.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.428+0000 7f2911400640 1 -- 172.21.15.71:0/438954587 learned_addr learned my addr 172.21.15.71:0/438954587 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.429+0000 7f2911400640 1 -- 172.21.15.71:0/438954587 >> v2:172.21.15.137:3300/0 conn(0x7f29140d1400 msgr2=0x7f29140cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.429+0000 7f2911400640 1 --2- 172.21.15.71:0/438954587 >> v2:172.21.15.137:3300/0 conn(0x7f29140d1400 0x7f29140cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.429+0000 7f2911400640 1 -- 172.21.15.71:0/438954587 >> v1:172.21.15.137:6789/0 conn(0x7f291415e680 legacy=0x7f29140b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.429+0000 7f2911400640 1 -- 172.21.15.71:0/438954587 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29141626a0 con 0x7f29140d1e00 2024-04-20T21:20:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.429+0000 7f2912800640 1 --2- 172.21.15.71:0/438954587 >> v2:172.21.15.137:3300/0 conn(0x7f29140d1400 0x7f29140cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:20:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.431+0000 7f2911400640 1 --2- 172.21.15.71:0/438954587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29140d1e00 0x7f29140d0ec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2900009870 tx=0x7f290002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ad3a3594dc5ca9b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.431+0000 7f2910a00640 1 -- 172.21.15.71:0/438954587 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900034070 con 0x7f29140d1e00 2024-04-20T21:20:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.431+0000 7f2910a00640 1 -- 172.21.15.71:0/438954587 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900030840 con 0x7f29140d1e00 2024-04-20T21:20:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.431+0000 7f2910a00640 1 -- 172.21.15.71:0/438954587 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900030c10 con 0x7f29140d1e00 2024-04-20T21:20:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.432+0000 7f2913200640 1 -- 172.21.15.71:0/438954587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29140d1e00 msgr2=0x7f29140d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.432+0000 7f2913200640 1 --2- 172.21.15.71:0/438954587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29140d1e00 0x7f29140d0ec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2900009870 tx=0x7f290002b980 comp rx=0 tx=0).stop 2024-04-20T21:20:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.432+0000 7f2913200640 1 -- 172.21.15.71:0/438954587 shutdown_connections 2024-04-20T21:20:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.432+0000 7f2913200640 1 --2- 172.21.15.71:0/438954587 >> v2:172.21.15.137:3300/0 conn(0x7f29140d1400 0x7f29140cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.432+0000 7f2913200640 1 --2- 172.21.15.71:0/438954587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29140d1e00 0x7f29140d0ec0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.432+0000 7f2913200640 1 -- 172.21.15.71:0/438954587 >> 172.21.15.71:0/438954587 conn(0x7f29140ced60 msgr2=0x7f29140cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.432+0000 7f2913200640 1 -- 172.21.15.71:0/438954587 shutdown_connections 2024-04-20T21:20:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.432+0000 7f2913200640 1 -- 172.21.15.71:0/438954587 wait complete. 2024-04-20T21:20:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.435+0000 7f2913200640 1 Processor -- start 2024-04-20T21:20:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.435+0000 7f2913200640 1 -- start start 2024-04-20T21:20:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.436+0000 7f2913200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29140d1400 0x7f29140afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.436+0000 7f2913200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29140d1e00 0x7f29141516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.436+0000 7f2913200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f291415e680 0x7f29140cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.436+0000 7f2913200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f291415fa70 con 0x7f29140d1400 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.436+0000 7f2913200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2914162c60 con 0x7f29140d1e00 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.436+0000 7f2913200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f29140ccf70 con 0x7f291415e680 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.436+0000 7f2911e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29140d1400 0x7f29140afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.436+0000 7f2911e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29140d1400 0x7f29140afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51974/0 (socket says 172.21.15.71:51974) 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.436+0000 7f2911e00640 1 -- 172.21.15.71:0/679149344 learned_addr learned my addr 172.21.15.71:0/679149344 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.437+0000 7f2912800640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f291415e680 0x7f29140cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.437+0000 7f2911400640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29140d1e00 0x7f29141516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.437+0000 7f2911e00640 1 -- 172.21.15.71:0/679149344 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f291415e680 msgr2=0x7f29140cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.437+0000 7f2911e00640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f291415e680 0x7f29140cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.437+0000 7f2911e00640 1 -- 172.21.15.71:0/679149344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29140d1e00 msgr2=0x7f29141516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.437+0000 7f2911e00640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29140d1e00 0x7f29141516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.437+0000 7f2911e00640 1 -- 172.21.15.71:0/679149344 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29140c8b60 con 0x7f29140d1400 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.437+0000 7f2912800640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f291415e680 0x7f29140cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.437+0000 7f2911e00640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29140d1400 0x7f29140afe80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f290400c3c0 tx=0x7f290400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.437+0000 7f290a000640 1 -- 172.21.15.71:0/679149344 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29040052d0 con 0x7f29140d1400 2024-04-20T21:20:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.438+0000 7f290a000640 1 -- 172.21.15.71:0/679149344 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2904005490 con 0x7f29140d1400 2024-04-20T21:20:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.438+0000 7f2913200640 1 -- 172.21.15.71:0/679149344 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29140b0610 con 0x7f29140d1400 2024-04-20T21:20:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.438+0000 7f290a000640 1 -- 172.21.15.71:0/679149344 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2904007260 con 0x7f29140d1400 2024-04-20T21:20:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.438+0000 7f2913200640 1 -- 172.21.15.71:0/679149344 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29140b0bd0 con 0x7f29140d1400 2024-04-20T21:20:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.439+0000 7f2913200640 1 -- 172.21.15.71:0/679149344 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2914075b30 con 0x7f29140d1400 2024-04-20T21:20:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.440+0000 7f290a000640 1 -- 172.21.15.71:0/679149344 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2904007400 con 0x7f29140d1400 2024-04-20T21:20:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.441+0000 7f290a000640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f28f406c8f0 0x7f28f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.441+0000 7f290a000640 1 -- 172.21.15.71:0/679149344 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f290408b4a0 con 0x7f29140d1400 2024-04-20T21:20:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.441+0000 7f2911400640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f28f406c8f0 0x7f28f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.442+0000 7f2911400640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f28f406c8f0 0x7f28f406edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2900036000 tx=0x7f290003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.445+0000 7f290a000640 1 -- 172.21.15.71:0/679149344 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f29040594a0 con 0x7f29140d1400 2024-04-20T21:20:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.658+0000 7f2913200640 1 -- 172.21.15.71:0/679149344 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2914161a30 con 0x7f29140d1400 2024-04-20T21:20:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.659+0000 7f290a000640 1 -- 172.21.15.71:0/679149344 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f2904058da0 con 0x7f29140d1400 2024-04-20T21:20:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2024-04-20T21:20:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.661+0000 7f2913200640 1 -- 172.21.15.71:0/679149344 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f28f406c8f0 msgr2=0x7f28f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.661+0000 7f2913200640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f28f406c8f0 0x7f28f406edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2900036000 tx=0x7f290003b040 comp rx=0 tx=0).stop 2024-04-20T21:20:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.661+0000 7f2913200640 1 -- 172.21.15.71:0/679149344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29140d1400 msgr2=0x7f29140afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.661+0000 7f2913200640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29140d1400 0x7f29140afe80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f290400c3c0 tx=0x7f290400c880 comp rx=0 tx=0).stop 2024-04-20T21:20:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.661+0000 7f2913200640 1 -- 172.21.15.71:0/679149344 shutdown_connections 2024-04-20T21:20:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.662+0000 7f2913200640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f28f406c8f0 0x7f28f406edb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.662+0000 7f2913200640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f291415e680 0x7f29140cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.662+0000 7f2913200640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29140d1e00 0x7f29141516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.662+0000 7f2913200640 1 --2- 172.21.15.71:0/679149344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29140d1400 0x7f29140afe80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.662+0000 7f2913200640 1 -- 172.21.15.71:0/679149344 >> 172.21.15.71:0/679149344 conn(0x7f29140ced60 msgr2=0x7f2914160190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.662+0000 7f2913200640 1 -- 172.21.15.71:0/679149344 shutdown_connections 2024-04-20T21:20:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.662+0000 7f2913200640 1 -- 172.21.15.71:0/679149344 wait complete. 2024-04-20T21:20:47.679 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:20:47.679 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:47.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:47.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.964+0000 7f25c2e00640 1 Processor -- start 2024-04-20T21:20:47.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.964+0000 7f25c2e00640 1 -- start start 2024-04-20T21:20:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.965+0000 7f25c2e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f25bc06dcb0 0x7f25bc071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.965+0000 7f25c2e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f25bc072090 0x7f25bc0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.966+0000 7f25c2e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25bc0ade40 con 0x7f25bc15b3b0 2024-04-20T21:20:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.966+0000 7f25c2e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f25bc06f1b0 con 0x7f25bc06dcb0 2024-04-20T21:20:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.966+0000 7f25c2e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f25bc0ae0e0 con 0x7f25bc072090 2024-04-20T21:20:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.966+0000 7f25bb400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f25bc06dcb0 0x7f25bc071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.966+0000 7f25bb400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f25bc06dcb0 0x7f25bc071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51976/0 (socket says 172.21.15.71:51976) 2024-04-20T21:20:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.966+0000 7f25bb400640 1 -- 172.21.15.71:0/2423203530 learned_addr learned my addr 172.21.15.71:0/2423203530 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.966+0000 7f25c0e00640 1 --2- 172.21.15.71:0/2423203530 >> v2:172.21.15.137:3300/0 conn(0x7f25bc072090 0x7f25bc0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.966+0000 7f25bb400640 1 -- 172.21.15.71:0/2423203530 >> v2:172.21.15.137:3300/0 conn(0x7f25bc072090 msgr2=0x7f25bc0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.966+0000 7f25bb400640 1 --2- 172.21.15.71:0/2423203530 >> v2:172.21.15.137:3300/0 conn(0x7f25bc072090 0x7f25bc0d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.966+0000 7f25bb400640 1 -- 172.21.15.71:0/2423203530 >> v1:172.21.15.137:6789/0 conn(0x7f25bc15b3b0 legacy=0x7f25bc06eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.966+0000 7f25bb400640 1 -- 172.21.15.71:0/2423203530 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25bc15b790 con 0x7f25bc06dcb0 2024-04-20T21:20:47.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.968+0000 7f25bb400640 1 --2- 172.21.15.71:0/2423203530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25bc06dcb0 0x7f25bc071b50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f25bc073c80 tx=0x7f25a802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0c43c11838fe6d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:47.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.968+0000 7f25baa00640 1 -- 172.21.15.71:0/2423203530 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a803b070 con 0x7f25bc06dcb0 2024-04-20T21:20:47.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.968+0000 7f25baa00640 1 -- 172.21.15.71:0/2423203530 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a8036440 con 0x7f25bc06dcb0 2024-04-20T21:20:47.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.968+0000 7f25baa00640 1 -- 172.21.15.71:0/2423203530 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8036810 con 0x7f25bc06dcb0 2024-04-20T21:20:47.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.969+0000 7f25c2e00640 1 -- 172.21.15.71:0/2423203530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25bc06dcb0 msgr2=0x7f25bc071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:47.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.969+0000 7f25c2e00640 1 --2- 172.21.15.71:0/2423203530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25bc06dcb0 0x7f25bc071b50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f25bc073c80 tx=0x7f25a802e0e0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.969+0000 7f25c2e00640 1 -- 172.21.15.71:0/2423203530 shutdown_connections 2024-04-20T21:20:47.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.969+0000 7f25c2e00640 1 --2- 172.21.15.71:0/2423203530 >> v2:172.21.15.137:3300/0 conn(0x7f25bc072090 0x7f25bc0d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.969+0000 7f25c2e00640 1 --2- 172.21.15.71:0/2423203530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25bc06dcb0 0x7f25bc071b50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.969+0000 7f25c2e00640 1 -- 172.21.15.71:0/2423203530 >> 172.21.15.71:0/2423203530 conn(0x7f25bc0b3350 msgr2=0x7f25bc0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:47.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.969+0000 7f25c2e00640 1 -- 172.21.15.71:0/2423203530 shutdown_connections 2024-04-20T21:20:47.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.969+0000 7f25c2e00640 1 -- 172.21.15.71:0/2423203530 wait complete. 2024-04-20T21:20:47.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.971+0000 7f25c2e00640 1 Processor -- start 2024-04-20T21:20:47.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.971+0000 7f25c2e00640 1 -- start start 2024-04-20T21:20:47.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25c2e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25bc06dcb0 0x7f25bc1e6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25c2e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25bc15b3b0 0x7f25bc155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25c2e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25bc15e6a0 0x7f25bc15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25c2e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc0aec20 con 0x7f25bc06dcb0 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25c2e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc0ae940 con 0x7f25bc15e6a0 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25c2e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f25bc0d08a0 con 0x7f25bc15b3b0 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25bbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25bc06dcb0 0x7f25bc1e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25bbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25bc06dcb0 0x7f25bc1e6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51992/0 (socket says 172.21.15.71:51992) 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25bbe00640 1 -- 172.21.15.71:0/803175989 learned_addr learned my addr 172.21.15.71:0/803175989 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25bbe00640 1 -- 172.21.15.71:0/803175989 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25bc15b3b0 msgr2=0x7f25bc155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25bbe00640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25bc15b3b0 0x7f25bc155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25bbe00640 1 -- 172.21.15.71:0/803175989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25bc15e6a0 msgr2=0x7f25bc15b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25bbe00640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25bc15e6a0 0x7f25bc15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.972+0000 7f25bbe00640 1 -- 172.21.15.71:0/803175989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25bc15d690 con 0x7f25bc06dcb0 2024-04-20T21:20:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.973+0000 7f25bbe00640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25bc06dcb0 0x7f25bc1e6030 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00b3f0 tx=0x7f25ac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.973+0000 7f25b3e00640 1 -- 172.21.15.71:0/803175989 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac015020 con 0x7f25bc06dcb0 2024-04-20T21:20:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.973+0000 7f25b3e00640 1 -- 172.21.15.71:0/803175989 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ac011830 con 0x7f25bc06dcb0 2024-04-20T21:20:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.973+0000 7f25b3e00640 1 -- 172.21.15.71:0/803175989 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac011c20 con 0x7f25bc06dcb0 2024-04-20T21:20:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.973+0000 7f25c2e00640 1 -- 172.21.15.71:0/803175989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25bc15dbe0 con 0x7f25bc06dcb0 2024-04-20T21:20:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.973+0000 7f25c2e00640 1 -- 172.21.15.71:0/803175989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25bc15e1a0 con 0x7f25bc06dcb0 2024-04-20T21:20:47.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.974+0000 7f25c2e00640 1 -- 172.21.15.71:0/803175989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25bc068980 con 0x7f25bc06dcb0 2024-04-20T21:20:47.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.975+0000 7f25b3e00640 1 -- 172.21.15.71:0/803175989 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25ac018020 con 0x7f25bc06dcb0 2024-04-20T21:20:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.976+0000 7f25b3e00640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f259c06c8f0 0x7f259c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.977+0000 7f25b3e00640 1 -- 172.21.15.71:0/803175989 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f25ac08bb90 con 0x7f25bc06dcb0 2024-04-20T21:20:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.977+0000 7f25bb400640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f259c06c8f0 0x7f259c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.977+0000 7f25bb400640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f259c06c8f0 0x7f259c06edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25a8038000 tx=0x7f25a8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:47.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:47.981+0000 7f25b3e00640 1 -- 172.21.15.71:0/803175989 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f25ac01f030 con 0x7f25bc06dcb0 2024-04-20T21:20:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.167+0000 7f25c2e00640 1 -- 172.21.15.71:0/803175989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25bc151b60 con 0x7f25bc06dcb0 2024-04-20T21:20:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.170+0000 7f25b3e00640 1 -- 172.21.15.71:0/803175989 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7f25ac059b90 con 0x7f25bc06dcb0 2024-04-20T21:20:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:48.171 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 -- 172.21.15.71:0/803175989 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f259c06c8f0 msgr2=0x7f259c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f259c06c8f0 0x7f259c06edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25a8038000 tx=0x7f25a8030000 comp rx=0 tx=0).stop 2024-04-20T21:20:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 -- 172.21.15.71:0/803175989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25bc06dcb0 msgr2=0x7f25bc1e6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25bc06dcb0 0x7f25bc1e6030 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00b3f0 tx=0x7f25ac00b8b0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 -- 172.21.15.71:0/803175989 shutdown_connections 2024-04-20T21:20:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f259c06c8f0 0x7f259c06edb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25bc15e6a0 0x7f25bc15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25bc15b3b0 0x7f25bc155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 --2- 172.21.15.71:0/803175989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25bc06dcb0 0x7f25bc1e6030 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 -- 172.21.15.71:0/803175989 >> 172.21.15.71:0/803175989 conn(0x7f25bc0b3350 msgr2=0x7f25bc0b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 -- 172.21.15.71:0/803175989 shutdown_connections 2024-04-20T21:20:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.173+0000 7f25c2e00640 1 -- 172.21.15.71:0/803175989 wait complete. 2024-04-20T21:20:48.191 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:48.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:48.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.387+0000 7f94b8400640 1 Processor -- start 2024-04-20T21:20:48.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.387+0000 7f94b8400640 1 -- start start 2024-04-20T21:20:48.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.389+0000 7f94b8400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f94b00d0360 0x7f94b00d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.389+0000 7f94b8400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94b0141c60 con 0x7f94b015ca40 2024-04-20T21:20:48.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.389+0000 7f94b8400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94b00adab0 con 0x7f94b0156c20 2024-04-20T21:20:48.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.389+0000 7f94b8400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f94b00d0d10 con 0x7f94b00d0360 2024-04-20T21:20:48.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.389+0000 7f94b5000640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f94b015ca40 0x7f94b00ad3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33172/0 (socket says 172.21.15.71:33172) 2024-04-20T21:20:48.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.389+0000 7f94b5000640 1 -- 172.21.15.71:0/1662239385 learned_addr learned my addr 172.21.15.71:0/1662239385 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:48.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.389+0000 7f94b6400640 1 --2- 172.21.15.71:0/1662239385 >> v2:172.21.15.71:3300/0 conn(0x7f94b00d0360 0x7f94b00d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:48.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.390+0000 7f94afe00640 1 -- 172.21.15.71:0/1662239385 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3082770868 0 0) 0x7f94b0141c60 con 0x7f94b015ca40 2024-04-20T21:20:48.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.390+0000 7f94afe00640 1 -- 172.21.15.71:0/1662239385 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9498003520 con 0x7f94b015ca40 2024-04-20T21:20:48.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.390+0000 7f94b6400640 1 -- 172.21.15.71:0/1662239385 >> v1:172.21.15.137:6789/0 conn(0x7f94b0156c20 legacy=0x7f94b006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:48.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.390+0000 7f94b6400640 1 -- 172.21.15.71:0/1662239385 >> v1:172.21.15.71:6789/0 conn(0x7f94b015ca40 legacy=0x7f94b00ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.390+0000 7f94b6400640 1 -- 172.21.15.71:0/1662239385 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b015cf90 con 0x7f94b00d0360 2024-04-20T21:20:48.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.391+0000 7f94b6400640 1 --2- 172.21.15.71:0/1662239385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b00d0360 0x7f94b00d07d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009d90 tx=0x7f94a802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef27449e399d990 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:48.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.391+0000 7f94afe00640 1 -- 172.21.15.71:0/1662239385 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8039070 con 0x7f94b00d0360 2024-04-20T21:20:48.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.391+0000 7f94afe00640 1 -- 172.21.15.71:0/1662239385 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a802cc60 con 0x7f94b00d0360 2024-04-20T21:20:48.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.391+0000 7f94afe00640 1 -- 172.21.15.71:0/1662239385 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8034660 con 0x7f94b00d0360 2024-04-20T21:20:48.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.392+0000 7f94b8400640 1 -- 172.21.15.71:0/1662239385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b00d0360 msgr2=0x7f94b00d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.392+0000 7f94b8400640 1 --2- 172.21.15.71:0/1662239385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b00d0360 0x7f94b00d07d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009d90 tx=0x7f94a802beb0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.392+0000 7f94b8400640 1 -- 172.21.15.71:0/1662239385 shutdown_connections 2024-04-20T21:20:48.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.392+0000 7f94b8400640 1 --2- 172.21.15.71:0/1662239385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b00d0360 0x7f94b00d07d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.392+0000 7f94b8400640 1 -- 172.21.15.71:0/1662239385 >> 172.21.15.71:0/1662239385 conn(0x7f94b00b3350 msgr2=0x7f94b00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:48.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.392+0000 7f94b8400640 1 -- 172.21.15.71:0/1662239385 shutdown_connections 2024-04-20T21:20:48.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.392+0000 7f94b8400640 1 -- 172.21.15.71:0/1662239385 wait complete. 2024-04-20T21:20:48.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.394+0000 7f94b8400640 1 Processor -- start 2024-04-20T21:20:48.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.394+0000 7f94b8400640 1 -- start start 2024-04-20T21:20:48.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.395+0000 7f94b8400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b00d0360 0x7f94b0099580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.395+0000 7f94b8400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b0156c20 0x7f94b00b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.395+0000 7f94b8400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94b015ca40 0x7f94b00b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.395+0000 7f94b8400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94b015d550 con 0x7f94b00d0360 2024-04-20T21:20:48.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.395+0000 7f94b8400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f94b006c010 con 0x7f94b0156c20 2024-04-20T21:20:48.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.395+0000 7f94b8400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f94b015d830 con 0x7f94b015ca40 2024-04-20T21:20:48.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.395+0000 7f94b5a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b00d0360 0x7f94b0099580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.395+0000 7f94b5a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b00d0360 0x7f94b0099580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52010/0 (socket says 172.21.15.71:52010) 2024-04-20T21:20:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.395+0000 7f94b5a00640 1 -- 172.21.15.71:0/2717219275 learned_addr learned my addr 172.21.15.71:0/2717219275 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.395+0000 7f94b5a00640 1 -- 172.21.15.71:0/2717219275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94b015ca40 msgr2=0x7f94b00b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.395+0000 7f94b5a00640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94b015ca40 0x7f94b00b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.396+0000 7f94b5a00640 1 -- 172.21.15.71:0/2717219275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b0156c20 msgr2=0x7f94b00b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.396+0000 7f94b5a00640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b0156c20 0x7f94b00b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.396+0000 7f94b5a00640 1 -- 172.21.15.71:0/2717219275 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b0099ac0 con 0x7f94b00d0360 2024-04-20T21:20:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.396+0000 7f94b5a00640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b00d0360 0x7f94b0099580 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c430 tx=0x7f94a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.396+0000 7f94ad600640 1 -- 172.21.15.71:0/2717219275 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4011790 con 0x7f94b00d0360 2024-04-20T21:20:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.396+0000 7f94ad600640 1 -- 172.21.15.71:0/2717219275 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a4017070 con 0x7f94b00d0360 2024-04-20T21:20:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.396+0000 7f94b8400640 1 -- 172.21.15.71:0/2717219275 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b00b18f0 con 0x7f94b00d0360 2024-04-20T21:20:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.396+0000 7f94ad600640 1 -- 172.21.15.71:0/2717219275 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4011b70 con 0x7f94b00d0360 2024-04-20T21:20:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.396+0000 7f94b8400640 1 -- 172.21.15.71:0/2717219275 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b01550b0 con 0x7f94b00d0360 2024-04-20T21:20:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.397+0000 7f94b8400640 1 -- 172.21.15.71:0/2717219275 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b0068980 con 0x7f94b00d0360 2024-04-20T21:20:48.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.398+0000 7f94ad600640 1 -- 172.21.15.71:0/2717219275 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f94a4011d10 con 0x7f94b00d0360 2024-04-20T21:20:48.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.399+0000 7f94ad600640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f949006c8f0 0x7f949006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.399+0000 7f94ad600640 1 -- 172.21.15.71:0/2717219275 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f94a408be20 con 0x7f94b00d0360 2024-04-20T21:20:48.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.399+0000 7f94b5000640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f949006c8f0 0x7f949006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:48.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.400+0000 7f94b5000640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f949006c8f0 0x7f949006edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f949c000f60 tx=0x7f949c0078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:48.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.403+0000 7f94ad600640 1 -- 172.21.15.71:0/2717219275 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f94b0099ac0 con 0x7f94b00d0360 2024-04-20T21:20:48.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.601+0000 7f94b8400640 1 -- 172.21.15.71:0/2717219275 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f94b00cfd90 con 0x7f94b00d0360 2024-04-20T21:20:48.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.602+0000 7f94ad600640 1 -- 172.21.15.71:0/2717219275 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f94a4059e20 con 0x7f94b00d0360 2024-04-20T21:20:48.602 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.604+0000 7f94b8400640 1 -- 172.21.15.71:0/2717219275 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f949006c8f0 msgr2=0x7f949006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.604+0000 7f94b8400640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f949006c8f0 0x7f949006edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f949c000f60 tx=0x7f949c0078f0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.604+0000 7f94b8400640 1 -- 172.21.15.71:0/2717219275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b00d0360 msgr2=0x7f94b0099580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.604+0000 7f94b8400640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b00d0360 0x7f94b0099580 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c430 tx=0x7f94a400c8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.605+0000 7f94b8400640 1 -- 172.21.15.71:0/2717219275 shutdown_connections 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.605+0000 7f94b8400640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f949006c8f0 0x7f949006edb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.605+0000 7f94b8400640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94b015ca40 0x7f94b00b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.605+0000 7f94b8400640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94b0156c20 0x7f94b00b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.605+0000 7f94b8400640 1 --2- 172.21.15.71:0/2717219275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b00d0360 0x7f94b0099580 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.605+0000 7f94b8400640 1 -- 172.21.15.71:0/2717219275 >> 172.21.15.71:0/2717219275 conn(0x7f94b00b3350 msgr2=0x7f94b0152b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.605+0000 7f94b8400640 1 -- 172.21.15.71:0/2717219275 shutdown_connections 2024-04-20T21:20:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.605+0000 7f94b8400640 1 -- 172.21.15.71:0/2717219275 wait complete. 2024-04-20T21:20:48.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.827+0000 7f343d200640 1 Processor -- start 2024-04-20T21:20:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.827+0000 7f343d200640 1 -- start start 2024-04-20T21:20:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.829+0000 7f343d200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34380d3b20 0x7f34380b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.829+0000 7f343d200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34380d0980 con 0x7f343806c010 2024-04-20T21:20:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.829+0000 7f343d200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3438162490 con 0x7f3438161a50 2024-04-20T21:20:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.829+0000 7f343d200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f34380d0c60 con 0x7f34380d3b20 2024-04-20T21:20:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.829+0000 7f3437e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f343806c010 0x7f34380ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33186/0 (socket says 172.21.15.71:33186) 2024-04-20T21:20:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.829+0000 7f3437e00640 1 -- 172.21.15.71:0/403929223 learned_addr learned my addr 172.21.15.71:0/403929223 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f342ea00640 1 --2- 172.21.15.71:0/403929223 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34380d3b20 0x7f34380b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3663310392 0 0) 0x7f34380d0980 con 0x7f343806c010 2024-04-20T21:20:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f341c003520 con 0x7f343806c010 2024-04-20T21:20:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2810683696 0 0) 0x7f341c003520 con 0x7f343806c010 2024-04-20T21:20:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34380d3b20 msgr2=0x7f34380b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 --2- 172.21.15.71:0/403929223 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34380d3b20 0x7f34380b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 >> v1:172.21.15.137:6789/0 conn(0x7f3438161a50 legacy=0x7f343806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3438162770 con 0x7f343806c010 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f3430001670 con 0x7f343806c010 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 >> v1:172.21.15.71:6789/0 conn(0x7f343806c010 legacy=0x7f34380ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 --2- 172.21.15.71:0/403929223 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f341c0039e0 0x7f341c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 --2- 172.21.15.71:0/403929223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c004360 0x7f341c004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 --2- 172.21.15.71:0/403929223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f341c005040 0x7f341c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f34380d0c60 con 0x7f341c004360 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f341c00bf00 con 0x7f341c005040 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.830+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f341c00c0b0 con 0x7f341c0039e0 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.831+0000 7f342ea00640 1 --2- 172.21.15.71:0/403929223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c004360 0x7f341c004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.831+0000 7f342ea00640 1 -- 172.21.15.71:0/403929223 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f341c0039e0 msgr2=0x7f341c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.831+0000 7f342ea00640 1 --2- 172.21.15.71:0/403929223 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f341c0039e0 0x7f341c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.831+0000 7f342ea00640 1 -- 172.21.15.71:0/403929223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f341c005040 msgr2=0x7f341c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.831+0000 7f342ea00640 1 --2- 172.21.15.71:0/403929223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f341c005040 0x7f341c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.831+0000 7f342ea00640 1 -- 172.21.15.71:0/403929223 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c003520 con 0x7f341c004360 2024-04-20T21:20:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.832+0000 7f342ea00640 1 --2- 172.21.15.71:0/403929223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c004360 0x7f341c004840 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3420009ac0 tx=0x7f341c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496aad6bcf95757a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.832+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420039070 con 0x7f341c004360 2024-04-20T21:20:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.832+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342002c710 con 0x7f341c004360 2024-04-20T21:20:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.832+0000 7f3436a00640 1 -- 172.21.15.71:0/403929223 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420009690 con 0x7f341c004360 2024-04-20T21:20:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.833+0000 7f343d200640 1 -- 172.21.15.71:0/403929223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c004360 msgr2=0x7f341c004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.833+0000 7f343d200640 1 --2- 172.21.15.71:0/403929223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c004360 0x7f341c004840 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3420009ac0 tx=0x7f341c005830 comp rx=0 tx=0).stop 2024-04-20T21:20:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.833+0000 7f3437e00640 1 -- 172.21.15.71:0/403929223 reap_dead start 2024-04-20T21:20:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.833+0000 7f343d200640 1 -- 172.21.15.71:0/403929223 shutdown_connections 2024-04-20T21:20:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.833+0000 7f343d200640 1 -- 172.21.15.71:0/403929223 >> 172.21.15.71:0/403929223 conn(0x7f34380d0ed0 msgr2=0x7f34380d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.833+0000 7f343d200640 1 -- 172.21.15.71:0/403929223 shutdown_connections 2024-04-20T21:20:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.833+0000 7f343d200640 1 -- 172.21.15.71:0/403929223 wait complete. 2024-04-20T21:20:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.835+0000 7f343d200640 1 Processor -- start 2024-04-20T21:20:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.835+0000 7f343d200640 1 -- start start 2024-04-20T21:20:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.836+0000 7f343d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f341c004360 0x7f34380ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.836+0000 7f343d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3438158240 0x7f343815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.836+0000 7f343d200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34380cd800 0x7f343815c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.836+0000 7f343d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3438162ae0 con 0x7f3438158240 2024-04-20T21:20:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.836+0000 7f343d200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34380d0690 con 0x7f341c004360 2024-04-20T21:20:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.836+0000 7f343d200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3438161e30 con 0x7f34380cd800 2024-04-20T21:20:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.836+0000 7f342ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3438158240 0x7f343815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.836+0000 7f342ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3438158240 0x7f343815bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52032/0 (socket says 172.21.15.71:52032) 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.836+0000 7f342ea00640 1 -- 172.21.15.71:0/4123343994 learned_addr learned my addr 172.21.15.71:0/4123343994 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f3437e00640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34380cd800 0x7f343815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f3437400640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f341c004360 0x7f34380ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f342ea00640 1 -- 172.21.15.71:0/4123343994 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34380cd800 msgr2=0x7f343815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f342ea00640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34380cd800 0x7f343815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f342ea00640 1 -- 172.21.15.71:0/4123343994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f341c004360 msgr2=0x7f34380ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f342ea00640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f341c004360 0x7f34380ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f342ea00640 1 -- 172.21.15.71:0/4123343994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3438157480 con 0x7f3438158240 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f3437e00640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34380cd800 0x7f343815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f342ea00640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3438158240 0x7f343815bec0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3420000c00 tx=0x7f3420004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f342fe00640 1 -- 172.21.15.71:0/4123343994 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420042020 con 0x7f3438158240 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f342fe00640 1 -- 172.21.15.71:0/4123343994 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342003a040 con 0x7f3438158240 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.837+0000 7f343d200640 1 -- 172.21.15.71:0/4123343994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3438157760 con 0x7f3438158240 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.838+0000 7f342fe00640 1 -- 172.21.15.71:0/4123343994 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420039070 con 0x7f3438158240 2024-04-20T21:20:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.838+0000 7f343d200640 1 -- 172.21.15.71:0/4123343994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3438157d20 con 0x7f3438158240 2024-04-20T21:20:48.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.839+0000 7f343d200640 1 -- 172.21.15.71:0/4123343994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3438075b30 con 0x7f3438158240 2024-04-20T21:20:48.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.840+0000 7f342fe00640 1 -- 172.21.15.71:0/4123343994 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3420045020 con 0x7f3438158240 2024-04-20T21:20:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.840+0000 7f342fe00640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f341406c8f0 0x7f341406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.841+0000 7f342fe00640 1 -- 172.21.15.71:0/4123343994 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f34200ad7c0 con 0x7f3438158240 2024-04-20T21:20:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.841+0000 7f3437400640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f341406c8f0 0x7f341406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.841+0000 7f3437400640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f341406c8f0 0x7f341406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3428001d50 tx=0x7f3428009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:48.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:48.845+0000 7f342fe00640 1 -- 172.21.15.71:0/4123343994 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f342004c030 con 0x7f3438158240 2024-04-20T21:20:49.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.044+0000 7f343d200640 1 -- 172.21.15.71:0/4123343994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f34380d3f10 con 0x7f3438158240 2024-04-20T21:20:49.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.045+0000 7f342fe00640 1 -- 172.21.15.71:0/4123343994 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f342007b7c0 con 0x7f3438158240 2024-04-20T21:20:49.045 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.047+0000 7f343d200640 1 -- 172.21.15.71:0/4123343994 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f341406c8f0 msgr2=0x7f341406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.047+0000 7f343d200640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f341406c8f0 0x7f341406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3428001d50 tx=0x7f3428009040 comp rx=0 tx=0).stop 2024-04-20T21:20:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.047+0000 7f343d200640 1 -- 172.21.15.71:0/4123343994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3438158240 msgr2=0x7f343815bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.047+0000 7f343d200640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3438158240 0x7f343815bec0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3420000c00 tx=0x7f3420004730 comp rx=0 tx=0).stop 2024-04-20T21:20:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.048+0000 7f343d200640 1 -- 172.21.15.71:0/4123343994 shutdown_connections 2024-04-20T21:20:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.048+0000 7f343d200640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f341406c8f0 0x7f341406edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.048+0000 7f343d200640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34380cd800 0x7f343815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.048+0000 7f343d200640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3438158240 0x7f343815bec0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.048+0000 7f343d200640 1 --2- 172.21.15.71:0/4123343994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f341c004360 0x7f34380ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.048+0000 7f343d200640 1 -- 172.21.15.71:0/4123343994 >> 172.21.15.71:0/4123343994 conn(0x7f34380d0ed0 msgr2=0x7f34380b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.048+0000 7f343d200640 1 -- 172.21.15.71:0/4123343994 shutdown_connections 2024-04-20T21:20:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.048+0000 7f343d200640 1 -- 172.21.15.71:0/4123343994 wait complete. 2024-04-20T21:20:49.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.265+0000 7f1ec4a00640 1 Processor -- start 2024-04-20T21:20:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.266+0000 7f1ec4a00640 1 -- start start 2024-04-20T21:20:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.267+0000 7f1ec4a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1ec015e750 0x7f1ec00cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.267+0000 7f1ec4a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ec00cf970 0x7f1ec00b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.267+0000 7f1ec4a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec00cfe10 con 0x7f1ec006d070 2024-04-20T21:20:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.267+0000 7f1ec4a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1ec00d0a20 con 0x7f1ec00cf970 2024-04-20T21:20:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.267+0000 7f1ec4a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1ec00d00f0 con 0x7f1ec015e750 2024-04-20T21:20:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.268+0000 7f1ebf200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ec00cf970 0x7f1ec00b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.268+0000 7f1ebf200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ec00cf970 0x7f1ec00b77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52046/0 (socket says 172.21.15.71:52046) 2024-04-20T21:20:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.268+0000 7f1ebf200640 1 -- 172.21.15.71:0/416568804 learned_addr learned my addr 172.21.15.71:0/416568804 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.268+0000 7f1ebe800640 1 --2- 172.21.15.71:0/416568804 >> v2:172.21.15.137:3300/0 conn(0x7f1ec015e750 0x7f1ec00cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.268+0000 7f1ebf200640 1 -- 172.21.15.71:0/416568804 >> v2:172.21.15.137:3300/0 conn(0x7f1ec015e750 msgr2=0x7f1ec00cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:49.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.268+0000 7f1ebf200640 1 --2- 172.21.15.71:0/416568804 >> v2:172.21.15.137:3300/0 conn(0x7f1ec015e750 0x7f1ec00cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.268+0000 7f1ebf200640 1 -- 172.21.15.71:0/416568804 >> v1:172.21.15.137:6789/0 conn(0x7f1ec006d070 legacy=0x7f1ec00d2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:49.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.268+0000 7f1ebf200640 1 -- 172.21.15.71:0/416568804 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec00d03d0 con 0x7f1ec00cf970 2024-04-20T21:20:49.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.270+0000 7f1ebf200640 1 --2- 172.21.15.71:0/416568804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec00cf970 0x7f1ec00b77b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1ec008c750 tx=0x7f1eb802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4566cd432ac1ec27 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.270+0000 7f1ebd400640 1 -- 172.21.15.71:0/416568804 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8035020 con 0x7f1ec00cf970 2024-04-20T21:20:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.270+0000 7f1ebd400640 1 -- 172.21.15.71:0/416568804 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb8031870 con 0x7f1ec00cf970 2024-04-20T21:20:49.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.270+0000 7f1ebd400640 1 -- 172.21.15.71:0/416568804 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8031c40 con 0x7f1ec00cf970 2024-04-20T21:20:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.271+0000 7f1ec4a00640 1 -- 172.21.15.71:0/416568804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec00cf970 msgr2=0x7f1ec00b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.271+0000 7f1ec4a00640 1 --2- 172.21.15.71:0/416568804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec00cf970 0x7f1ec00b77b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1ec008c750 tx=0x7f1eb802b910 comp rx=0 tx=0).stop 2024-04-20T21:20:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.271+0000 7f1ec4a00640 1 -- 172.21.15.71:0/416568804 shutdown_connections 2024-04-20T21:20:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.271+0000 7f1ec4a00640 1 --2- 172.21.15.71:0/416568804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec00cf970 0x7f1ec00b77b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.271+0000 7f1ec4a00640 1 --2- 172.21.15.71:0/416568804 >> v2:172.21.15.137:3300/0 conn(0x7f1ec015e750 0x7f1ec00cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.271+0000 7f1ec4a00640 1 -- 172.21.15.71:0/416568804 >> 172.21.15.71:0/416568804 conn(0x7f1ec00d0e50 msgr2=0x7f1ec00d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.271+0000 7f1ec4a00640 1 -- 172.21.15.71:0/416568804 shutdown_connections 2024-04-20T21:20:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.271+0000 7f1ec4a00640 1 -- 172.21.15.71:0/416568804 wait complete. 2024-04-20T21:20:49.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.273+0000 7f1ec4a00640 1 Processor -- start 2024-04-20T21:20:49.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.273+0000 7f1ec4a00640 1 -- start start 2024-04-20T21:20:49.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.274+0000 7f1ec4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec006d070 0x7f1ec01f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.274+0000 7f1ec4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ec00cf970 0x7f1ec0156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.274+0000 7f1ec4a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec015e750 0x7f1ec01566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.274+0000 7f1ec4a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec00d3840 con 0x7f1ec015e750 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.274+0000 7f1ec4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec00d36c0 con 0x7f1ec006d070 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.274+0000 7f1ec4a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec00b7cf0 con 0x7f1ec00cf970 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.274+0000 7f1ebf200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec015e750 0x7f1ec01566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.274+0000 7f1ebf200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec015e750 0x7f1ec01566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52058/0 (socket says 172.21.15.71:52058) 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.274+0000 7f1ebf200640 1 -- 172.21.15.71:0/1207684143 learned_addr learned my addr 172.21.15.71:0/1207684143 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.274+0000 7f1ebe800640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec006d070 0x7f1ec01f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1ebde00640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ec00cf970 0x7f1ec0156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1ebf200640 1 -- 172.21.15.71:0/1207684143 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ec00cf970 msgr2=0x7f1ec0156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1ebf200640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ec00cf970 0x7f1ec0156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1ebf200640 1 -- 172.21.15.71:0/1207684143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec006d070 msgr2=0x7f1ec01f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1ebf200640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec006d070 0x7f1ec01f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1ebf200640 1 -- 172.21.15.71:0/1207684143 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec00c9020 con 0x7f1ec015e750 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1ebe800640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec006d070 0x7f1ec01f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:49.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1ebde00640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ec00cf970 0x7f1ec0156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:49.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1ebf200640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec015e750 0x7f1ec01566b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1eb802b950 tx=0x7f1eb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:49.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1eb6a00640 1 -- 172.21.15.71:0/1207684143 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8040070 con 0x7f1ec015e750 2024-04-20T21:20:49.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1eb6a00640 1 -- 172.21.15.71:0/1207684143 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb8030d00 con 0x7f1ec015e750 2024-04-20T21:20:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1eb6a00640 1 -- 172.21.15.71:0/1207684143 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8035040 con 0x7f1ec015e750 2024-04-20T21:20:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.275+0000 7f1ec4a00640 1 -- 172.21.15.71:0/1207684143 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec00c9300 con 0x7f1ec015e750 2024-04-20T21:20:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.276+0000 7f1ec4a00640 1 -- 172.21.15.71:0/1207684143 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec00c98c0 con 0x7f1ec015e750 2024-04-20T21:20:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.277+0000 7f1ec4a00640 1 -- 172.21.15.71:0/1207684143 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec0075b30 con 0x7f1ec015e750 2024-04-20T21:20:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.278+0000 7f1eb6a00640 1 -- 172.21.15.71:0/1207684143 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1eb8038020 con 0x7f1ec015e750 2024-04-20T21:20:49.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.278+0000 7f1eb6a00640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1e9c06c8f0 0x7f1e9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.279+0000 7f1eb6a00640 1 -- 172.21.15.71:0/1207684143 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f1eb80addc0 con 0x7f1ec015e750 2024-04-20T21:20:49.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.279+0000 7f1ebe800640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1e9c06c8f0 0x7f1e9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.279+0000 7f1ebe800640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1e9c06c8f0 0x7f1e9c06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009f50 tx=0x7f1eb000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:49.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.283+0000 7f1eb6a00640 1 -- 172.21.15.71:0/1207684143 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1eb807bdc0 con 0x7f1ec015e750 2024-04-20T21:20:49.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.486+0000 7f1ec4a00640 1 -- 172.21.15.71:0/1207684143 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1ec01f47b0 con 0x7f1ec015e750 2024-04-20T21:20:49.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.487+0000 7f1eb6a00640 1 -- 172.21.15.71:0/1207684143 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f1eb807b6c0 con 0x7f1ec015e750 2024-04-20T21:20:49.487 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:49.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.489+0000 7f1ec4a00640 1 -- 172.21.15.71:0/1207684143 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1e9c06c8f0 msgr2=0x7f1e9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.489+0000 7f1ec4a00640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1e9c06c8f0 0x7f1e9c06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009f50 tx=0x7f1eb000b040 comp rx=0 tx=0).stop 2024-04-20T21:20:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.489+0000 7f1ec4a00640 1 -- 172.21.15.71:0/1207684143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec015e750 msgr2=0x7f1ec01566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.489+0000 7f1ec4a00640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec015e750 0x7f1ec01566b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1eb802b950 tx=0x7f1eb80046c0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.490+0000 7f1ec4a00640 1 -- 172.21.15.71:0/1207684143 shutdown_connections 2024-04-20T21:20:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.490+0000 7f1ec4a00640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1e9c06c8f0 0x7f1e9c06edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.490+0000 7f1ec4a00640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec015e750 0x7f1ec01566b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.490+0000 7f1ec4a00640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ec00cf970 0x7f1ec0156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.490+0000 7f1ec4a00640 1 --2- 172.21.15.71:0/1207684143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec006d070 0x7f1ec01f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.490+0000 7f1ec4a00640 1 -- 172.21.15.71:0/1207684143 >> 172.21.15.71:0/1207684143 conn(0x7f1ec00d0e50 msgr2=0x7f1ec00d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.490+0000 7f1ec4a00640 1 -- 172.21.15.71:0/1207684143 shutdown_connections 2024-04-20T21:20:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.490+0000 7f1ec4a00640 1 -- 172.21.15.71:0/1207684143 wait complete. 2024-04-20T21:20:49.508 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:49.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.712+0000 7f9b3ae00640 1 Processor -- start 2024-04-20T21:20:49.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.712+0000 7f9b3ae00640 1 -- start start 2024-04-20T21:20:49.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.714+0000 7f9b3ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b3415c310 0x7f9b340716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.714+0000 7f9b3ae00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9b340c7a30 0x7f9b34071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.714+0000 7f9b3ae00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b340c7ea0 con 0x7f9b340cff70 2024-04-20T21:20:49.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.714+0000 7f9b3ae00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9b3415c6f0 con 0x7f9b340c7a30 2024-04-20T21:20:49.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.714+0000 7f9b3ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3415eee0 con 0x7f9b3415c310 2024-04-20T21:20:49.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.714+0000 7f9b38e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9b340c7a30 0x7f9b34071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.714+0000 7f9b38e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9b340c7a30 0x7f9b34071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52064/0 (socket says 172.21.15.71:52064) 2024-04-20T21:20:49.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.714+0000 7f9b38e00640 1 -- 172.21.15.71:0/4058987158 learned_addr learned my addr 172.21.15.71:0/4058987158 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:49.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.715+0000 7f9b33e00640 1 --2- 172.21.15.71:0/4058987158 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b3415c310 0x7f9b340716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.715+0000 7f9b38e00640 1 -- 172.21.15.71:0/4058987158 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b3415c310 msgr2=0x7f9b340716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:49.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.715+0000 7f9b38e00640 1 --2- 172.21.15.71:0/4058987158 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b3415c310 0x7f9b340716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.715+0000 7f9b38e00640 1 -- 172.21.15.71:0/4058987158 >> v1:172.21.15.137:6789/0 conn(0x7f9b340cff70 legacy=0x7f9b340c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:49.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.715+0000 7f9b38e00640 1 -- 172.21.15.71:0/4058987158 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3415f1c0 con 0x7f9b340c7a30 2024-04-20T21:20:49.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.716+0000 7f9b38e00640 1 --2- 172.21.15.71:0/4058987158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b340c7a30 0x7f9b34071c20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009870 tx=0x7f9b2c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f2456cb9909dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.716+0000 7f9b32a00640 1 -- 172.21.15.71:0/4058987158 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c035020 con 0x7f9b340c7a30 2024-04-20T21:20:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.716+0000 7f9b32a00640 1 -- 172.21.15.71:0/4058987158 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2c031640 con 0x7f9b340c7a30 2024-04-20T21:20:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.716+0000 7f9b32a00640 1 -- 172.21.15.71:0/4058987158 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c02d040 con 0x7f9b340c7a30 2024-04-20T21:20:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.717+0000 7f9b3ae00640 1 -- 172.21.15.71:0/4058987158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b340c7a30 msgr2=0x7f9b34071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.717+0000 7f9b3ae00640 1 --2- 172.21.15.71:0/4058987158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b340c7a30 0x7f9b34071c20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009870 tx=0x7f9b2c02b8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.717+0000 7f9b3ae00640 1 -- 172.21.15.71:0/4058987158 shutdown_connections 2024-04-20T21:20:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.717+0000 7f9b3ae00640 1 --2- 172.21.15.71:0/4058987158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b340c7a30 0x7f9b34071c20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.717+0000 7f9b3ae00640 1 --2- 172.21.15.71:0/4058987158 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b3415c310 0x7f9b340716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.717+0000 7f9b3ae00640 1 -- 172.21.15.71:0/4058987158 >> 172.21.15.71:0/4058987158 conn(0x7f9b340d23a0 msgr2=0x7f9b340d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.717+0000 7f9b3ae00640 1 -- 172.21.15.71:0/4058987158 shutdown_connections 2024-04-20T21:20:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.717+0000 7f9b3ae00640 1 -- 172.21.15.71:0/4058987158 wait complete. 2024-04-20T21:20:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.719+0000 7f9b3ae00640 1 Processor -- start 2024-04-20T21:20:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.719+0000 7f9b3ae00640 1 -- start start 2024-04-20T21:20:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.720+0000 7f9b3ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b340c7a30 0x7f9b34153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.720+0000 7f9b3ae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b340cff70 0x7f9b341554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.720+0000 7f9b3ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b3415c310 0x7f9b340cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.720+0000 7f9b3ae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b34162330 con 0x7f9b340cff70 2024-04-20T21:20:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.720+0000 7f9b3ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3415f780 con 0x7f9b340c7a30 2024-04-20T21:20:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.720+0000 7f9b3ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9b341624b0 con 0x7f9b3415c310 2024-04-20T21:20:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.720+0000 7f9b33400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b340cff70 0x7f9b341554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.720+0000 7f9b33400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b340cff70 0x7f9b341554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52066/0 (socket says 172.21.15.71:52066) 2024-04-20T21:20:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.720+0000 7f9b33400640 1 -- 172.21.15.71:0/2183679459 learned_addr learned my addr 172.21.15.71:0/2183679459 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:49.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b33e00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b340c7a30 0x7f9b34153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b38e00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b3415c310 0x7f9b340cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b33400640 1 -- 172.21.15.71:0/2183679459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b3415c310 msgr2=0x7f9b340cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b33400640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b3415c310 0x7f9b340cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b33400640 1 -- 172.21.15.71:0/2183679459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b340c7a30 msgr2=0x7f9b34153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b33400640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b340c7a30 0x7f9b34153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b33400640 1 -- 172.21.15.71:0/2183679459 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b341595c0 con 0x7f9b340cff70 2024-04-20T21:20:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b33e00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b340c7a30 0x7f9b34153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b33400640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b340cff70 0x7f9b341554f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00c430 tx=0x7f9b1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b2be00640 1 -- 172.21.15.71:0/2183679459 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c011790 con 0x7f9b340cff70 2024-04-20T21:20:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b2be00640 1 -- 172.21.15.71:0/2183679459 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1c017070 con 0x7f9b340cff70 2024-04-20T21:20:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b3ae00640 1 -- 172.21.15.71:0/2183679459 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b341598a0 con 0x7f9b340cff70 2024-04-20T21:20:49.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b2be00640 1 -- 172.21.15.71:0/2183679459 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c011b70 con 0x7f9b340cff70 2024-04-20T21:20:49.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.721+0000 7f9b3ae00640 1 -- 172.21.15.71:0/2183679459 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b34159e60 con 0x7f9b340cff70 2024-04-20T21:20:49.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.723+0000 7f9b3ae00640 1 -- 172.21.15.71:0/2183679459 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b34068980 con 0x7f9b340cff70 2024-04-20T21:20:49.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.724+0000 7f9b2be00640 1 -- 172.21.15.71:0/2183679459 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b1c011d10 con 0x7f9b340cff70 2024-04-20T21:20:49.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.725+0000 7f9b2be00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9b1006c8f0 0x7f9b1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:49.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.725+0000 7f9b2be00640 1 -- 172.21.15.71:0/2183679459 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f9b1c08bec0 con 0x7f9b340cff70 2024-04-20T21:20:49.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.725+0000 7f9b33e00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9b1006c8f0 0x7f9b1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:49.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.726+0000 7f9b33e00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9b1006c8f0 0x7f9b1006edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b24009f50 tx=0x7f9b2400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:49.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.730+0000 7f9b2be00640 1 -- 172.21.15.71:0/2183679459 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9b1c059eb0 con 0x7f9b340cff70 2024-04-20T21:20:49.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.930+0000 7f9b3ae00640 1 -- 172.21.15.71:0/2183679459 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9b34161fa0 con 0x7f9b340cff70 2024-04-20T21:20:49.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.931+0000 7f9b2be00640 1 -- 172.21.15.71:0/2183679459 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f9b1c060080 con 0x7f9b340cff70 2024-04-20T21:20:49.931 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.933+0000 7f9b3ae00640 1 -- 172.21.15.71:0/2183679459 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9b1006c8f0 msgr2=0x7f9b1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.933+0000 7f9b3ae00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9b1006c8f0 0x7f9b1006edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b24009f50 tx=0x7f9b2400b040 comp rx=0 tx=0).stop 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.934+0000 7f9b3ae00640 1 -- 172.21.15.71:0/2183679459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b340cff70 msgr2=0x7f9b341554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.934+0000 7f9b3ae00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b340cff70 0x7f9b341554f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00c430 tx=0x7f9b1c00c8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.934+0000 7f9b3ae00640 1 -- 172.21.15.71:0/2183679459 shutdown_connections 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.934+0000 7f9b3ae00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9b1006c8f0 0x7f9b1006edb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.934+0000 7f9b3ae00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b3415c310 0x7f9b340cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.934+0000 7f9b3ae00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b340cff70 0x7f9b341554f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.934+0000 7f9b3ae00640 1 --2- 172.21.15.71:0/2183679459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b340c7a30 0x7f9b34153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.934+0000 7f9b3ae00640 1 -- 172.21.15.71:0/2183679459 >> 172.21.15.71:0/2183679459 conn(0x7f9b340d23a0 msgr2=0x7f9b340b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.934+0000 7f9b3ae00640 1 -- 172.21.15.71:0/2183679459 shutdown_connections 2024-04-20T21:20:49.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:49.934+0000 7f9b3ae00640 1 -- 172.21.15.71:0/2183679459 wait complete. 2024-04-20T21:20:49.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T21:20:50.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.157+0000 7fef78e00640 1 Processor -- start 2024-04-20T21:20:50.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.157+0000 7fef78e00640 1 -- start start 2024-04-20T21:20:50.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.158+0000 7fef78e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef74156c20 0x7fef7406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.158+0000 7fef78e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 0x7fef740d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.158+0000 7fef78e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef74141c60 con 0x7fef7415ca40 2024-04-20T21:20:50.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.158+0000 7fef78e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fef740adab0 con 0x7fef74156c20 2024-04-20T21:20:50.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.158+0000 7fef78e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fef7415cf90 con 0x7fef740d0360 2024-04-20T21:20:50.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.159+0000 7fef72800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 0x7fef740d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.159+0000 7fef71e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef74156c20 0x7fef7406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.159+0000 7fef72800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 0x7fef740d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:48834/0 (socket says 172.21.15.71:48834) 2024-04-20T21:20:50.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.159+0000 7fef72800640 1 -- 172.21.15.71:0/3478451255 learned_addr learned my addr 172.21.15.71:0/3478451255 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:50.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.160+0000 7fef72800640 1 -- 172.21.15.71:0/3478451255 >> v2:172.21.15.137:3300/0 conn(0x7fef74156c20 msgr2=0x7fef7406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:50.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.160+0000 7fef72800640 1 --2- 172.21.15.71:0/3478451255 >> v2:172.21.15.137:3300/0 conn(0x7fef74156c20 0x7fef7406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.160+0000 7fef72800640 1 -- 172.21.15.71:0/3478451255 >> v1:172.21.15.137:6789/0 conn(0x7fef7415ca40 legacy=0x7fef740ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:50.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.160+0000 7fef72800640 1 -- 172.21.15.71:0/3478451255 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7415d270 con 0x7fef740d0360 2024-04-20T21:20:50.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.161+0000 7fef72800640 1 --2- 172.21.15.71:0/3478451255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 0x7fef740d07f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009e50 tx=0x7fef6c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56a7d098ec41f6b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:50.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.162+0000 7fef70a00640 1 -- 172.21.15.71:0/3478451255 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c02cb00 con 0x7fef740d0360 2024-04-20T21:20:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.162+0000 7fef70a00640 1 -- 172.21.15.71:0/3478451255 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6c02cca0 con 0x7fef740d0360 2024-04-20T21:20:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.162+0000 7fef70a00640 1 -- 172.21.15.71:0/3478451255 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c034610 con 0x7fef740d0360 2024-04-20T21:20:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.163+0000 7fef78e00640 1 -- 172.21.15.71:0/3478451255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 msgr2=0x7fef740d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.163+0000 7fef78e00640 1 --2- 172.21.15.71:0/3478451255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 0x7fef740d07f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009e50 tx=0x7fef6c02bf60 comp rx=0 tx=0).stop 2024-04-20T21:20:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.163+0000 7fef78e00640 1 -- 172.21.15.71:0/3478451255 shutdown_connections 2024-04-20T21:20:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.163+0000 7fef78e00640 1 --2- 172.21.15.71:0/3478451255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 0x7fef740d07f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.163+0000 7fef78e00640 1 --2- 172.21.15.71:0/3478451255 >> v2:172.21.15.137:3300/0 conn(0x7fef74156c20 0x7fef7406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.163+0000 7fef78e00640 1 -- 172.21.15.71:0/3478451255 >> 172.21.15.71:0/3478451255 conn(0x7fef740b3350 msgr2=0x7fef740b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.163+0000 7fef78e00640 1 -- 172.21.15.71:0/3478451255 shutdown_connections 2024-04-20T21:20:50.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.163+0000 7fef78e00640 1 -- 172.21.15.71:0/3478451255 wait complete. 2024-04-20T21:20:50.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.165+0000 7fef78e00640 1 Processor -- start 2024-04-20T21:20:50.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.165+0000 7fef78e00640 1 -- start start 2024-04-20T21:20:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.166+0000 7fef78e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 0x7fef740afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.166+0000 7fef78e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef74156c20 0x7fef7415b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.166+0000 7fef78e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7415ca40 0x7fef7415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.166+0000 7fef78e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fef7406be40 con 0x7fef74156c20 2024-04-20T21:20:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.166+0000 7fef78e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fef7415d830 con 0x7fef7415ca40 2024-04-20T21:20:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.166+0000 7fef78e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fef7406bfc0 con 0x7fef740d0360 2024-04-20T21:20:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.166+0000 7fef71400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef74156c20 0x7fef7415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.166+0000 7fef71400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef74156c20 0x7fef7415b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52082/0 (socket says 172.21.15.71:52082) 2024-04-20T21:20:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.166+0000 7fef71400640 1 -- 172.21.15.71:0/3734051796 learned_addr learned my addr 172.21.15.71:0/3734051796 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:50.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef71e00640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 0x7fef740afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef72800640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7415ca40 0x7fef7415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef71400640 1 -- 172.21.15.71:0/3734051796 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 msgr2=0x7fef740afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef71400640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 0x7fef740afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef71400640 1 -- 172.21.15.71:0/3734051796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7415ca40 msgr2=0x7fef7415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef71400640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7415ca40 0x7fef7415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef71400640 1 -- 172.21.15.71:0/3734051796 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7406dbb0 con 0x7fef74156c20 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef72800640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7415ca40 0x7fef7415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef71400640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef74156c20 0x7fef7415b410 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fef6000c400 tx=0x7fef6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef6a000640 1 -- 172.21.15.71:0/3734051796 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef600052d0 con 0x7fef74156c20 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef6a000640 1 -- 172.21.15.71:0/3734051796 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef60005490 con 0x7fef74156c20 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef6a000640 1 -- 172.21.15.71:0/3734051796 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60007260 con 0x7fef74156c20 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.167+0000 7fef78e00640 1 -- 172.21.15.71:0/3734051796 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7406de90 con 0x7fef74156c20 2024-04-20T21:20:50.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.168+0000 7fef78e00640 1 -- 172.21.15.71:0/3734051796 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7406e450 con 0x7fef74156c20 2024-04-20T21:20:50.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.169+0000 7fef78e00640 1 -- 172.21.15.71:0/3734051796 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef740742b0 con 0x7fef74156c20 2024-04-20T21:20:50.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.170+0000 7fef6a000640 1 -- 172.21.15.71:0/3734051796 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef60007400 con 0x7fef74156c20 2024-04-20T21:20:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.171+0000 7fef6a000640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fef5406c8f0 0x7fef5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.171+0000 7fef6a000640 1 -- 172.21.15.71:0/3734051796 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fef6008b630 con 0x7fef74156c20 2024-04-20T21:20:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.171+0000 7fef71e00640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fef5406c8f0 0x7fef5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.172+0000 7fef71e00640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fef5406c8f0 0x7fef5406edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fef64009ad0 tx=0x7fef64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:50.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.176+0000 7fef6a000640 1 -- 172.21.15.71:0/3734051796 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fef740742b0 con 0x7fef74156c20 2024-04-20T21:20:50.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.387+0000 7fef78e00640 1 -- 172.21.15.71:0/3734051796 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fef74068980 con 0x7fef74156c20 2024-04-20T21:20:50.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.388+0000 7fef6a000640 1 -- 172.21.15.71:0/3734051796 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fef60059510 con 0x7fef74156c20 2024-04-20T21:20:50.388 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2024-04-20T21:20:50.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 -- 172.21.15.71:0/3734051796 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fef5406c8f0 msgr2=0x7fef5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:50.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fef5406c8f0 0x7fef5406edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fef64009ad0 tx=0x7fef64008040 comp rx=0 tx=0).stop 2024-04-20T21:20:50.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 -- 172.21.15.71:0/3734051796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef74156c20 msgr2=0x7fef7415b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:50.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef74156c20 0x7fef7415b410 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fef6000c400 tx=0x7fef6000c8c0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 -- 172.21.15.71:0/3734051796 shutdown_connections 2024-04-20T21:20:50.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fef5406c8f0 0x7fef5406edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef7415ca40 0x7fef7415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef74156c20 0x7fef7415b410 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 --2- 172.21.15.71:0/3734051796 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef740d0360 0x7fef740afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 -- 172.21.15.71:0/3734051796 >> 172.21.15.71:0/3734051796 conn(0x7fef740b3350 msgr2=0x7fef74072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:50.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 -- 172.21.15.71:0/3734051796 shutdown_connections 2024-04-20T21:20:50.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.391+0000 7fef78e00640 1 -- 172.21.15.71:0/3734051796 wait complete. 2024-04-20T21:20:50.409 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2024-04-20T21:20:50.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:50.409 DEBUG:teuthology.orchestra.run.smithi071:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-20T21:20:50.487 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T21:20:50.487 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2024-04-20T21:20:50.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:50.487 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-20T21:20:50.541 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:20:50.541 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:50.600 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:20:50.600 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:50.654 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:50.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.863+0000 7f6b47e00640 1 Processor -- start 2024-04-20T21:20:50.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.863+0000 7f6b47e00640 1 -- start start 2024-04-20T21:20:50.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.865+0000 7f6b47e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b480b4320 0x7f6b480adf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.865+0000 7f6b47e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b48071a80 con 0x7f6b4806b900 2024-04-20T21:20:50.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.865+0000 7f6b47e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b48071cf0 con 0x7f6b480b2f70 2024-04-20T21:20:50.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.865+0000 7f6b47e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6b48071fd0 con 0x7f6b480b4320 2024-04-20T21:20:50.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.865+0000 7f6b47400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6b4806b900 0x7f6b4806bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33198/0 (socket says 172.21.15.71:33198) 2024-04-20T21:20:50.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.865+0000 7f6b47400640 1 -- 172.21.15.71:0/2311714538 learned_addr learned my addr 172.21.15.71:0/2311714538 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:50.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b3e000640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b480b4320 0x7f6b480adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1535846641 0 0) 0x7f6b48071a80 con 0x7f6b4806b900 2024-04-20T21:20:50.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b2c003520 con 0x7f6b4806b900 2024-04-20T21:20:50.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1528062257 0 0) 0x7f6b2c003520 con 0x7f6b4806b900 2024-04-20T21:20:50.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b480b4320 msgr2=0x7f6b480adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:50.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b480b4320 0x7f6b480adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 >> v1:172.21.15.137:6789/0 conn(0x7f6b480b2f70 legacy=0x7f6b4815f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b480739c0 con 0x7f6b4806b900 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f6b40001670 con 0x7f6b4806b900 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b3e000640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b480b4320 0x7f6b480adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 >> v1:172.21.15.71:6789/0 conn(0x7f6b4806b900 legacy=0x7f6b4806bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b480b4320 0x7f6b2c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b2c003fd0 0x7f6b2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b2c004d40 0x7f6b2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48071fd0 con 0x7f6b2c003fd0 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c00bb20 con 0x7f6b2c004d40 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.866+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2c00bd20 con 0x7f6b480b4320 2024-04-20T21:20:50.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.867+0000 7f6b3e000640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b2c003fd0 0x7f6b2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.867+0000 7f6b46a00640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b480b4320 0x7f6b2c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.867+0000 7f6b47400640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b2c004d40 0x7f6b2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.867+0000 7f6b3e000640 1 -- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b480b4320 msgr2=0x7f6b2c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:50.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.867+0000 7f6b3e000640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b480b4320 0x7f6b2c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.867+0000 7f6b3e000640 1 -- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b2c004d40 msgr2=0x7f6b2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:50.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.867+0000 7f6b3e000640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b2c004d40 0x7f6b2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.867+0000 7f6b3e000640 1 -- 172.21.15.71:0/2311714538 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c003520 con 0x7f6b2c003fd0 2024-04-20T21:20:50.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.868+0000 7f6b3e000640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b2c003fd0 0x7f6b2c004800 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6b300098a0 tx=0x7f6b2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0dd7b3bf6191c8c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:50.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.868+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000f040 con 0x7f6b2c003fd0 2024-04-20T21:20:50.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.868+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b30004230 con 0x7f6b2c003fd0 2024-04-20T21:20:50.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.868+0000 7f6b46000640 1 -- 172.21.15.71:0/2311714538 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3002d040 con 0x7f6b2c003fd0 2024-04-20T21:20:50.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.869+0000 7f6b47e00640 1 -- 172.21.15.71:0/2311714538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b2c003fd0 msgr2=0x7f6b2c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:50.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.869+0000 7f6b47e00640 1 --2- 172.21.15.71:0/2311714538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b2c003fd0 0x7f6b2c004800 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6b300098a0 tx=0x7f6b2c005830 comp rx=0 tx=0).stop 2024-04-20T21:20:50.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.869+0000 7f6b47400640 1 -- 172.21.15.71:0/2311714538 reap_dead start 2024-04-20T21:20:50.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.869+0000 7f6b47e00640 1 -- 172.21.15.71:0/2311714538 shutdown_connections 2024-04-20T21:20:50.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.869+0000 7f6b47e00640 1 -- 172.21.15.71:0/2311714538 >> 172.21.15.71:0/2311714538 conn(0x7f6b480d0040 msgr2=0x7f6b480d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:50.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.869+0000 7f6b47e00640 1 -- 172.21.15.71:0/2311714538 shutdown_connections 2024-04-20T21:20:50.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.869+0000 7f6b47e00640 1 -- 172.21.15.71:0/2311714538 wait complete. 2024-04-20T21:20:50.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.871+0000 7f6b47e00640 1 Processor -- start 2024-04-20T21:20:50.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.871+0000 7f6b47e00640 1 -- start start 2024-04-20T21:20:50.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.872+0000 7f6b47e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b2c003fd0 0x7f6b4815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.872+0000 7f6b47e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b480ced00 0x7f6b4815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.872+0000 7f6b47e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b4814cd40 0x7f6b480cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.872+0000 7f6b47e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4815fe40 con 0x7f6b4814cd40 2024-04-20T21:20:50.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.872+0000 7f6b47e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4815fcc0 con 0x7f6b480ced00 2024-04-20T21:20:50.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.872+0000 7f6b47e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6b480adf60 con 0x7f6b2c003fd0 2024-04-20T21:20:50.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.872+0000 7f6b47400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b4814cd40 0x7f6b480cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b47400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b4814cd40 0x7f6b480cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52104/0 (socket says 172.21.15.71:52104) 2024-04-20T21:20:50.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b47400640 1 -- 172.21.15.71:0/2236854222 learned_addr learned my addr 172.21.15.71:0/2236854222 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b46a00640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b2c003fd0 0x7f6b4815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b3e000640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b480ced00 0x7f6b4815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b47400640 1 -- 172.21.15.71:0/2236854222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b2c003fd0 msgr2=0x7f6b4815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b47400640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b2c003fd0 0x7f6b4815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b47400640 1 -- 172.21.15.71:0/2236854222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b480ced00 msgr2=0x7f6b4815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b47400640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b480ced00 0x7f6b4815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b47400640 1 -- 172.21.15.71:0/2236854222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b480cf180 con 0x7f6b4814cd40 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b3e000640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b480ced00 0x7f6b4815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b46a00640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b2c003fd0 0x7f6b4815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b47400640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b4814cd40 0x7f6b480cc0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6b48073f30 tx=0x7f6b4000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b3f400640 1 -- 172.21.15.71:0/2236854222 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000c5b0 con 0x7f6b4814cd40 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b3f400640 1 -- 172.21.15.71:0/2236854222 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b40018070 con 0x7f6b4814cd40 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b3f400640 1 -- 172.21.15.71:0/2236854222 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000c990 con 0x7f6b4814cd40 2024-04-20T21:20:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.873+0000 7f6b47e00640 1 -- 172.21.15.71:0/2236854222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4815d100 con 0x7f6b4814cd40 2024-04-20T21:20:50.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.874+0000 7f6b47e00640 1 -- 172.21.15.71:0/2236854222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4815d6c0 con 0x7f6b4814cd40 2024-04-20T21:20:50.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.875+0000 7f6b47e00640 1 -- 172.21.15.71:0/2236854222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b48075b60 con 0x7f6b4814cd40 2024-04-20T21:20:50.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.876+0000 7f6b3f400640 1 -- 172.21.15.71:0/2236854222 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b4000cb30 con 0x7f6b4814cd40 2024-04-20T21:20:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.877+0000 7f6b3f400640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6b2406c920 0x7f6b2406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.878+0000 7f6b3f400640 1 -- 172.21.15.71:0/2236854222 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f6b4008b6f0 con 0x7f6b4814cd40 2024-04-20T21:20:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.878+0000 7f6b46a00640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6b2406c920 0x7f6b2406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.878+0000 7f6b46a00640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6b2406c920 0x7f6b2406ede0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b38007fd0 tx=0x7f6b38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:50.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:50.882+0000 7f6b3f400640 1 -- 172.21.15.71:0/2236854222 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6b400597a0 con 0x7f6b4814cd40 2024-04-20T21:20:51.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.067+0000 7f6b47e00640 1 -- 172.21.15.71:0/2236854222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b4806d220 con 0x7f6b4814cd40 2024-04-20T21:20:51.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.069+0000 7f6b3f400640 1 -- 172.21.15.71:0/2236854222 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7f6b400590a0 con 0x7f6b4814cd40 2024-04-20T21:20:51.069 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:51.069 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 -- 172.21.15.71:0/2236854222 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6b2406c920 msgr2=0x7f6b2406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6b2406c920 0x7f6b2406ede0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b38007fd0 tx=0x7f6b38009040 comp rx=0 tx=0).stop 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 -- 172.21.15.71:0/2236854222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b4814cd40 msgr2=0x7f6b480cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b4814cd40 0x7f6b480cc0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6b48073f30 tx=0x7f6b4000eb90 comp rx=0 tx=0).stop 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 -- 172.21.15.71:0/2236854222 shutdown_connections 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6b2406c920 0x7f6b2406ede0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b4814cd40 0x7f6b480cc0a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b480ced00 0x7f6b4815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 --2- 172.21.15.71:0/2236854222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6b2c003fd0 0x7f6b4815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 -- 172.21.15.71:0/2236854222 >> 172.21.15.71:0/2236854222 conn(0x7f6b480d0040 msgr2=0x7f6b4809ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 -- 172.21.15.71:0/2236854222 shutdown_connections 2024-04-20T21:20:51.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.072+0000 7f6b47e00640 1 -- 172.21.15.71:0/2236854222 wait complete. 2024-04-20T21:20:51.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:51.091 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:51.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.285+0000 7f4b62200640 1 Processor -- start 2024-04-20T21:20:51.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.286+0000 7f4b62200640 1 -- start start 2024-04-20T21:20:51.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.287+0000 7f4b62200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4b5c15cd10 0x7f4b5c15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.287+0000 7f4b62200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b5c13f900 con 0x7f4b5c0cfd80 2024-04-20T21:20:51.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.287+0000 7f4b62200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b5c1426c0 con 0x7f4b5c0ce820 2024-04-20T21:20:51.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.287+0000 7f4b62200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4b5c0c7030 con 0x7f4b5c15cd10 2024-04-20T21:20:51.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.287+0000 7f4b60e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4b5c0cfd80 0x7f4b5c0d0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33208/0 (socket says 172.21.15.71:33208) 2024-04-20T21:20:51.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.287+0000 7f4b60e00640 1 -- 172.21.15.71:0/822656426 learned_addr learned my addr 172.21.15.71:0/822656426 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452388372 0 0) 0x7f4b4c001110 con 0x7f4b5c0cfd80 2024-04-20T21:20:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b3c003520 con 0x7f4b5c0cfd80 2024-04-20T21:20:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5be00640 1 --2- 172.21.15.71:0/822656426 >> v2:172.21.15.137:3300/0 conn(0x7f4b5c15cd10 0x7f4b5c15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1488330940 0 0) 0x7f4b3c003520 con 0x7f4b5c0cfd80 2024-04-20T21:20:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 >> v2:172.21.15.137:3300/0 conn(0x7f4b5c15cd10 msgr2=0x7f4b5c15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 --2- 172.21.15.71:0/822656426 >> v2:172.21.15.137:3300/0 conn(0x7f4b5c15cd10 0x7f4b5c15d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 >> v1:172.21.15.137:6789/0 conn(0x7f4b5c0ce820 legacy=0x7f4b5c0cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c0c7280 con 0x7f4b5c0cfd80 2024-04-20T21:20:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f4b4c001840 con 0x7f4b5c0cfd80 2024-04-20T21:20:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 >> v1:172.21.15.71:6789/0 conn(0x7f4b5c0cfd80 legacy=0x7f4b5c0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 --2- 172.21.15.71:0/822656426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b3c0039b0 0x7f4b3c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 --2- 172.21.15.71:0/822656426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c004800 0x7f4b3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 --2- 172.21.15.71:0/822656426 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b3c0052e0 0x7f4b3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c0c7030 con 0x7f4b3c0039b0 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c00c190 con 0x7f4b3c004800 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.288+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4b3c00c390 con 0x7f4b3c0052e0 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.289+0000 7f4b60e00640 1 --2- 172.21.15.71:0/822656426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b3c0039b0 0x7f4b3c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.289+0000 7f4b60e00640 1 -- 172.21.15.71:0/822656426 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b3c0052e0 msgr2=0x7f4b3c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.289+0000 7f4b60e00640 1 --2- 172.21.15.71:0/822656426 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b3c0052e0 0x7f4b3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.289+0000 7f4b60e00640 1 -- 172.21.15.71:0/822656426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c004800 msgr2=0x7f4b3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.289+0000 7f4b60e00640 1 --2- 172.21.15.71:0/822656426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c004800 0x7f4b3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.289+0000 7f4b60e00640 1 -- 172.21.15.71:0/822656426 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c003520 con 0x7f4b3c0039b0 2024-04-20T21:20:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.289+0000 7f4b61800640 1 -- 172.21.15.71:0/822656426 reap_dead start 2024-04-20T21:20:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.290+0000 7f4b60e00640 1 --2- 172.21.15.71:0/822656426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b3c0039b0 0x7f4b3c003db0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00c490 tx=0x7f4b3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a306e61f27c31660 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.290+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c00c0e0 con 0x7f4b3c0039b0 2024-04-20T21:20:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.290+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4c030070 con 0x7f4b3c0039b0 2024-04-20T21:20:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.290+0000 7f4b5b400640 1 -- 172.21.15.71:0/822656426 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0058d0 con 0x7f4b3c0039b0 2024-04-20T21:20:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.291+0000 7f4b62200640 1 -- 172.21.15.71:0/822656426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b3c0039b0 msgr2=0x7f4b3c003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.291+0000 7f4b62200640 1 --2- 172.21.15.71:0/822656426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b3c0039b0 0x7f4b3c003db0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00c490 tx=0x7f4b3c005830 comp rx=0 tx=0).stop 2024-04-20T21:20:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.291+0000 7f4b62200640 1 -- 172.21.15.71:0/822656426 shutdown_connections 2024-04-20T21:20:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.291+0000 7f4b62200640 1 --2- 172.21.15.71:0/822656426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b3c0039b0 0x7f4b3c003db0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.291+0000 7f4b62200640 1 -- 172.21.15.71:0/822656426 >> 172.21.15.71:0/822656426 conn(0x7f4b5c0b3dc0 msgr2=0x7f4b5c0b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.291+0000 7f4b62200640 1 -- 172.21.15.71:0/822656426 shutdown_connections 2024-04-20T21:20:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.291+0000 7f4b62200640 1 -- 172.21.15.71:0/822656426 wait complete. 2024-04-20T21:20:51.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.292+0000 7f4b62200640 1 Processor -- start 2024-04-20T21:20:51.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.293+0000 7f4b62200640 1 -- start start 2024-04-20T21:20:51.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.293+0000 7f4b62200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b3c0039b0 0x7f4b5c152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.293+0000 7f4b62200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b5c0cd690 0x7f4b5c0cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b62200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b5c1f7c40 0x7f4b5c1f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b62200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c0d0160 con 0x7f4b5c0cd690 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b62200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c0c7840 con 0x7f4b5c1f7c40 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b62200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4b5c0d02e0 con 0x7f4b3c0039b0 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b5be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b5c0cd690 0x7f4b5c0cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b5be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b5c0cd690 0x7f4b5c0cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52122/0 (socket says 172.21.15.71:52122) 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b5be00640 1 -- 172.21.15.71:0/526283820 learned_addr learned my addr 172.21.15.71:0/526283820 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b5be00640 1 -- 172.21.15.71:0/526283820 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b3c0039b0 msgr2=0x7f4b5c152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b5be00640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b3c0039b0 0x7f4b5c152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b5be00640 1 -- 172.21.15.71:0/526283820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b5c1f7c40 msgr2=0x7f4b5c1f80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b5be00640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b5c1f7c40 0x7f4b5c1f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b5be00640 1 -- 172.21.15.71:0/526283820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c1f4610 con 0x7f4b5c0cd690 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.294+0000 7f4b5be00640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b5c0cd690 0x7f4b5c0cdb10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400d530 tx=0x7f4b4400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.295+0000 7f4b58c00640 1 -- 172.21.15.71:0/526283820 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b440125f0 con 0x7f4b5c0cd690 2024-04-20T21:20:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.295+0000 7f4b58c00640 1 -- 172.21.15.71:0/526283820 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b44019070 con 0x7f4b5c0cd690 2024-04-20T21:20:51.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.295+0000 7f4b62200640 1 -- 172.21.15.71:0/526283820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5c1f4880 con 0x7f4b5c0cd690 2024-04-20T21:20:51.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.295+0000 7f4b58c00640 1 -- 172.21.15.71:0/526283820 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b440129d0 con 0x7f4b5c0cd690 2024-04-20T21:20:51.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.295+0000 7f4b62200640 1 -- 172.21.15.71:0/526283820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b5c1f4e40 con 0x7f4b5c0cd690 2024-04-20T21:20:51.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.296+0000 7f4b62200640 1 -- 172.21.15.71:0/526283820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5c075b30 con 0x7f4b5c0cd690 2024-04-20T21:20:51.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.297+0000 7f4b58c00640 1 -- 172.21.15.71:0/526283820 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b44012b70 con 0x7f4b5c0cd690 2024-04-20T21:20:51.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.298+0000 7f4b58c00640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b3806c920 0x7f4b3806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.298+0000 7f4b58c00640 1 -- 172.21.15.71:0/526283820 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f4b4408c1f0 con 0x7f4b5c0cd690 2024-04-20T21:20:51.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.298+0000 7f4b60e00640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b3806c920 0x7f4b3806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:51.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.299+0000 7f4b60e00640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b3806c920 0x7f4b3806ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c034000 tx=0x7f4b4c007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:51.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.302+0000 7f4b58c00640 1 -- 172.21.15.71:0/526283820 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4b4405a1f0 con 0x7f4b5c0cd690 2024-04-20T21:20:51.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.498+0000 7f4b62200640 1 -- 172.21.15.71:0/526283820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4b5c15d1a0 con 0x7f4b5c0cd690 2024-04-20T21:20:51.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.499+0000 7f4b58c00640 1 -- 172.21.15.71:0/526283820 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f4b44059af0 con 0x7f4b5c0cd690 2024-04-20T21:20:51.499 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:51.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 -- 172.21.15.71:0/526283820 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b3806c920 msgr2=0x7f4b3806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b3806c920 0x7f4b3806ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c034000 tx=0x7f4b4c007000 comp rx=0 tx=0).stop 2024-04-20T21:20:51.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 -- 172.21.15.71:0/526283820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b5c0cd690 msgr2=0x7f4b5c0cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b5c0cd690 0x7f4b5c0cdb10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400d530 tx=0x7f4b4400d9f0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 -- 172.21.15.71:0/526283820 shutdown_connections 2024-04-20T21:20:51.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f4b3806c920 0x7f4b3806ede0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b5c1f7c40 0x7f4b5c1f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b5c0cd690 0x7f4b5c0cdb10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 --2- 172.21.15.71:0/526283820 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b3c0039b0 0x7f4b5c152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 -- 172.21.15.71:0/526283820 >> 172.21.15.71:0/526283820 conn(0x7f4b5c0b3dc0 msgr2=0x7f4b5c15d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:51.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 -- 172.21.15.71:0/526283820 shutdown_connections 2024-04-20T21:20:51.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.502+0000 7f4b62200640 1 -- 172.21.15.71:0/526283820 wait complete. 2024-04-20T21:20:51.520 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:51.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.721+0000 7f115a000640 1 Processor -- start 2024-04-20T21:20:51.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.722+0000 7f115a000640 1 -- start start 2024-04-20T21:20:51.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.723+0000 7f115a000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1154156c20 0x7f115406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.723+0000 7f115a000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1154141c60 con 0x7f11540d0360 2024-04-20T21:20:51.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.723+0000 7f115a000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11540adab0 con 0x7f115415ca40 2024-04-20T21:20:51.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.723+0000 7f115a000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f115415cf90 con 0x7f1154156c20 2024-04-20T21:20:51.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.724+0000 7f1153e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f11540d0360 0x7f1154142140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33224/0 (socket says 172.21.15.71:33224) 2024-04-20T21:20:51.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.724+0000 7f1153e00640 1 -- 172.21.15.71:0/2109434399 learned_addr learned my addr 172.21.15.71:0/2109434399 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:51.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.724+0000 7f1153400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1154156c20 0x7f115406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:51.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.724+0000 7f1152a00640 1 -- 172.21.15.71:0/2109434399 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559792528 0 0) 0x7f1154141c60 con 0x7f11540d0360 2024-04-20T21:20:51.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.724+0000 7f1152a00640 1 -- 172.21.15.71:0/2109434399 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1138003520 con 0x7f11540d0360 2024-04-20T21:20:51.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.724+0000 7f1153400640 1 -- 172.21.15.71:0/2109434399 >> v1:172.21.15.137:6789/0 conn(0x7f115415ca40 legacy=0x7f11540ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:51.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.724+0000 7f1153400640 1 -- 172.21.15.71:0/2109434399 >> v1:172.21.15.71:6789/0 conn(0x7f11540d0360 legacy=0x7f1154142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.724+0000 7f1153400640 1 -- 172.21.15.71:0/2109434399 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115415d270 con 0x7f1154156c20 2024-04-20T21:20:51.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.725+0000 7f1153400640 1 --2- 172.21.15.71:0/2109434399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1154156c20 0x7f115406b900 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f11440097a0 tx=0x7f114402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ce4c5dccb941c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:51.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.726+0000 7f1152a00640 1 -- 172.21.15.71:0/2109434399 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144034070 con 0x7f1154156c20 2024-04-20T21:20:51.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.726+0000 7f1152a00640 1 -- 172.21.15.71:0/2109434399 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1144030610 con 0x7f1154156c20 2024-04-20T21:20:51.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.726+0000 7f1152a00640 1 -- 172.21.15.71:0/2109434399 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11440309e0 con 0x7f1154156c20 2024-04-20T21:20:51.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.726+0000 7f115a000640 1 -- 172.21.15.71:0/2109434399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1154156c20 msgr2=0x7f115406b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.726+0000 7f115a000640 1 --2- 172.21.15.71:0/2109434399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1154156c20 0x7f115406b900 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f11440097a0 tx=0x7f114402b960 comp rx=0 tx=0).stop 2024-04-20T21:20:51.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.726+0000 7f115a000640 1 -- 172.21.15.71:0/2109434399 shutdown_connections 2024-04-20T21:20:51.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.726+0000 7f115a000640 1 --2- 172.21.15.71:0/2109434399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1154156c20 0x7f115406b900 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.726+0000 7f115a000640 1 -- 172.21.15.71:0/2109434399 >> 172.21.15.71:0/2109434399 conn(0x7f11540b3350 msgr2=0x7f11540b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:51.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.727+0000 7f115a000640 1 -- 172.21.15.71:0/2109434399 shutdown_connections 2024-04-20T21:20:51.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.727+0000 7f115a000640 1 -- 172.21.15.71:0/2109434399 wait complete. 2024-04-20T21:20:51.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.728+0000 7f115a000640 1 Processor -- start 2024-04-20T21:20:51.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.728+0000 7f115a000640 1 -- start start 2024-04-20T21:20:51.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.729+0000 7f115a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11540d0360 0x7f11540ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.729+0000 7f115a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1154156c20 0x7f11540ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.729+0000 7f115a000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f115415ca40 0x7f1154099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.729+0000 7f115a000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f115406be40 con 0x7f115415ca40 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.729+0000 7f115a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f115415d830 con 0x7f11540d0360 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.729+0000 7f115a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f115406bfc0 con 0x7f1154156c20 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.730+0000 7f1153e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f115415ca40 0x7f1154099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.730+0000 7f1153e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f115415ca40 0x7f1154099940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52136/0 (socket says 172.21.15.71:52136) 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.730+0000 7f1153e00640 1 -- 172.21.15.71:0/894306731 learned_addr learned my addr 172.21.15.71:0/894306731 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.730+0000 7f1153400640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11540d0360 0x7f11540ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.730+0000 7f114be00640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1154156c20 0x7f11540ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.730+0000 7f1153e00640 1 -- 172.21.15.71:0/894306731 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1154156c20 msgr2=0x7f11540ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.730+0000 7f1153e00640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1154156c20 0x7f11540ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.730+0000 7f1153e00640 1 -- 172.21.15.71:0/894306731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11540d0360 msgr2=0x7f11540ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.730+0000 7f1153e00640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11540d0360 0x7f11540ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.730+0000 7f1153e00640 1 -- 172.21.15.71:0/894306731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1154099e80 con 0x7f115415ca40 2024-04-20T21:20:51.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.731+0000 7f1153e00640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f115415ca40 0x7f1154099940 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f114c00cad0 tx=0x7f114c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:51.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.731+0000 7f114b400640 1 -- 172.21.15.71:0/894306731 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c017070 con 0x7f115415ca40 2024-04-20T21:20:51.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.731+0000 7f114b400640 1 -- 172.21.15.71:0/894306731 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f114c00ac30 con 0x7f115415ca40 2024-04-20T21:20:51.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.731+0000 7f114b400640 1 -- 172.21.15.71:0/894306731 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c012400 con 0x7f115415ca40 2024-04-20T21:20:51.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.731+0000 7f115a000640 1 -- 172.21.15.71:0/894306731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11540cd2a0 con 0x7f115415ca40 2024-04-20T21:20:51.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.731+0000 7f115a000640 1 -- 172.21.15.71:0/894306731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11540cd860 con 0x7f115415ca40 2024-04-20T21:20:51.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.732+0000 7f115a000640 1 -- 172.21.15.71:0/894306731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11540d09d0 con 0x7f115415ca40 2024-04-20T21:20:51.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.733+0000 7f114b400640 1 -- 172.21.15.71:0/894306731 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f114c01a070 con 0x7f115415ca40 2024-04-20T21:20:51.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.734+0000 7f114b400640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f113006c920 0x7f113006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:51.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.735+0000 7f114b400640 1 -- 172.21.15.71:0/894306731 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f114c08bdc0 con 0x7f115415ca40 2024-04-20T21:20:51.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.735+0000 7f1153400640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f113006c920 0x7f113006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:51.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.735+0000 7f1153400640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f113006c920 0x7f113006ede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1144036000 tx=0x7f114403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:51.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.739+0000 7f114b400640 1 -- 172.21.15.71:0/894306731 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f11540d09d0 con 0x7f115415ca40 2024-04-20T21:20:51.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.939+0000 7f115a000640 1 -- 172.21.15.71:0/894306731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1154068980 con 0x7f115415ca40 2024-04-20T21:20:51.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.940+0000 7f114b400640 1 -- 172.21.15.71:0/894306731 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f1154099e80 con 0x7f115415ca40 2024-04-20T21:20:51.940 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 -- 172.21.15.71:0/894306731 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f113006c920 msgr2=0x7f113006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f113006c920 0x7f113006ede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1144036000 tx=0x7f114403b040 comp rx=0 tx=0).stop 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 -- 172.21.15.71:0/894306731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f115415ca40 msgr2=0x7f1154099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f115415ca40 0x7f1154099940 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f114c00cad0 tx=0x7f114c00cf90 comp rx=0 tx=0).stop 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 -- 172.21.15.71:0/894306731 shutdown_connections 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f113006c920 0x7f113006ede0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f115415ca40 0x7f1154099940 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1154156c20 0x7f11540ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 --2- 172.21.15.71:0/894306731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11540d0360 0x7f11540ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 -- 172.21.15.71:0/894306731 >> 172.21.15.71:0/894306731 conn(0x7f11540b3350 msgr2=0x7f115415e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 -- 172.21.15.71:0/894306731 shutdown_connections 2024-04-20T21:20:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:51.943+0000 7f115a000640 1 -- 172.21.15.71:0/894306731 wait complete. 2024-04-20T21:20:51.962 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:52.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.164+0000 7f5fc6200640 1 Processor -- start 2024-04-20T21:20:52.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.165+0000 7f5fc6200640 1 -- start start 2024-04-20T21:20:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.166+0000 7f5fc6200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5fc00d0360 0x7f5fc00d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.166+0000 7f5fc6200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fc00ade40 con 0x7f5fc015b3b0 2024-04-20T21:20:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.166+0000 7f5fc6200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fc00ae0e0 con 0x7f5fc006dcb0 2024-04-20T21:20:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.166+0000 7f5fc6200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc006f1b0 con 0x7f5fc00d0360 2024-04-20T21:20:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.166+0000 7f5fbf400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5fc015b3b0 0x7f5fc006eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33236/0 (socket says 172.21.15.71:33236) 2024-04-20T21:20:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.166+0000 7f5fbf400640 1 -- 172.21.15.71:0/4133849185 learned_addr learned my addr 172.21.15.71:0/4133849185 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.166+0000 7f5fbfe00640 1 --2- 172.21.15.71:0/4133849185 >> v2:172.21.15.71:3300/0 conn(0x7f5fc00d0360 0x7f5fc00d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.167+0000 7f5fbe000640 1 -- 172.21.15.71:0/4133849185 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3235759096 0 0) 0x7f5fc00ade40 con 0x7f5fc015b3b0 2024-04-20T21:20:52.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.167+0000 7f5fbe000640 1 -- 172.21.15.71:0/4133849185 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fa0003520 con 0x7f5fc015b3b0 2024-04-20T21:20:52.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.167+0000 7f5fbfe00640 1 -- 172.21.15.71:0/4133849185 >> v1:172.21.15.137:6789/0 conn(0x7f5fc006dcb0 legacy=0x7f5fc0071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:52.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.167+0000 7f5fbfe00640 1 -- 172.21.15.71:0/4133849185 >> v1:172.21.15.71:6789/0 conn(0x7f5fc015b3b0 legacy=0x7f5fc006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:52.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.167+0000 7f5fbfe00640 1 -- 172.21.15.71:0/4133849185 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc015b790 con 0x7f5fc00d0360 2024-04-20T21:20:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.168+0000 7f5fbfe00640 1 --2- 172.21.15.71:0/4133849185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc00d0360 0x7f5fc00d0770 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0073c80 tx=0x7f5fb802b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae9d52eefaf09d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.168+0000 7f5fbe000640 1 -- 172.21.15.71:0/4133849185 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8035020 con 0x7f5fc00d0360 2024-04-20T21:20:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.168+0000 7f5fbe000640 1 -- 172.21.15.71:0/4133849185 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb8031800 con 0x7f5fc00d0360 2024-04-20T21:20:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.168+0000 7f5fbe000640 1 -- 172.21.15.71:0/4133849185 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8031bd0 con 0x7f5fc00d0360 2024-04-20T21:20:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.169+0000 7f5fc6200640 1 -- 172.21.15.71:0/4133849185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc00d0360 msgr2=0x7f5fc00d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.169+0000 7f5fc6200640 1 --2- 172.21.15.71:0/4133849185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc00d0360 0x7f5fc00d0770 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0073c80 tx=0x7f5fb802b8a0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.169+0000 7f5fc6200640 1 -- 172.21.15.71:0/4133849185 shutdown_connections 2024-04-20T21:20:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.169+0000 7f5fc6200640 1 --2- 172.21.15.71:0/4133849185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc00d0360 0x7f5fc00d0770 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.169+0000 7f5fc6200640 1 -- 172.21.15.71:0/4133849185 >> 172.21.15.71:0/4133849185 conn(0x7f5fc00b3350 msgr2=0x7f5fc00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:52.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.169+0000 7f5fc6200640 1 -- 172.21.15.71:0/4133849185 shutdown_connections 2024-04-20T21:20:52.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.169+0000 7f5fc6200640 1 -- 172.21.15.71:0/4133849185 wait complete. 2024-04-20T21:20:52.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.171+0000 7f5fc6200640 1 Processor -- start 2024-04-20T21:20:52.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.171+0000 7f5fc6200640 1 -- start start 2024-04-20T21:20:52.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.172+0000 7f5fc6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fc006dcb0 0x7f5fc014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.172+0000 7f5fc6200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00d0360 0x7f5fc01f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.172+0000 7f5fc6200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc015b3b0 0x7f5fc015b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.172+0000 7f5fc6200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc00ae940 con 0x7f5fc015b3b0 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.172+0000 7f5fc6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc00ae660 con 0x7f5fc006dcb0 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.172+0000 7f5fc6200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc00aec20 con 0x7f5fc00d0360 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.172+0000 7f5fbfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc015b3b0 0x7f5fc015b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.172+0000 7f5fbfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc015b3b0 0x7f5fc015b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52146/0 (socket says 172.21.15.71:52146) 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.172+0000 7f5fbfe00640 1 -- 172.21.15.71:0/580543540 learned_addr learned my addr 172.21.15.71:0/580543540 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.173+0000 7f5fbf400640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fc006dcb0 0x7f5fc014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.173+0000 7f5fbfe00640 1 -- 172.21.15.71:0/580543540 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00d0360 msgr2=0x7f5fc01f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.173+0000 7f5fbea00640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00d0360 0x7f5fc01f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.173+0000 7f5fbfe00640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00d0360 0x7f5fc01f10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.173+0000 7f5fbfe00640 1 -- 172.21.15.71:0/580543540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fc006dcb0 msgr2=0x7f5fc014e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.173+0000 7f5fbfe00640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fc006dcb0 0x7f5fc014e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.173+0000 7f5fbfe00640 1 -- 172.21.15.71:0/580543540 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc01f3f00 con 0x7f5fc015b3b0 2024-04-20T21:20:52.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.173+0000 7f5fbfe00640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc015b3b0 0x7f5fc015b990 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5fb802beb0 tx=0x7f5fb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:52.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.173+0000 7f5fb7400640 1 -- 172.21.15.71:0/580543540 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8048070 con 0x7f5fc015b3b0 2024-04-20T21:20:52.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.174+0000 7f5fb7400640 1 -- 172.21.15.71:0/580543540 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb803bcf0 con 0x7f5fc015b3b0 2024-04-20T21:20:52.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.174+0000 7f5fb7400640 1 -- 172.21.15.71:0/580543540 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8043610 con 0x7f5fc015b3b0 2024-04-20T21:20:52.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.174+0000 7f5fc6200640 1 -- 172.21.15.71:0/580543540 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc006bff0 con 0x7f5fc015b3b0 2024-04-20T21:20:52.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.174+0000 7f5fc6200640 1 -- 172.21.15.71:0/580543540 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc006c2d0 con 0x7f5fc015b3b0 2024-04-20T21:20:52.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.175+0000 7f5fc6200640 1 -- 172.21.15.71:0/580543540 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc006be10 con 0x7f5fc015b3b0 2024-04-20T21:20:52.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.176+0000 7f5fb7400640 1 -- 172.21.15.71:0/580543540 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fb804b070 con 0x7f5fc015b3b0 2024-04-20T21:20:52.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.177+0000 7f5fb7400640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5f9c06c8f0 0x7f5f9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.177+0000 7f5fb7400640 1 -- 172.21.15.71:0/580543540 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f5fb80add50 con 0x7f5fc015b3b0 2024-04-20T21:20:52.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.177+0000 7f5fbf400640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5f9c06c8f0 0x7f5f9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.178+0000 7f5fbf400640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5f9c06c8f0 0x7f5f9c06edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0005880 tx=0x7f5fb0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:52.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.181+0000 7f5fb7400640 1 -- 172.21.15.71:0/580543540 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5fc006be10 con 0x7f5fc015b3b0 2024-04-20T21:20:52.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.379+0000 7f5fc6200640 1 -- 172.21.15.71:0/580543540 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5fc0068980 con 0x7f5fc015b3b0 2024-04-20T21:20:52.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.381+0000 7f5fb7400640 1 -- 172.21.15.71:0/580543540 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f5fb8040070 con 0x7f5fc015b3b0 2024-04-20T21:20:52.380 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:52.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.383+0000 7f5fc6200640 1 -- 172.21.15.71:0/580543540 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5f9c06c8f0 msgr2=0x7f5f9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:52.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.383+0000 7f5fc6200640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5f9c06c8f0 0x7f5f9c06edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0005880 tx=0x7f5fb0009040 comp rx=0 tx=0).stop 2024-04-20T21:20:52.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.383+0000 7f5fc6200640 1 -- 172.21.15.71:0/580543540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc015b3b0 msgr2=0x7f5fc015b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:52.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.383+0000 7f5fc6200640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc015b3b0 0x7f5fc015b990 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5fb802beb0 tx=0x7f5fb80046c0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.384+0000 7f5fc6200640 1 -- 172.21.15.71:0/580543540 shutdown_connections 2024-04-20T21:20:52.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.384+0000 7f5fc6200640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5f9c06c8f0 0x7f5f9c06edb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.384+0000 7f5fc6200640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc015b3b0 0x7f5fc015b990 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.384+0000 7f5fc6200640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00d0360 0x7f5fc01f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.384+0000 7f5fc6200640 1 --2- 172.21.15.71:0/580543540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fc006dcb0 0x7f5fc014e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.384+0000 7f5fc6200640 1 -- 172.21.15.71:0/580543540 >> 172.21.15.71:0/580543540 conn(0x7f5fc00b3350 msgr2=0x7f5fc00b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:52.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.384+0000 7f5fc6200640 1 -- 172.21.15.71:0/580543540 shutdown_connections 2024-04-20T21:20:52.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.384+0000 7f5fc6200640 1 -- 172.21.15.71:0/580543540 wait complete. 2024-04-20T21:20:52.404 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:52.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.607+0000 7f5b7a200640 1 Processor -- start 2024-04-20T21:20:52.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.607+0000 7f5b7a200640 1 -- start start 2024-04-20T21:20:52.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.608+0000 7f5b7a200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b74156c20 0x7f5b7406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.608+0000 7f5b7a200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5b7415ca40 0x7f5b740ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b7a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b740ad8e0 0x7f5b740d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b7a200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5b74141c60 con 0x7f5b74156c20 2024-04-20T21:20:52.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b7a200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5b7415cf90 con 0x7f5b7415ca40 2024-04-20T21:20:52.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b7a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5b7415d270 con 0x7f5b740ad8e0 2024-04-20T21:20:52.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b73400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b74156c20 0x7f5b7406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b73400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b74156c20 0x7f5b7406b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52158/0 (socket says 172.21.15.71:52158) 2024-04-20T21:20:52.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b73400640 1 -- 172.21.15.71:0/1351832416 learned_addr learned my addr 172.21.15.71:0/1351832416 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b72a00640 1 --2- 172.21.15.71:0/1351832416 >> v2:172.21.15.137:3300/0 conn(0x7f5b7415ca40 0x7f5b740ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b73e00640 1 --2- 172.21.15.71:0/1351832416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b740ad8e0 0x7f5b740d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b73400640 1 -- 172.21.15.71:0/1351832416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b740ad8e0 msgr2=0x7f5b740d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b73400640 1 --2- 172.21.15.71:0/1351832416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b740ad8e0 0x7f5b740d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b73400640 1 -- 172.21.15.71:0/1351832416 >> v2:172.21.15.137:3300/0 conn(0x7f5b7415ca40 msgr2=0x7f5b740ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b73400640 1 --2- 172.21.15.71:0/1351832416 >> v2:172.21.15.137:3300/0 conn(0x7f5b7415ca40 0x7f5b740ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b73400640 1 -- 172.21.15.71:0/1351832416 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7415d550 con 0x7f5b74156c20 2024-04-20T21:20:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.609+0000 7f5b73e00640 1 --2- 172.21.15.71:0/1351832416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b740ad8e0 0x7f5b740d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.611+0000 7f5b73400640 1 --2- 172.21.15.71:0/1351832416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b74156c20 0x7f5b7406b900 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5b7406fe40 tx=0x7f5b6402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ca1e8eae1110ed server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.611+0000 7f5b72000640 1 -- 172.21.15.71:0/1351832416 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64035020 con 0x7f5b74156c20 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.611+0000 7f5b72000640 1 -- 172.21.15.71:0/1351832416 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b64031870 con 0x7f5b74156c20 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.611+0000 7f5b72000640 1 -- 172.21.15.71:0/1351832416 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64031c40 con 0x7f5b74156c20 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.611+0000 7f5b7a200640 1 -- 172.21.15.71:0/1351832416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b74156c20 msgr2=0x7f5b7406b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.611+0000 7f5b7a200640 1 --2- 172.21.15.71:0/1351832416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b74156c20 0x7f5b7406b900 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5b7406fe40 tx=0x7f5b6402b910 comp rx=0 tx=0).stop 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.612+0000 7f5b7a200640 1 -- 172.21.15.71:0/1351832416 shutdown_connections 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.612+0000 7f5b7a200640 1 --2- 172.21.15.71:0/1351832416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b740ad8e0 0x7f5b740d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.612+0000 7f5b7a200640 1 --2- 172.21.15.71:0/1351832416 >> v2:172.21.15.137:3300/0 conn(0x7f5b7415ca40 0x7f5b740ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.612+0000 7f5b7a200640 1 --2- 172.21.15.71:0/1351832416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b74156c20 0x7f5b7406b900 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.612+0000 7f5b7a200640 1 -- 172.21.15.71:0/1351832416 >> 172.21.15.71:0/1351832416 conn(0x7f5b740b3350 msgr2=0x7f5b740b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.612+0000 7f5b7a200640 1 -- 172.21.15.71:0/1351832416 shutdown_connections 2024-04-20T21:20:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.612+0000 7f5b7a200640 1 -- 172.21.15.71:0/1351832416 wait complete. 2024-04-20T21:20:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.613+0000 7f5b7a200640 1 Processor -- start 2024-04-20T21:20:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.614+0000 7f5b7a200640 1 -- start start 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.614+0000 7f5b7a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b740ad8e0 0x7f5b7414e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b7a200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b74156c20 0x7f5b741f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b7a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b7415ca40 0x7f5b740ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b7a200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7406bfc0 con 0x7f5b74156c20 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b7a200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7406be40 con 0x7f5b7415ca40 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b7a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5b740d08a0 con 0x7f5b740ad8e0 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b72a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b74156c20 0x7f5b741f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b72a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b74156c20 0x7f5b741f2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52162/0 (socket says 172.21.15.71:52162) 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b72a00640 1 -- 172.21.15.71:0/1116551668 learned_addr learned my addr 172.21.15.71:0/1116551668 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b73400640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b740ad8e0 0x7f5b7414e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b73e00640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b7415ca40 0x7f5b740ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b72a00640 1 -- 172.21.15.71:0/1116551668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b740ad8e0 msgr2=0x7f5b7414e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b72a00640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b740ad8e0 0x7f5b7414e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b72a00640 1 -- 172.21.15.71:0/1116551668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b7415ca40 msgr2=0x7f5b740ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:52.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b72a00640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b7415ca40 0x7f5b740ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.615+0000 7f5b72a00640 1 -- 172.21.15.71:0/1116551668 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7414f120 con 0x7f5b74156c20 2024-04-20T21:20:52.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.616+0000 7f5b72a00640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b74156c20 0x7f5b741f2240 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000d5f0 tx=0x7f5b6000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:52.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.616+0000 7f5b6b400640 1 -- 172.21.15.71:0/1116551668 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b600125f0 con 0x7f5b74156c20 2024-04-20T21:20:52.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.616+0000 7f5b6b400640 1 -- 172.21.15.71:0/1116551668 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b60019070 con 0x7f5b74156c20 2024-04-20T21:20:52.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.616+0000 7f5b6b400640 1 -- 172.21.15.71:0/1116551668 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b600129d0 con 0x7f5b74156c20 2024-04-20T21:20:52.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.616+0000 7f5b7a200640 1 -- 172.21.15.71:0/1116551668 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7414ee40 con 0x7f5b74156c20 2024-04-20T21:20:52.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.616+0000 7f5b7a200640 1 -- 172.21.15.71:0/1116551668 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b74097ee0 con 0x7f5b74156c20 2024-04-20T21:20:52.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.617+0000 7f5b7a200640 1 -- 172.21.15.71:0/1116551668 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b74068980 con 0x7f5b74156c20 2024-04-20T21:20:52.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.618+0000 7f5b6b400640 1 -- 172.21.15.71:0/1116551668 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b60012b70 con 0x7f5b74156c20 2024-04-20T21:20:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.619+0000 7f5b6b400640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5b5406c920 0x7f5b5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.619+0000 7f5b6b400640 1 -- 172.21.15.71:0/1116551668 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f5b6008c360 con 0x7f5b74156c20 2024-04-20T21:20:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.619+0000 7f5b73400640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5b5406c920 0x7f5b5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.620+0000 7f5b73400640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5b5406c920 0x7f5b5406ede0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5b64036000 tx=0x7f5b6403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:52.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.623+0000 7f5b6b400640 1 -- 172.21.15.71:0/1116551668 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5b6005a360 con 0x7f5b74156c20 2024-04-20T21:20:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.810+0000 7f5b7a200640 1 -- 172.21.15.71:0/1116551668 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5b740cfd90 con 0x7f5b74156c20 2024-04-20T21:20:52.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.812+0000 7f5b6b400640 1 -- 172.21.15.71:0/1116551668 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f5b60059c60 con 0x7f5b74156c20 2024-04-20T21:20:52.811 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:52.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 -- 172.21.15.71:0/1116551668 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5b5406c920 msgr2=0x7f5b5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:52.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5b5406c920 0x7f5b5406ede0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5b64036000 tx=0x7f5b6403c040 comp rx=0 tx=0).stop 2024-04-20T21:20:52.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 -- 172.21.15.71:0/1116551668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b74156c20 msgr2=0x7f5b741f2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:52.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b74156c20 0x7f5b741f2240 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000d5f0 tx=0x7f5b6000dab0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 -- 172.21.15.71:0/1116551668 shutdown_connections 2024-04-20T21:20:52.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f5b5406c920 0x7f5b5406ede0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b7415ca40 0x7f5b740ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b74156c20 0x7f5b741f2240 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 --2- 172.21.15.71:0/1116551668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5b740ad8e0 0x7f5b7414e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:52.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 -- 172.21.15.71:0/1116551668 >> 172.21.15.71:0/1116551668 conn(0x7f5b740b3350 msgr2=0x7f5b7415ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:52.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 -- 172.21.15.71:0/1116551668 shutdown_connections 2024-04-20T21:20:52.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:52.814+0000 7f5b7a200640 1 -- 172.21.15.71:0/1116551668 wait complete. 2024-04-20T21:20:52.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:20:52.826 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:20:52.830 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T21:20:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.065+0000 7f30ba600640 1 Processor -- start 2024-04-20T21:20:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.065+0000 7f30ba600640 1 -- start start 2024-04-20T21:20:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.067+0000 7f30ba600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f30b406dcb0 0x7f30b4071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.067+0000 7f30ba600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b40ade40 con 0x7f30b4072090 2024-04-20T21:20:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.067+0000 7f30ba600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b40ae0e0 con 0x7f30b415b3b0 2024-04-20T21:20:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.067+0000 7f30ba600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f30b406f1b0 con 0x7f30b406dcb0 2024-04-20T21:20:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.067+0000 7f30b3e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f30b4072090 0x7f30b40d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37052/0 (socket says 172.21.15.71:37052) 2024-04-20T21:20:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.067+0000 7f30b3e00640 1 -- 172.21.15.71:0/3925985478 learned_addr learned my addr 172.21.15.71:0/3925985478 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30aaa00640 1 --2- 172.21.15.71:0/3925985478 >> v2:172.21.15.137:3300/0 conn(0x7f30b406dcb0 0x7f30b4071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1815407227 0 0) 0x7f30b40ade40 con 0x7f30b4072090 2024-04-20T21:20:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3098003520 con 0x7f30b4072090 2024-04-20T21:20:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1485497279 0 0) 0x7f3098003520 con 0x7f30b4072090 2024-04-20T21:20:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 >> v2:172.21.15.137:3300/0 conn(0x7f30b406dcb0 msgr2=0x7f30b4071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 --2- 172.21.15.71:0/3925985478 >> v2:172.21.15.137:3300/0 conn(0x7f30b406dcb0 0x7f30b4071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 >> v1:172.21.15.137:6789/0 conn(0x7f30b415b3b0 legacy=0x7f30b406eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b415b790 con 0x7f30b4072090 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f30ac001670 con 0x7f30b4072090 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 >> v1:172.21.15.71:6789/0 conn(0x7f30b4072090 legacy=0x7f30b40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 --2- 172.21.15.71:0/3925985478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30980039b0 0x7f3098003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 --2- 172.21.15.71:0/3925985478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3098004800 0x7f3098004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 --2- 172.21.15.71:0/3925985478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30980051c0 0x7f309800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f30b406f1b0 con 0x7f30980039b0 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f309800e270 con 0x7f3098004800 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.068+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f309800e470 con 0x7f30980051c0 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.069+0000 7f30b3400640 1 --2- 172.21.15.71:0/3925985478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30980039b0 0x7f3098003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.069+0000 7f30b3400640 1 -- 172.21.15.71:0/3925985478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30980051c0 msgr2=0x7f309800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.069+0000 7f30b3400640 1 --2- 172.21.15.71:0/3925985478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30980051c0 0x7f309800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.069+0000 7f30b3400640 1 -- 172.21.15.71:0/3925985478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3098004800 msgr2=0x7f3098004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.069+0000 7f30aaa00640 1 --2- 172.21.15.71:0/3925985478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3098004800 0x7f3098004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.069+0000 7f30b3400640 1 --2- 172.21.15.71:0/3925985478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3098004800 0x7f3098004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.069+0000 7f30b3400640 1 -- 172.21.15.71:0/3925985478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3098003520 con 0x7f30980039b0 2024-04-20T21:20:53.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.069+0000 7f30b3e00640 1 -- 172.21.15.71:0/3925985478 reap_dead start 2024-04-20T21:20:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.070+0000 7f30b3400640 1 --2- 172.21.15.71:0/3925985478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30980039b0 0x7f3098003dd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f30a4001e20 tx=0x7f3098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48522999730ae3a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.070+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4001a70 con 0x7f30980039b0 2024-04-20T21:20:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.070+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a4003b70 con 0x7f30980039b0 2024-04-20T21:20:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.070+0000 7f30b2a00640 1 -- 172.21.15.71:0/3925985478 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a40050d0 con 0x7f30980039b0 2024-04-20T21:20:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.071+0000 7f30ba600640 1 -- 172.21.15.71:0/3925985478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30980039b0 msgr2=0x7f3098003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.071+0000 7f30ba600640 1 --2- 172.21.15.71:0/3925985478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30980039b0 0x7f3098003dd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f30a4001e20 tx=0x7f3098005830 comp rx=0 tx=0).stop 2024-04-20T21:20:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.071+0000 7f30ba600640 1 -- 172.21.15.71:0/3925985478 shutdown_connections 2024-04-20T21:20:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.071+0000 7f30ba600640 1 --2- 172.21.15.71:0/3925985478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30980039b0 0x7f3098003dd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.071+0000 7f30ba600640 1 -- 172.21.15.71:0/3925985478 >> 172.21.15.71:0/3925985478 conn(0x7f30b40b3350 msgr2=0x7f30b40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.071+0000 7f30ba600640 1 -- 172.21.15.71:0/3925985478 shutdown_connections 2024-04-20T21:20:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.071+0000 7f30ba600640 1 -- 172.21.15.71:0/3925985478 wait complete. 2024-04-20T21:20:53.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.073+0000 7f30ba600640 1 Processor -- start 2024-04-20T21:20:53.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.073+0000 7f30ba600640 1 -- start start 2024-04-20T21:20:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.074+0000 7f30ba600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30980039b0 0x7f30b4145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.074+0000 7f30ba600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30b415bec0 0x7f30b4156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.074+0000 7f30ba600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30b415c340 0x7f30b4141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.074+0000 7f30ba600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40ae940 con 0x7f30b415c340 2024-04-20T21:20:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.074+0000 7f30ba600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40ae3e0 con 0x7f30b415bec0 2024-04-20T21:20:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.074+0000 7f30ba600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f30b40aec20 con 0x7f30980039b0 2024-04-20T21:20:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.074+0000 7f30b3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30b415c340 0x7f30b4141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.074+0000 7f30b3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30b415c340 0x7f30b4141eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41592/0 (socket says 172.21.15.71:41592) 2024-04-20T21:20:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.074+0000 7f30b3e00640 1 -- 172.21.15.71:0/221804388 learned_addr learned my addr 172.21.15.71:0/221804388 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.074+0000 7f30b3400640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30980039b0 0x7f30b4145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30b3e00640 1 -- 172.21.15.71:0/221804388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30980039b0 msgr2=0x7f30b4145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30b3e00640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30980039b0 0x7f30b4145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30b3e00640 1 -- 172.21.15.71:0/221804388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30b415bec0 msgr2=0x7f30b4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30b3e00640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30b415bec0 0x7f30b4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30b3e00640 1 -- 172.21.15.71:0/221804388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b4145a70 con 0x7f30b415c340 2024-04-20T21:20:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30b3400640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30980039b0 0x7f30b4145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30b3e00640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30b415c340 0x7f30b4141eb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f30b406f680 tx=0x7f30ac00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30abe00640 1 -- 172.21.15.71:0/221804388 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac0074e0 con 0x7f30b415c340 2024-04-20T21:20:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30abe00640 1 -- 172.21.15.71:0/221804388 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ac0047e0 con 0x7f30b415c340 2024-04-20T21:20:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30ba600640 1 -- 172.21.15.71:0/221804388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b4142e10 con 0x7f30b415c340 2024-04-20T21:20:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30abe00640 1 -- 172.21.15.71:0/221804388 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac004bd0 con 0x7f30b415c340 2024-04-20T21:20:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.075+0000 7f30ba600640 1 -- 172.21.15.71:0/221804388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b41433d0 con 0x7f30b415c340 2024-04-20T21:20:53.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.077+0000 7f30ba600640 1 -- 172.21.15.71:0/221804388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b4068980 con 0x7f30b415c340 2024-04-20T21:20:53.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.078+0000 7f30abe00640 1 -- 172.21.15.71:0/221804388 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30ac01d3f0 con 0x7f30b415c340 2024-04-20T21:20:53.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.078+0000 7f30abe00640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f309006c920 0x7f309006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.079+0000 7f30abe00640 1 -- 172.21.15.71:0/221804388 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f30ac08b900 con 0x7f30b415c340 2024-04-20T21:20:53.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.079+0000 7f30b3400640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f309006c920 0x7f309006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.079+0000 7f30b3400640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f309006c920 0x7f309006ede0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f30a4034000 tx=0x7f30a4009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:53.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.083+0000 7f30abe00640 1 -- 172.21.15.71:0/221804388 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f30ac004d70 con 0x7f30b415c340 2024-04-20T21:20:53.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.280+0000 7f30ba600640 1 -- 172.21.15.71:0/221804388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f30b40008d0 con 0x7f30b415c340 2024-04-20T21:20:53.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.281+0000 7f30abe00640 1 -- 172.21.15.71:0/221804388 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f30ac059220 con 0x7f30b415c340 2024-04-20T21:20:53.281 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2024-04-20T21:20:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 -- 172.21.15.71:0/221804388 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f309006c920 msgr2=0x7f309006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f309006c920 0x7f309006ede0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f30a4034000 tx=0x7f30a4009030 comp rx=0 tx=0).stop 2024-04-20T21:20:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 -- 172.21.15.71:0/221804388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30b415c340 msgr2=0x7f30b4141eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30b415c340 0x7f30b4141eb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f30b406f680 tx=0x7f30ac00c7a0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 -- 172.21.15.71:0/221804388 shutdown_connections 2024-04-20T21:20:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f309006c920 0x7f309006ede0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30b415c340 0x7f30b4141eb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30b415bec0 0x7f30b4156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 --2- 172.21.15.71:0/221804388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30980039b0 0x7f30b4145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 -- 172.21.15.71:0/221804388 >> 172.21.15.71:0/221804388 conn(0x7f30b40b3350 msgr2=0x7f30b406e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:53.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 -- 172.21.15.71:0/221804388 shutdown_connections 2024-04-20T21:20:53.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.284+0000 7f30ba600640 1 -- 172.21.15.71:0/221804388 wait complete. 2024-04-20T21:20:53.300 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-20T21:20:53.300 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T21:20:53.357 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:53.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.558+0000 7fd4b6000640 1 Processor -- start 2024-04-20T21:20:53.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.559+0000 7fd4b6000640 1 -- start start 2024-04-20T21:20:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.560+0000 7fd4b6000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4b0161d50 0x7fd4b00d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.560+0000 7fd4b6000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4b00b3330 0x7fd4b00b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.560+0000 7fd4b6000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4b006c190 con 0x7fd4b006c6d0 2024-04-20T21:20:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.560+0000 7fd4b6000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b0162130 con 0x7fd4b0161d50 2024-04-20T21:20:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.560+0000 7fd4b6000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b006c470 con 0x7fd4b00b3330 2024-04-20T21:20:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.560+0000 7fd4b4c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4b0161d50 0x7fd4b00d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.560+0000 7fd4b5600640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd4b006c6d0 0x7fd4b00cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37056/0 (socket says 172.21.15.71:37056) 2024-04-20T21:20:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.560+0000 7fd4b5600640 1 -- 172.21.15.71:0/3159244568 learned_addr learned my addr 172.21.15.71:0/3159244568 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.561+0000 7fd4afe00640 1 --2- 172.21.15.71:0/3159244568 >> v2:172.21.15.137:3300/0 conn(0x7fd4b00b3330 0x7fd4b00b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.561+0000 7fd4b4c00640 1 -- 172.21.15.71:0/3159244568 >> v2:172.21.15.137:3300/0 conn(0x7fd4b00b3330 msgr2=0x7fd4b00b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.561+0000 7fd4b4c00640 1 --2- 172.21.15.71:0/3159244568 >> v2:172.21.15.137:3300/0 conn(0x7fd4b00b3330 0x7fd4b00b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.561+0000 7fd4b4c00640 1 -- 172.21.15.71:0/3159244568 >> v1:172.21.15.71:6789/0 conn(0x7fd4b006c6d0 legacy=0x7fd4b00cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.561+0000 7fd4b4c00640 1 -- 172.21.15.71:0/3159244568 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b00d2e00 con 0x7fd4b0161d50 2024-04-20T21:20:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.561+0000 7fd4af400640 1 -- 172.21.15.71:0/3159244568 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538255068 0 0) 0x7fd4b006c190 con 0x7fd4b006c6d0 2024-04-20T21:20:53.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.562+0000 7fd4b4c00640 1 --2- 172.21.15.71:0/3159244568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4b0161d50 0x7fd4b00d38e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00d1f00 tx=0x7fd4a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a21d1ebdc351d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:53.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.562+0000 7fd4af400640 1 -- 172.21.15.71:0/3159244568 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4035020 con 0x7fd4b0161d50 2024-04-20T21:20:53.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.563+0000 7fd4af400640 1 -- 172.21.15.71:0/3159244568 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a4031830 con 0x7fd4b0161d50 2024-04-20T21:20:53.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.563+0000 7fd4af400640 1 -- 172.21.15.71:0/3159244568 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4031c00 con 0x7fd4b0161d50 2024-04-20T21:20:53.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.563+0000 7fd4b6000640 1 -- 172.21.15.71:0/3159244568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4b0161d50 msgr2=0x7fd4b00d38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.563+0000 7fd4b6000640 1 --2- 172.21.15.71:0/3159244568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4b0161d50 0x7fd4b00d38e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00d1f00 tx=0x7fd4a402b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.563+0000 7fd4b6000640 1 -- 172.21.15.71:0/3159244568 shutdown_connections 2024-04-20T21:20:53.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.563+0000 7fd4b6000640 1 --2- 172.21.15.71:0/3159244568 >> v2:172.21.15.137:3300/0 conn(0x7fd4b00b3330 0x7fd4b00b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.563+0000 7fd4b6000640 1 --2- 172.21.15.71:0/3159244568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4b0161d50 0x7fd4b00d38e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.563+0000 7fd4b6000640 1 -- 172.21.15.71:0/3159244568 >> 172.21.15.71:0/3159244568 conn(0x7fd4b00d4450 msgr2=0x7fd4b00d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:53.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.563+0000 7fd4b6000640 1 -- 172.21.15.71:0/3159244568 shutdown_connections 2024-04-20T21:20:53.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.563+0000 7fd4b6000640 1 -- 172.21.15.71:0/3159244568 wait complete. 2024-04-20T21:20:53.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.565+0000 7fd4b6000640 1 Processor -- start 2024-04-20T21:20:53.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.565+0000 7fd4b6000640 1 -- start start 2024-04-20T21:20:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.566+0000 7fd4b6000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4b006c6d0 0x7fd4b00c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.566+0000 7fd4b6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4b00b3330 0x7fd4b0158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.566+0000 7fd4b6000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4b0161d50 0x7fd4b00c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.566+0000 7fd4b6000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b006cb20 con 0x7fd4b00b3330 2024-04-20T21:20:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.566+0000 7fd4b6000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b00d33c0 con 0x7fd4b006c6d0 2024-04-20T21:20:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.566+0000 7fd4b6000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b006cca0 con 0x7fd4b0161d50 2024-04-20T21:20:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.566+0000 7fd4afe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4b00b3330 0x7fd4b0158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.566+0000 7fd4afe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4b00b3330 0x7fd4b0158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41600/0 (socket says 172.21.15.71:41600) 2024-04-20T21:20:53.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.566+0000 7fd4afe00640 1 -- 172.21.15.71:0/2925879313 learned_addr learned my addr 172.21.15.71:0/2925879313 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4b4c00640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4b006c6d0 0x7fd4b00c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4b5600640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4b0161d50 0x7fd4b00c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4afe00640 1 -- 172.21.15.71:0/2925879313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4b0161d50 msgr2=0x7fd4b00c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4afe00640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4b0161d50 0x7fd4b00c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4afe00640 1 -- 172.21.15.71:0/2925879313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4b006c6d0 msgr2=0x7fd4b00c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4afe00640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4b006c6d0 0x7fd4b00c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4afe00640 1 -- 172.21.15.71:0/2925879313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b00c8eb0 con 0x7fd4b00b3330 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4b5600640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4b0161d50 0x7fd4b00c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4afe00640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4b00b3330 0x7fd4b0158aa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00c820 tx=0x7fd49c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4acc00640 1 -- 172.21.15.71:0/2925879313 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c015070 con 0x7fd4b00b3330 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4acc00640 1 -- 172.21.15.71:0/2925879313 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd49c004240 con 0x7fd4b00b3330 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4b6000640 1 -- 172.21.15.71:0/2925879313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b00c99f0 con 0x7fd4b00b3330 2024-04-20T21:20:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.567+0000 7fd4acc00640 1 -- 172.21.15.71:0/2925879313 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00ce10 con 0x7fd4b00b3330 2024-04-20T21:20:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.568+0000 7fd4b6000640 1 -- 172.21.15.71:0/2925879313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b00c9430 con 0x7fd4b00b3330 2024-04-20T21:20:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.569+0000 7fd4b6000640 1 -- 172.21.15.71:0/2925879313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b0075b60 con 0x7fd4b00b3330 2024-04-20T21:20:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.570+0000 7fd4acc00640 1 -- 172.21.15.71:0/2925879313 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd49c007830 con 0x7fd4b00b3330 2024-04-20T21:20:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.571+0000 7fd4acc00640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd49006c920 0x7fd49006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.571+0000 7fd4acc00640 1 -- 172.21.15.71:0/2925879313 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fd49c08be30 con 0x7fd4b00b3330 2024-04-20T21:20:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.571+0000 7fd4b4c00640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd49006c920 0x7fd49006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:53.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.572+0000 7fd4b4c00640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd49006c920 0x7fd49006ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4036000 tx=0x7fd4a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:53.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.575+0000 7fd4acc00640 1 -- 172.21.15.71:0/2925879313 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd49c059e40 con 0x7fd4b00b3330 2024-04-20T21:20:53.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.780+0000 7fd4b6000640 1 -- 172.21.15.71:0/2925879313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4b0159630 con 0x7fd4b00b3330 2024-04-20T21:20:53.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.783+0000 7fd4acc00640 1 -- 172.21.15.71:0/2925879313 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7fd49c059740 con 0x7fd4b00b3330 2024-04-20T21:20:53.783 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:53.783 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.785+0000 7fd4b6000640 1 -- 172.21.15.71:0/2925879313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd49006c920 msgr2=0x7fd49006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.785+0000 7fd4b6000640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd49006c920 0x7fd49006ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4036000 tx=0x7fd4a4008030 comp rx=0 tx=0).stop 2024-04-20T21:20:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.785+0000 7fd4b6000640 1 -- 172.21.15.71:0/2925879313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4b00b3330 msgr2=0x7fd4b0158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.785+0000 7fd4b6000640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4b00b3330 0x7fd4b0158aa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00c820 tx=0x7fd49c00cce0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.785+0000 7fd4b6000640 1 -- 172.21.15.71:0/2925879313 shutdown_connections 2024-04-20T21:20:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.786+0000 7fd4b6000640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd49006c920 0x7fd49006ede0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.786+0000 7fd4b6000640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4b0161d50 0x7fd4b00c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.786+0000 7fd4b6000640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4b00b3330 0x7fd4b0158aa0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.786+0000 7fd4b6000640 1 --2- 172.21.15.71:0/2925879313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4b006c6d0 0x7fd4b00c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.786+0000 7fd4b6000640 1 -- 172.21.15.71:0/2925879313 >> 172.21.15.71:0/2925879313 conn(0x7fd4b00d4450 msgr2=0x7fd4b00d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.786+0000 7fd4b6000640 1 -- 172.21.15.71:0/2925879313 shutdown_connections 2024-04-20T21:20:53.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:53.786+0000 7fd4b6000640 1 -- 172.21.15.71:0/2925879313 wait complete. 2024-04-20T21:20:53.806 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:53.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:54.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.003+0000 7f33bf000640 1 Processor -- start 2024-04-20T21:20:54.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.004+0000 7f33bf000640 1 -- start start 2024-04-20T21:20:54.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.005+0000 7f33bf000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f33b8162700 0x7f33b8162ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.005+0000 7f33bf000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f33b815ead0 0x7f33b80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.005+0000 7f33bf000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b806f2b0 con 0x7f33b80b6c20 2024-04-20T21:20:54.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.005+0000 7f33bf000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f33b80b6900 con 0x7f33b815ead0 2024-04-20T21:20:54.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.005+0000 7f33bf000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f33b80b6620 con 0x7f33b8162700 2024-04-20T21:20:54.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.006+0000 7f33b7400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f33b80b6c20 0x7f33b815e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37068/0 (socket says 172.21.15.71:37068) 2024-04-20T21:20:54.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.006+0000 7f33b7400640 1 -- 172.21.15.71:0/729301323 learned_addr learned my addr 172.21.15.71:0/729301323 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:54.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.006+0000 7f33bd000640 1 --2- 172.21.15.71:0/729301323 >> v2:172.21.15.71:3300/0 conn(0x7f33b815ead0 0x7f33b80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.006+0000 7f33b7e00640 1 --2- 172.21.15.71:0/729301323 >> v2:172.21.15.137:3300/0 conn(0x7f33b8162700 0x7f33b8162ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.006+0000 7f33bd000640 1 -- 172.21.15.71:0/729301323 >> v2:172.21.15.137:3300/0 conn(0x7f33b8162700 msgr2=0x7f33b8162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:54.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.006+0000 7f33bd000640 1 --2- 172.21.15.71:0/729301323 >> v2:172.21.15.137:3300/0 conn(0x7f33b8162700 0x7f33b8162ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.006+0000 7f33bd000640 1 -- 172.21.15.71:0/729301323 >> v1:172.21.15.71:6789/0 conn(0x7f33b80b6c20 legacy=0x7f33b815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.006+0000 7f33b6a00640 1 -- 172.21.15.71:0/729301323 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522081684 0 0) 0x7f33b806f2b0 con 0x7f33b80b6c20 2024-04-20T21:20:54.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.006+0000 7f33bd000640 1 -- 172.21.15.71:0/729301323 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b80b6160 con 0x7f33b815ead0 2024-04-20T21:20:54.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.007+0000 7f33bd000640 1 --2- 172.21.15.71:0/729301323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33b815ead0 0x7f33b80cf710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f33b80b67a0 tx=0x7f33b002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df694bb7f63280d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:54.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.008+0000 7f33b6a00640 1 -- 172.21.15.71:0/729301323 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0038070 con 0x7f33b815ead0 2024-04-20T21:20:54.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.008+0000 7f33b6a00640 1 -- 172.21.15.71:0/729301323 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b0031700 con 0x7f33b815ead0 2024-04-20T21:20:54.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.008+0000 7f33b6a00640 1 -- 172.21.15.71:0/729301323 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0031ad0 con 0x7f33b815ead0 2024-04-20T21:20:54.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.008+0000 7f33bf000640 1 -- 172.21.15.71:0/729301323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33b815ead0 msgr2=0x7f33b80cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.008+0000 7f33bf000640 1 --2- 172.21.15.71:0/729301323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33b815ead0 0x7f33b80cf710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f33b80b67a0 tx=0x7f33b002b7a0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.008+0000 7f33bf000640 1 -- 172.21.15.71:0/729301323 shutdown_connections 2024-04-20T21:20:54.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.008+0000 7f33bf000640 1 --2- 172.21.15.71:0/729301323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33b815ead0 0x7f33b80cf710 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.008+0000 7f33bf000640 1 --2- 172.21.15.71:0/729301323 >> v2:172.21.15.137:3300/0 conn(0x7f33b8162700 0x7f33b8162ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.009+0000 7f33bf000640 1 -- 172.21.15.71:0/729301323 >> 172.21.15.71:0/729301323 conn(0x7f33b809d910 msgr2=0x7f33b80b9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:54.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.009+0000 7f33bf000640 1 -- 172.21.15.71:0/729301323 shutdown_connections 2024-04-20T21:20:54.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.009+0000 7f33bf000640 1 -- 172.21.15.71:0/729301323 wait complete. 2024-04-20T21:20:54.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.010+0000 7f33bf000640 1 Processor -- start 2024-04-20T21:20:54.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.010+0000 7f33bf000640 1 -- start start 2024-04-20T21:20:54.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.011+0000 7f33bf000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33b80b6c20 0x7f33b806b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.011+0000 7f33bf000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33b815ead0 0x7f33b80cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.011+0000 7f33bf000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33b8162700 0x7f33b815d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.011+0000 7f33bf000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f33b80b3690 con 0x7f33b80b6c20 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.011+0000 7f33bf000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33b80b3510 con 0x7f33b815ead0 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.011+0000 7f33bf000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f33b80b3810 con 0x7f33b8162700 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.012+0000 7f33b7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33b80b6c20 0x7f33b806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.012+0000 7f33b7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33b80b6c20 0x7f33b806b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41618/0 (socket says 172.21.15.71:41618) 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.012+0000 7f33b7e00640 1 -- 172.21.15.71:0/2834269987 learned_addr learned my addr 172.21.15.71:0/2834269987 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.012+0000 7f33b7e00640 1 -- 172.21.15.71:0/2834269987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33b8162700 msgr2=0x7f33b815d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.012+0000 7f33bd000640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33b8162700 0x7f33b815d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.012+0000 7f33b7e00640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33b8162700 0x7f33b815d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.012+0000 7f33b7e00640 1 -- 172.21.15.71:0/2834269987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33b815ead0 msgr2=0x7f33b80cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.012+0000 7f33b7e00640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33b815ead0 0x7f33b80cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.012+0000 7f33b7e00640 1 -- 172.21.15.71:0/2834269987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b806bfe0 con 0x7f33b80b6c20 2024-04-20T21:20:54.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.013+0000 7f33b7e00640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33b80b6c20 0x7f33b806b900 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f33a800d620 tx=0x7f33a800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:54.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.013+0000 7f33afe00640 1 -- 172.21.15.71:0/2834269987 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a800b620 con 0x7f33b80b6c20 2024-04-20T21:20:54.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.013+0000 7f33afe00640 1 -- 172.21.15.71:0/2834269987 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a8019070 con 0x7f33b80b6c20 2024-04-20T21:20:54.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.013+0000 7f33afe00640 1 -- 172.21.15.71:0/2834269987 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a800ba00 con 0x7f33b80b6c20 2024-04-20T21:20:54.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.013+0000 7f33bf000640 1 -- 172.21.15.71:0/2834269987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b806c2c0 con 0x7f33b80b6c20 2024-04-20T21:20:54.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.013+0000 7f33bf000640 1 -- 172.21.15.71:0/2834269987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b806c880 con 0x7f33b80b6c20 2024-04-20T21:20:54.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.014+0000 7f33bf000640 1 -- 172.21.15.71:0/2834269987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b8068980 con 0x7f33b80b6c20 2024-04-20T21:20:54.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.015+0000 7f33afe00640 1 -- 172.21.15.71:0/2834269987 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33a800bba0 con 0x7f33b80b6c20 2024-04-20T21:20:54.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.016+0000 7f33afe00640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f339406c8f0 0x7f339406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.016+0000 7f33afe00640 1 -- 172.21.15.71:0/2834269987 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f33a808c490 con 0x7f33b80b6c20 2024-04-20T21:20:54.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.016+0000 7f33b7400640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f339406c8f0 0x7f339406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.017+0000 7f33b7400640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f339406c8f0 0x7f339406edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f33a0001560 tx=0x7f33a0007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:54.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.020+0000 7f33afe00640 1 -- 172.21.15.71:0/2834269987 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f33a805a400 con 0x7f33b80b6c20 2024-04-20T21:20:54.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.223+0000 7f33bf000640 1 -- 172.21.15.71:0/2834269987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f33b80d51b0 con 0x7f33b80b6c20 2024-04-20T21:20:54.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.223+0000 7f33afe00640 1 -- 172.21.15.71:0/2834269987 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f33a8059d00 con 0x7f33b80b6c20 2024-04-20T21:20:54.223 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:54.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 -- 172.21.15.71:0/2834269987 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f339406c8f0 msgr2=0x7f339406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f339406c8f0 0x7f339406edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f33a0001560 tx=0x7f33a0007ca0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 -- 172.21.15.71:0/2834269987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33b80b6c20 msgr2=0x7f33b806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33b80b6c20 0x7f33b806b900 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f33a800d620 tx=0x7f33a800dae0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 -- 172.21.15.71:0/2834269987 shutdown_connections 2024-04-20T21:20:54.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f339406c8f0 0x7f339406edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33b8162700 0x7f33b815d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33b815ead0 0x7f33b80cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 --2- 172.21.15.71:0/2834269987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33b80b6c20 0x7f33b806b900 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 -- 172.21.15.71:0/2834269987 >> 172.21.15.71:0/2834269987 conn(0x7f33b809d910 msgr2=0x7f33b80d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:54.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 -- 172.21.15.71:0/2834269987 shutdown_connections 2024-04-20T21:20:54.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.226+0000 7f33bf000640 1 -- 172.21.15.71:0/2834269987 wait complete. 2024-04-20T21:20:54.246 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.452+0000 7fafac200640 1 Processor -- start 2024-04-20T21:20:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.453+0000 7fafac200640 1 -- start start 2024-04-20T21:20:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.454+0000 7fafac200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa4071b50 0x7fafa415abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.454+0000 7fafac200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa40ae9b0 con 0x7fafa40725b0 2024-04-20T21:20:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.454+0000 7fafac200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa406e840 con 0x7fafa40af800 2024-04-20T21:20:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.454+0000 7fafac200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fafa40d0a70 con 0x7fafa4071b50 2024-04-20T21:20:54.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.455+0000 7fafa9800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa4071b50 0x7fafa415abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.455+0000 7fafaa200640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fafa40725b0 0x7fafa4165ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37082/0 (socket says 172.21.15.71:37082) 2024-04-20T21:20:54.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.455+0000 7fafaa200640 1 -- 172.21.15.71:0/40029582 learned_addr learned my addr 172.21.15.71:0/40029582 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:54.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.455+0000 7fafa3e00640 1 -- 172.21.15.71:0/40029582 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1960224891 0 0) 0x7fafa40ae9b0 con 0x7fafa40725b0 2024-04-20T21:20:54.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.456+0000 7fafa3e00640 1 -- 172.21.15.71:0/40029582 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf8c005730 con 0x7fafa40725b0 2024-04-20T21:20:54.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.456+0000 7fafa9800640 1 -- 172.21.15.71:0/40029582 >> v1:172.21.15.137:6789/0 conn(0x7fafa40af800 legacy=0x7fafa40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.456+0000 7fafa9800640 1 -- 172.21.15.71:0/40029582 >> v1:172.21.15.71:6789/0 conn(0x7fafa40725b0 legacy=0x7fafa4165ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.456+0000 7fafa9800640 1 -- 172.21.15.71:0/40029582 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa415b350 con 0x7fafa4071b50 2024-04-20T21:20:54.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.457+0000 7fafa9800640 1 --2- 172.21.15.71:0/40029582 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa4071b50 0x7fafa415abb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf980097d0 tx=0x7faf9802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7a4211bb26601b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:54.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.457+0000 7fafa3e00640 1 -- 172.21.15.71:0/40029582 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98034070 con 0x7fafa4071b50 2024-04-20T21:20:54.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.457+0000 7fafa3e00640 1 -- 172.21.15.71:0/40029582 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf98030800 con 0x7fafa4071b50 2024-04-20T21:20:54.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.458+0000 7fafa3e00640 1 -- 172.21.15.71:0/40029582 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98030bb0 con 0x7fafa4071b50 2024-04-20T21:20:54.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.458+0000 7fafac200640 1 -- 172.21.15.71:0/40029582 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa4071b50 msgr2=0x7fafa415abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.458+0000 7fafac200640 1 --2- 172.21.15.71:0/40029582 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa4071b50 0x7fafa415abb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf980097d0 tx=0x7faf9802b940 comp rx=0 tx=0).stop 2024-04-20T21:20:54.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.458+0000 7fafac200640 1 -- 172.21.15.71:0/40029582 shutdown_connections 2024-04-20T21:20:54.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.458+0000 7fafac200640 1 --2- 172.21.15.71:0/40029582 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa4071b50 0x7fafa415abb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.458+0000 7fafac200640 1 -- 172.21.15.71:0/40029582 >> 172.21.15.71:0/40029582 conn(0x7fafa40b3350 msgr2=0x7fafa40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:54.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.458+0000 7fafac200640 1 -- 172.21.15.71:0/40029582 shutdown_connections 2024-04-20T21:20:54.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.458+0000 7fafac200640 1 -- 172.21.15.71:0/40029582 wait complete. 2024-04-20T21:20:54.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.460+0000 7fafac200640 1 Processor -- start 2024-04-20T21:20:54.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.460+0000 7fafac200640 1 -- start start 2024-04-20T21:20:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.461+0000 7fafac200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa4071b50 0x7fafa409db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.461+0000 7fafac200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa40725b0 0x7fafa4156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.461+0000 7fafac200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40af800 0x7fafa4153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.461+0000 7fafac200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fafa415bf60 con 0x7fafa40af800 2024-04-20T21:20:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.461+0000 7fafac200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafa415b0f0 con 0x7fafa40725b0 2024-04-20T21:20:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.461+0000 7fafac200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fafa415b910 con 0x7fafa4071b50 2024-04-20T21:20:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.461+0000 7fafaa200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40af800 0x7fafa4153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.461+0000 7fafaa200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40af800 0x7fafa4153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41634/0 (socket says 172.21.15.71:41634) 2024-04-20T21:20:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.461+0000 7fafaa200640 1 -- 172.21.15.71:0/2966906114 learned_addr learned my addr 172.21.15.71:0/2966906114 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.462+0000 7fafa9800640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa4071b50 0x7fafa409db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.462+0000 7fafa8e00640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa40725b0 0x7fafa4156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.462+0000 7fafaa200640 1 -- 172.21.15.71:0/2966906114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa4071b50 msgr2=0x7fafa409db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.462+0000 7fafaa200640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa4071b50 0x7fafa409db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.462+0000 7fafaa200640 1 -- 172.21.15.71:0/2966906114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa40725b0 msgr2=0x7fafa4156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.462+0000 7fafaa200640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa40725b0 0x7fafa4156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.462+0000 7fafaa200640 1 -- 172.21.15.71:0/2966906114 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa409cad0 con 0x7fafa40af800 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.462+0000 7fafaa200640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40af800 0x7fafa4153780 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00caa0 tx=0x7faf9c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.462+0000 7fafa1600640 1 -- 172.21.15.71:0/2966906114 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9c017070 con 0x7fafa40af800 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.463+0000 7fafa1600640 1 -- 172.21.15.71:0/2966906114 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf9c00ac00 con 0x7fafa40af800 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.463+0000 7fafa1600640 1 -- 172.21.15.71:0/2966906114 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9c012400 con 0x7fafa40af800 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.463+0000 7fafac200640 1 -- 172.21.15.71:0/2966906114 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa409cdb0 con 0x7fafa40af800 2024-04-20T21:20:54.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.463+0000 7fafac200640 1 -- 172.21.15.71:0/2966906114 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa409d370 con 0x7fafa40af800 2024-04-20T21:20:54.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.464+0000 7fafac200640 1 -- 172.21.15.71:0/2966906114 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa4068980 con 0x7fafa40af800 2024-04-20T21:20:54.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.465+0000 7fafa1600640 1 -- 172.21.15.71:0/2966906114 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf9c01a070 con 0x7fafa40af800 2024-04-20T21:20:54.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.466+0000 7fafa1600640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8406c920 0x7faf8406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.466+0000 7fafa1600640 1 -- 172.21.15.71:0/2966906114 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7faf9c08bce0 con 0x7fafa40af800 2024-04-20T21:20:54.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.466+0000 7fafa9800640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8406c920 0x7faf8406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.467+0000 7fafa9800640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8406c920 0x7faf8406ede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf98036000 tx=0x7faf98008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:54.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.471+0000 7fafa1600640 1 -- 172.21.15.71:0/2966906114 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7faf9c059ce0 con 0x7fafa40af800 2024-04-20T21:20:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.674+0000 7fafac200640 1 -- 172.21.15.71:0/2966906114 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fafa406ea80 con 0x7fafa40af800 2024-04-20T21:20:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.675+0000 7fafa1600640 1 -- 172.21.15.71:0/2966906114 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7faf9c0595e0 con 0x7fafa40af800 2024-04-20T21:20:54.675 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 -- 172.21.15.71:0/2966906114 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8406c920 msgr2=0x7faf8406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8406c920 0x7faf8406ede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf98036000 tx=0x7faf98008030 comp rx=0 tx=0).stop 2024-04-20T21:20:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 -- 172.21.15.71:0/2966906114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40af800 msgr2=0x7fafa4153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40af800 0x7fafa4153780 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00caa0 tx=0x7faf9c00cf60 comp rx=0 tx=0).stop 2024-04-20T21:20:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 -- 172.21.15.71:0/2966906114 shutdown_connections 2024-04-20T21:20:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7faf8406c920 0x7faf8406ede0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa40af800 0x7fafa4153780 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa40725b0 0x7fafa4156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 --2- 172.21.15.71:0/2966906114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafa4071b50 0x7fafa409db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 -- 172.21.15.71:0/2966906114 >> 172.21.15.71:0/2966906114 conn(0x7fafa40b3350 msgr2=0x7fafa4154580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 -- 172.21.15.71:0/2966906114 shutdown_connections 2024-04-20T21:20:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.678+0000 7fafac200640 1 -- 172.21.15.71:0/2966906114 wait complete. 2024-04-20T21:20:54.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:54.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.902+0000 7fbf8cc00640 1 Processor -- start 2024-04-20T21:20:54.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.902+0000 7fbf8cc00640 1 -- start start 2024-04-20T21:20:54.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.904+0000 7fbf8cc00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbf8815ca40 0x7fbf880ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.904+0000 7fbf8cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf880ad8e0 0x7fbf880d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.904+0000 7fbf8cc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf88141c60 con 0x7fbf88156c20 2024-04-20T21:20:54.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.904+0000 7fbf8cc00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbf8806c010 con 0x7fbf8815ca40 2024-04-20T21:20:54.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.904+0000 7fbf8cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbf8815cf90 con 0x7fbf880ad8e0 2024-04-20T21:20:54.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.904+0000 7fbf85400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbf8815ca40 0x7fbf880ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.904+0000 7fbf85400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbf8815ca40 0x7fbf880ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41642/0 (socket says 172.21.15.71:41642) 2024-04-20T21:20:54.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.904+0000 7fbf85400640 1 -- 172.21.15.71:0/3664158930 learned_addr learned my addr 172.21.15.71:0/3664158930 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:54.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.905+0000 7fbf86800640 1 --2- 172.21.15.71:0/3664158930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf880ad8e0 0x7fbf880d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.905+0000 7fbf85400640 1 -- 172.21.15.71:0/3664158930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf880ad8e0 msgr2=0x7fbf880d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:54.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.905+0000 7fbf85400640 1 --2- 172.21.15.71:0/3664158930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf880ad8e0 0x7fbf880d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.905+0000 7fbf85400640 1 -- 172.21.15.71:0/3664158930 >> v1:172.21.15.137:6789/0 conn(0x7fbf88156c20 legacy=0x7fbf8806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:54.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.905+0000 7fbf85400640 1 -- 172.21.15.71:0/3664158930 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8815d270 con 0x7fbf8815ca40 2024-04-20T21:20:54.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.906+0000 7fbf85400640 1 --2- 172.21.15.71:0/3664158930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf8815ca40 0x7fbf880ad3a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009870 tx=0x7fbf7402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a20c302b16d00a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:54.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.906+0000 7fbf84a00640 1 -- 172.21.15.71:0/3664158930 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74035020 con 0x7fbf8815ca40 2024-04-20T21:20:54.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.906+0000 7fbf84a00640 1 -- 172.21.15.71:0/3664158930 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf74031640 con 0x7fbf8815ca40 2024-04-20T21:20:54.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.906+0000 7fbf84a00640 1 -- 172.21.15.71:0/3664158930 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7402d040 con 0x7fbf8815ca40 2024-04-20T21:20:54.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.907+0000 7fbf8cc00640 1 -- 172.21.15.71:0/3664158930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf8815ca40 msgr2=0x7fbf880ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.907+0000 7fbf8cc00640 1 --2- 172.21.15.71:0/3664158930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf8815ca40 0x7fbf880ad3a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009870 tx=0x7fbf7402b8f0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.907+0000 7fbf8cc00640 1 -- 172.21.15.71:0/3664158930 shutdown_connections 2024-04-20T21:20:54.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.907+0000 7fbf8cc00640 1 --2- 172.21.15.71:0/3664158930 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf880ad8e0 0x7fbf880d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.907+0000 7fbf8cc00640 1 --2- 172.21.15.71:0/3664158930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf8815ca40 0x7fbf880ad3a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.907+0000 7fbf8cc00640 1 -- 172.21.15.71:0/3664158930 >> 172.21.15.71:0/3664158930 conn(0x7fbf880b3350 msgr2=0x7fbf880b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:54.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.907+0000 7fbf8cc00640 1 -- 172.21.15.71:0/3664158930 shutdown_connections 2024-04-20T21:20:54.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.907+0000 7fbf8cc00640 1 -- 172.21.15.71:0/3664158930 wait complete. 2024-04-20T21:20:54.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.909+0000 7fbf8cc00640 1 Processor -- start 2024-04-20T21:20:54.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.909+0000 7fbf8cc00640 1 -- start start 2024-04-20T21:20:54.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.910+0000 7fbf8cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf880ad8e0 0x7fbf881f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.910+0000 7fbf8cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf88156c20 0x7fbf88072ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.910+0000 7fbf8cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf8815ca40 0x7fbf880730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.910+0000 7fbf8cc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbf880d08a0 con 0x7fbf8815ca40 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.910+0000 7fbf8cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8815d830 con 0x7fbf880ad8e0 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.910+0000 7fbf8cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbf880d0a20 con 0x7fbf88156c20 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.910+0000 7fbf86800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf8815ca40 0x7fbf880730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.910+0000 7fbf86800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf8815ca40 0x7fbf880730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41644/0 (socket says 172.21.15.71:41644) 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.910+0000 7fbf86800640 1 -- 172.21.15.71:0/1737731604 learned_addr learned my addr 172.21.15.71:0/1737731604 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.911+0000 7fbf85400640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf88156c20 0x7fbf88072ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.911+0000 7fbf85e00640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf880ad8e0 0x7fbf881f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.911+0000 7fbf86800640 1 -- 172.21.15.71:0/1737731604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf88156c20 msgr2=0x7fbf88072ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.911+0000 7fbf86800640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf88156c20 0x7fbf88072ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.911+0000 7fbf86800640 1 -- 172.21.15.71:0/1737731604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf880ad8e0 msgr2=0x7fbf881f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.911+0000 7fbf86800640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf880ad8e0 0x7fbf881f48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.911+0000 7fbf86800640 1 -- 172.21.15.71:0/1737731604 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf880cf700 con 0x7fbf8815ca40 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.911+0000 7fbf85400640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf88156c20 0x7fbf88072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:54.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.911+0000 7fbf85e00640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf880ad8e0 0x7fbf881f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:54.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.911+0000 7fbf86800640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf8815ca40 0x7fbf880730e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbf80007d40 tx=0x7fbf8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:54.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.912+0000 7fbf7e000640 1 -- 172.21.15.71:0/1737731604 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80014420 con 0x7fbf8815ca40 2024-04-20T21:20:54.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.912+0000 7fbf7e000640 1 -- 172.21.15.71:0/1737731604 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf80019070 con 0x7fbf8815ca40 2024-04-20T21:20:54.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.912+0000 7fbf7e000640 1 -- 172.21.15.71:0/1737731604 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80014820 con 0x7fbf8815ca40 2024-04-20T21:20:54.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.912+0000 7fbf8cc00640 1 -- 172.21.15.71:0/1737731604 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf880cccd0 con 0x7fbf8815ca40 2024-04-20T21:20:54.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.912+0000 7fbf8cc00640 1 -- 172.21.15.71:0/1737731604 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf880cd290 con 0x7fbf8815ca40 2024-04-20T21:20:54.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.913+0000 7fbf8cc00640 1 -- 172.21.15.71:0/1737731604 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf88068980 con 0x7fbf8815ca40 2024-04-20T21:20:54.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.914+0000 7fbf7e000640 1 -- 172.21.15.71:0/1737731604 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf800149c0 con 0x7fbf8815ca40 2024-04-20T21:20:54.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.915+0000 7fbf7e000640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbf6806c920 0x7fbf6806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:54.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.915+0000 7fbf7e000640 1 -- 172.21.15.71:0/1737731604 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fbf8008c800 con 0x7fbf8815ca40 2024-04-20T21:20:54.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.915+0000 7fbf85e00640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbf6806c920 0x7fbf6806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:54.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.916+0000 7fbf85e00640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbf6806c920 0x7fbf6806ede0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbf78003eb0 tx=0x7fbf78009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:54.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:54.920+0000 7fbf7e000640 1 -- 172.21.15.71:0/1737731604 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbf8005a770 con 0x7fbf8815ca40 2024-04-20T21:20:55.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.118+0000 7fbf8cc00640 1 -- 172.21.15.71:0/1737731604 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbf880cfd90 con 0x7fbf8815ca40 2024-04-20T21:20:55.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.119+0000 7fbf7e000640 1 -- 172.21.15.71:0/1737731604 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fbf8005a070 con 0x7fbf8815ca40 2024-04-20T21:20:55.118 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:55.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 -- 172.21.15.71:0/1737731604 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbf6806c920 msgr2=0x7fbf6806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbf6806c920 0x7fbf6806ede0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbf78003eb0 tx=0x7fbf78009040 comp rx=0 tx=0).stop 2024-04-20T21:20:55.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 -- 172.21.15.71:0/1737731604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf8815ca40 msgr2=0x7fbf880730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf8815ca40 0x7fbf880730e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbf80007d40 tx=0x7fbf8000e4b0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 -- 172.21.15.71:0/1737731604 shutdown_connections 2024-04-20T21:20:55.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fbf6806c920 0x7fbf6806ede0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf8815ca40 0x7fbf880730e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf88156c20 0x7fbf88072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 --2- 172.21.15.71:0/1737731604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf880ad8e0 0x7fbf881f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 -- 172.21.15.71:0/1737731604 >> 172.21.15.71:0/1737731604 conn(0x7fbf880b3350 msgr2=0x7fbf8815f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:55.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 -- 172.21.15.71:0/1737731604 shutdown_connections 2024-04-20T21:20:55.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.122+0000 7fbf8cc00640 1 -- 172.21.15.71:0/1737731604 wait complete. 2024-04-20T21:20:55.141 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:55.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.340+0000 7f2ca3000640 1 Processor -- start 2024-04-20T21:20:55.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.341+0000 7f2ca3000640 1 -- start start 2024-04-20T21:20:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.342+0000 7f2ca3000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d51b0 0x7f2c9c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.342+0000 7f2ca3000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c9c0d1c10 0x7f2c9c0b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.342+0000 7f2ca3000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9c15ed40 con 0x7f2c9c15e960 2024-04-20T21:20:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.342+0000 7f2ca3000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2c9c0b6e90 con 0x7f2c9c0d1c10 2024-04-20T21:20:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.342+0000 7f2ca3000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9c0d0e50 con 0x7f2c9c0d51b0 2024-04-20T21:20:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.343+0000 7f2c9b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d51b0 0x7f2c9c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.343+0000 7f2c9be00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2c9c15e960 0x7f2c9c0d4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:33958/0 (socket says 172.21.15.71:33958) 2024-04-20T21:20:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.343+0000 7f2c9b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d51b0 0x7f2c9c0b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:54616/0 (socket says 172.21.15.71:54616) 2024-04-20T21:20:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.343+0000 7f2ca1000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c9c0d1c10 0x7f2c9c0b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.343+0000 7f2c9be00640 1 -- 172.21.15.71:0/1396991795 learned_addr learned my addr 172.21.15.71:0/1396991795 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.344+0000 7f2c9b400640 1 -- 172.21.15.71:0/1396991795 >> v2:172.21.15.137:3300/0 conn(0x7f2c9c0d1c10 msgr2=0x7f2c9c0b6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.344+0000 7f2c9b400640 1 --2- 172.21.15.71:0/1396991795 >> v2:172.21.15.137:3300/0 conn(0x7f2c9c0d1c10 0x7f2c9c0b6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.344+0000 7f2c9b400640 1 -- 172.21.15.71:0/1396991795 >> v1:172.21.15.137:6789/0 conn(0x7f2c9c15e960 legacy=0x7f2c9c0d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.344+0000 7f2c9aa00640 1 -- 172.21.15.71:0/1396991795 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389581847 0 0) 0x7f2c9c15ed40 con 0x7f2c9c15e960 2024-04-20T21:20:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.344+0000 7f2c9b400640 1 -- 172.21.15.71:0/1396991795 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c0d1130 con 0x7f2c9c0d51b0 2024-04-20T21:20:55.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.346+0000 7f2c9b400640 1 --2- 172.21.15.71:0/1396991795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d51b0 0x7f2c9c0b6120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c840097a0 tx=0x7f2c8402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=775307867adbc305 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:55.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.346+0000 7f2c9aa00640 1 -- 172.21.15.71:0/1396991795 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c84035020 con 0x7f2c9c0d51b0 2024-04-20T21:20:55.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.346+0000 7f2c9aa00640 1 -- 172.21.15.71:0/1396991795 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c84031830 con 0x7f2c9c0d51b0 2024-04-20T21:20:55.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.346+0000 7f2c9aa00640 1 -- 172.21.15.71:0/1396991795 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c84031c00 con 0x7f2c9c0d51b0 2024-04-20T21:20:55.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.347+0000 7f2ca3000640 1 -- 172.21.15.71:0/1396991795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d51b0 msgr2=0x7f2c9c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.347+0000 7f2ca3000640 1 --2- 172.21.15.71:0/1396991795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d51b0 0x7f2c9c0b6120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c840097a0 tx=0x7f2c8402b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.347+0000 7f2ca3000640 1 -- 172.21.15.71:0/1396991795 shutdown_connections 2024-04-20T21:20:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.347+0000 7f2ca3000640 1 --2- 172.21.15.71:0/1396991795 >> v2:172.21.15.137:3300/0 conn(0x7f2c9c0d1c10 0x7f2c9c0b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.347+0000 7f2ca3000640 1 --2- 172.21.15.71:0/1396991795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d51b0 0x7f2c9c0b6120 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.347+0000 7f2ca3000640 1 -- 172.21.15.71:0/1396991795 >> 172.21.15.71:0/1396991795 conn(0x7f2c9c0b96f0 msgr2=0x7f2c9c0b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.347+0000 7f2ca3000640 1 -- 172.21.15.71:0/1396991795 shutdown_connections 2024-04-20T21:20:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.347+0000 7f2ca3000640 1 -- 172.21.15.71:0/1396991795 wait complete. 2024-04-20T21:20:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.348+0000 7f2ca3000640 1 Processor -- start 2024-04-20T21:20:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.349+0000 7f2ca3000640 1 -- start start 2024-04-20T21:20:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.349+0000 7f2ca3000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d1c10 0x7f2c9c0cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca3000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c9c0d51b0 0x7f2c9c06e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca3000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c9c15e960 0x7f2c9c1603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca3000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c0b6ba0 con 0x7f2c9c15e960 2024-04-20T21:20:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca3000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c0d16f0 con 0x7f2c9c0d51b0 2024-04-20T21:20:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca3000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9c0d3160 con 0x7f2c9c0d1c10 2024-04-20T21:20:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca1000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c9c15e960 0x7f2c9c1603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca1000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c9c15e960 0x7f2c9c1603c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41656/0 (socket says 172.21.15.71:41656) 2024-04-20T21:20:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca1000640 1 -- 172.21.15.71:0/3980537401 learned_addr learned my addr 172.21.15.71:0/3980537401 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2c9be00640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d1c10 0x7f2c9c0cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2c9b400640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c9c0d51b0 0x7f2c9c06e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca1000640 1 -- 172.21.15.71:0/3980537401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d1c10 msgr2=0x7f2c9c0cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca1000640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d1c10 0x7f2c9c0cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca1000640 1 -- 172.21.15.71:0/3980537401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c9c0d51b0 msgr2=0x7f2c9c06e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca1000640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c9c0d51b0 0x7f2c9c06e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.350+0000 7f2ca1000640 1 -- 172.21.15.71:0/3980537401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c06ec40 con 0x7f2c9c15e960 2024-04-20T21:20:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.351+0000 7f2ca1000640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c9c15e960 0x7f2c9c1603c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400efc0 tx=0x7f2c9400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.351+0000 7f2c93e00640 1 -- 172.21.15.71:0/3980537401 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94018020 con 0x7f2c9c15e960 2024-04-20T21:20:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.351+0000 7f2c93e00640 1 -- 172.21.15.71:0/3980537401 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c94014480 con 0x7f2c9c15e960 2024-04-20T21:20:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.351+0000 7f2c93e00640 1 -- 172.21.15.71:0/3980537401 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94014870 con 0x7f2c9c15e960 2024-04-20T21:20:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.351+0000 7f2ca3000640 1 -- 172.21.15.71:0/3980537401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9c06e960 con 0x7f2c9c15e960 2024-04-20T21:20:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.351+0000 7f2ca3000640 1 -- 172.21.15.71:0/3980537401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9c0ccc30 con 0x7f2c9c15e960 2024-04-20T21:20:55.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.352+0000 7f2ca3000640 1 -- 172.21.15.71:0/3980537401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9c068980 con 0x7f2c9c15e960 2024-04-20T21:20:55.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.353+0000 7f2c93e00640 1 -- 172.21.15.71:0/3980537401 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c94005d10 con 0x7f2c9c15e960 2024-04-20T21:20:55.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.355+0000 7f2c93e00640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2c7806c8f0 0x7f2c7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:55.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.355+0000 7f2c93e00640 1 -- 172.21.15.71:0/3980537401 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f2c9408cd40 con 0x7f2c9c15e960 2024-04-20T21:20:55.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.355+0000 7f2c9be00640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2c7806c8f0 0x7f2c7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:55.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.356+0000 7f2c9be00640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2c7806c8f0 0x7f2c7806edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c000f60 tx=0x7f2c8c007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:55.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.359+0000 7f2c93e00640 1 -- 172.21.15.71:0/3980537401 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2c94022030 con 0x7f2c9c15e960 2024-04-20T21:20:55.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.558+0000 7f2ca3000640 1 -- 172.21.15.71:0/3980537401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2c9c0cb0e0 con 0x7f2c9c15e960 2024-04-20T21:20:55.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.558+0000 7f2c93e00640 1 -- 172.21.15.71:0/3980537401 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f2c94010040 con 0x7f2c9c15e960 2024-04-20T21:20:55.558 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 -- 172.21.15.71:0/3980537401 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2c7806c8f0 msgr2=0x7f2c7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2c7806c8f0 0x7f2c7806edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c000f60 tx=0x7f2c8c007c00 comp rx=0 tx=0).stop 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 -- 172.21.15.71:0/3980537401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c9c15e960 msgr2=0x7f2c9c1603c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c9c15e960 0x7f2c9c1603c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400efc0 tx=0x7f2c9400c490 comp rx=0 tx=0).stop 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 -- 172.21.15.71:0/3980537401 shutdown_connections 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2c7806c8f0 0x7f2c7806edb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c9c15e960 0x7f2c9c1603c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c9c0d51b0 0x7f2c9c06e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 --2- 172.21.15.71:0/3980537401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0d1c10 0x7f2c9c0cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 -- 172.21.15.71:0/3980537401 >> 172.21.15.71:0/3980537401 conn(0x7f2c9c0b96f0 msgr2=0x7f2c9c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 -- 172.21.15.71:0/3980537401 shutdown_connections 2024-04-20T21:20:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.561+0000 7f2ca3000640 1 -- 172.21.15.71:0/3980537401 wait complete. 2024-04-20T21:20:55.579 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T21:20:55.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.783+0000 7fc0ba200640 1 Processor -- start 2024-04-20T21:20:55.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.783+0000 7fc0ba200640 1 -- start start 2024-04-20T21:20:55.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.785+0000 7fc0ba200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0b415ca40 0x7fc0b40ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:55.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.785+0000 7fc0ba200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b4141c60 con 0x7fc0b4156c20 2024-04-20T21:20:55.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.785+0000 7fc0ba200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b415cf90 con 0x7fc0b40ad8e0 2024-04-20T21:20:55.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.785+0000 7fc0ba200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b406c010 con 0x7fc0b415ca40 2024-04-20T21:20:55.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.785+0000 7fc0b3400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc0b4156c20 0x7fc0b406b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37084/0 (socket says 172.21.15.71:37084) 2024-04-20T21:20:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.785+0000 7fc0b3400640 1 -- 172.21.15.71:0/3402452674 learned_addr learned my addr 172.21.15.71:0/3402452674 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.785+0000 7fc0abe00640 1 --2- 172.21.15.71:0/3402452674 >> v2:172.21.15.71:3300/0 conn(0x7fc0b415ca40 0x7fc0b40ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.786+0000 7fc0b2a00640 1 -- 172.21.15.71:0/3402452674 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 830675563 0 0) 0x7fc0b4141c60 con 0x7fc0b4156c20 2024-04-20T21:20:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.786+0000 7fc0b2a00640 1 -- 172.21.15.71:0/3402452674 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc098003520 con 0x7fc0b4156c20 2024-04-20T21:20:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.786+0000 7fc0abe00640 1 -- 172.21.15.71:0/3402452674 >> v1:172.21.15.137:6789/0 conn(0x7fc0b40ad8e0 legacy=0x7fc0b40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.786+0000 7fc0abe00640 1 -- 172.21.15.71:0/3402452674 >> v1:172.21.15.71:6789/0 conn(0x7fc0b4156c20 legacy=0x7fc0b406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.786+0000 7fc0abe00640 1 -- 172.21.15.71:0/3402452674 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b415d270 con 0x7fc0b415ca40 2024-04-20T21:20:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.787+0000 7fc0abe00640 1 --2- 172.21.15.71:0/3402452674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b415ca40 0x7fc0b40ad3a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4141e30 tx=0x7fc09c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ece17757d95a25e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.787+0000 7fc0b2a00640 1 -- 172.21.15.71:0/3402452674 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c034070 con 0x7fc0b415ca40 2024-04-20T21:20:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.787+0000 7fc0b2a00640 1 -- 172.21.15.71:0/3402452674 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09c030800 con 0x7fc0b415ca40 2024-04-20T21:20:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.787+0000 7fc0b2a00640 1 -- 172.21.15.71:0/3402452674 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c030bb0 con 0x7fc0b415ca40 2024-04-20T21:20:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.788+0000 7fc0ba200640 1 -- 172.21.15.71:0/3402452674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b415ca40 msgr2=0x7fc0b40ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.788+0000 7fc0ba200640 1 --2- 172.21.15.71:0/3402452674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b415ca40 0x7fc0b40ad3a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4141e30 tx=0x7fc09c02b940 comp rx=0 tx=0).stop 2024-04-20T21:20:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.788+0000 7fc0ba200640 1 -- 172.21.15.71:0/3402452674 shutdown_connections 2024-04-20T21:20:55.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.788+0000 7fc0ba200640 1 --2- 172.21.15.71:0/3402452674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b415ca40 0x7fc0b40ad3a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.788+0000 7fc0ba200640 1 -- 172.21.15.71:0/3402452674 >> 172.21.15.71:0/3402452674 conn(0x7fc0b40b3350 msgr2=0x7fc0b40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:55.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.788+0000 7fc0ba200640 1 -- 172.21.15.71:0/3402452674 shutdown_connections 2024-04-20T21:20:55.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.788+0000 7fc0ba200640 1 -- 172.21.15.71:0/3402452674 wait complete. 2024-04-20T21:20:55.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.790+0000 7fc0ba200640 1 Processor -- start 2024-04-20T21:20:55.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.790+0000 7fc0ba200640 1 -- start start 2024-04-20T21:20:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0ba200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b40ad8e0 0x7fc0b41542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0ba200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0b4156c20 0x7fc0b4099830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0ba200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b415ca40 0x7fc0b4099210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0ba200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b40d0a70 con 0x7fc0b415ca40 2024-04-20T21:20:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0ba200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b415d830 con 0x7fc0b4156c20 2024-04-20T21:20:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0ba200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b40d0bf0 con 0x7fc0b40ad8e0 2024-04-20T21:20:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0b3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b415ca40 0x7fc0b4099210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0b3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b415ca40 0x7fc0b4099210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41672/0 (socket says 172.21.15.71:41672) 2024-04-20T21:20:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0b3e00640 1 -- 172.21.15.71:0/3081787508 learned_addr learned my addr 172.21.15.71:0/3081787508 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0b3400640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b40ad8e0 0x7fc0b41542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0abe00640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0b4156c20 0x7fc0b4099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0b3e00640 1 -- 172.21.15.71:0/3081787508 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b40ad8e0 msgr2=0x7fc0b41542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0b3e00640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b40ad8e0 0x7fc0b41542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.792+0000 7fc0b3e00640 1 -- 172.21.15.71:0/3081787508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0b4156c20 msgr2=0x7fc0b4099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.793+0000 7fc0b3e00640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0b4156c20 0x7fc0b4099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:55.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.793+0000 7fc0b3e00640 1 -- 172.21.15.71:0/3081787508 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b4153870 con 0x7fc0b415ca40 2024-04-20T21:20:55.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.793+0000 7fc0b3e00640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b415ca40 0x7fc0b4099210 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c730 tx=0x7fc0ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:55.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.793+0000 7fc0ab400640 1 -- 172.21.15.71:0/3081787508 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac003b70 con 0x7fc0b415ca40 2024-04-20T21:20:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.793+0000 7fc0ab400640 1 -- 172.21.15.71:0/3081787508 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac003d10 con 0x7fc0b415ca40 2024-04-20T21:20:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.793+0000 7fc0ba200640 1 -- 172.21.15.71:0/3081787508 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b4153b50 con 0x7fc0b415ca40 2024-04-20T21:20:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.793+0000 7fc0ab400640 1 -- 172.21.15.71:0/3081787508 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac005310 con 0x7fc0b415ca40 2024-04-20T21:20:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.793+0000 7fc0ba200640 1 -- 172.21.15.71:0/3081787508 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b4154880 con 0x7fc0b415ca40 2024-04-20T21:20:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.794+0000 7fc0ba200640 1 -- 172.21.15.71:0/3081787508 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b4154070 con 0x7fc0b415ca40 2024-04-20T21:20:55.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.796+0000 7fc0ab400640 1 -- 172.21.15.71:0/3081787508 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc0ac0054b0 con 0x7fc0b415ca40 2024-04-20T21:20:55.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.796+0000 7fc0ab400640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc09006c8f0 0x7fc09006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:55.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.797+0000 7fc0ab400640 1 -- 172.21.15.71:0/3081787508 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fc0ac08bdd0 con 0x7fc0b415ca40 2024-04-20T21:20:55.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.797+0000 7fc0b3400640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc09006c8f0 0x7fc09006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:55.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.798+0000 7fc0b3400640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc09006c8f0 0x7fc09006edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40011e0 tx=0x7fc0a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:55.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:55.801+0000 7fc0ab400640 1 -- 172.21.15.71:0/3081787508 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc0b4154070 con 0x7fc0b415ca40 2024-04-20T21:20:56.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.015+0000 7fc0ba200640 1 -- 172.21.15.71:0/3081787508 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc0b4068980 con 0x7fc0b415ca40 2024-04-20T21:20:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.016+0000 7fc0ab400640 1 -- 172.21.15.71:0/3081787508 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fc0ac059d40 con 0x7fc0b415ca40 2024-04-20T21:20:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2024-04-20T21:20:56.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.018+0000 7fc0ba200640 1 -- 172.21.15.71:0/3081787508 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc09006c8f0 msgr2=0x7fc09006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.018+0000 7fc0ba200640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc09006c8f0 0x7fc09006edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40011e0 tx=0x7fc0a4009040 comp rx=0 tx=0).stop 2024-04-20T21:20:56.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.018+0000 7fc0ba200640 1 -- 172.21.15.71:0/3081787508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b415ca40 msgr2=0x7fc0b4099210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.018+0000 7fc0ba200640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b415ca40 0x7fc0b4099210 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c730 tx=0x7fc0ac00cbf0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.019+0000 7fc0ba200640 1 -- 172.21.15.71:0/3081787508 shutdown_connections 2024-04-20T21:20:56.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.019+0000 7fc0ba200640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc09006c8f0 0x7fc09006edb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.019+0000 7fc0ba200640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0b415ca40 0x7fc0b4099210 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.019+0000 7fc0ba200640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0b4156c20 0x7fc0b4099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.019+0000 7fc0ba200640 1 --2- 172.21.15.71:0/3081787508 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0b40ad8e0 0x7fc0b41542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.019+0000 7fc0ba200640 1 -- 172.21.15.71:0/3081787508 >> 172.21.15.71:0/3081787508 conn(0x7fc0b40b3350 msgr2=0x7fc0b415db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:56.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.019+0000 7fc0ba200640 1 -- 172.21.15.71:0/3081787508 shutdown_connections 2024-04-20T21:20:56.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.019+0000 7fc0ba200640 1 -- 172.21.15.71:0/3081787508 wait complete. 2024-04-20T21:20:56.038 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi137.front.sepia.ceph.com... 2024-04-20T21:20:56.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:56.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-04-20T21:20:56.127 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T21:20:56.127 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-20T21:20:56.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:20:56.128 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-20T21:20:56.178 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-20T21:20:56.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:20:56.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.382+0000 7fb710200640 1 Processor -- start 2024-04-20T21:20:56.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.382+0000 7fb710200640 1 -- start start 2024-04-20T21:20:56.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.383+0000 7fb710200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb70815b3b0 0x7fb70806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.383+0000 7fb710200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb70806dcb0 0x7fb708071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.383+0000 7fb710200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7080ade40 con 0x7fb708072090 2024-04-20T21:20:56.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.383+0000 7fb710200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb7080ae0e0 con 0x7fb70806dcb0 2024-04-20T21:20:56.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.383+0000 7fb710200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb70815b790 con 0x7fb70815b3b0 2024-04-20T21:20:56.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.384+0000 7fb70ce00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb70806dcb0 0x7fb708071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.384+0000 7fb70e200640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb708072090 0x7fb7080d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37098/0 (socket says 172.21.15.71:37098) 2024-04-20T21:20:56.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.384+0000 7fb70e200640 1 -- 172.21.15.71:0/2240824342 learned_addr learned my addr 172.21.15.71:0/2240824342 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:56.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.384+0000 7fb70d800640 1 --2- 172.21.15.71:0/2240824342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb70815b3b0 0x7fb70806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.384+0000 7fb70ce00640 1 -- 172.21.15.71:0/2240824342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb70815b3b0 msgr2=0x7fb70806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:56.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.384+0000 7fb70ce00640 1 --2- 172.21.15.71:0/2240824342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb70815b3b0 0x7fb70806eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.384+0000 7fb70ce00640 1 -- 172.21.15.71:0/2240824342 >> v1:172.21.15.71:6789/0 conn(0x7fb708072090 legacy=0x7fb7080d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.384+0000 7fb707e00640 1 -- 172.21.15.71:0/2240824342 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2030864048 0 0) 0x7fb7080ade40 con 0x7fb708072090 2024-04-20T21:20:56.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.384+0000 7fb70ce00640 1 -- 172.21.15.71:0/2240824342 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7080ae380 con 0x7fb70806dcb0 2024-04-20T21:20:56.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.385+0000 7fb70ce00640 1 --2- 172.21.15.71:0/2240824342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb70806dcb0 0x7fb708071b50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40097a0 tx=0x7fb6f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5027721b5acdaf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:56.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.386+0000 7fb707e00640 1 -- 172.21.15.71:0/2240824342 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4035020 con 0x7fb70806dcb0 2024-04-20T21:20:56.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.386+0000 7fb707e00640 1 -- 172.21.15.71:0/2240824342 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f4031830 con 0x7fb70806dcb0 2024-04-20T21:20:56.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.386+0000 7fb707e00640 1 -- 172.21.15.71:0/2240824342 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4031c00 con 0x7fb70806dcb0 2024-04-20T21:20:56.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.386+0000 7fb710200640 1 -- 172.21.15.71:0/2240824342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb70806dcb0 msgr2=0x7fb708071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.386+0000 7fb710200640 1 --2- 172.21.15.71:0/2240824342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb70806dcb0 0x7fb708071b50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40097a0 tx=0x7fb6f402b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.386+0000 7fb710200640 1 -- 172.21.15.71:0/2240824342 shutdown_connections 2024-04-20T21:20:56.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.386+0000 7fb710200640 1 --2- 172.21.15.71:0/2240824342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb70806dcb0 0x7fb708071b50 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.386+0000 7fb710200640 1 --2- 172.21.15.71:0/2240824342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb70815b3b0 0x7fb70806eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.386+0000 7fb710200640 1 -- 172.21.15.71:0/2240824342 >> 172.21.15.71:0/2240824342 conn(0x7fb7080b3350 msgr2=0x7fb7080b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:56.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.387+0000 7fb710200640 1 -- 172.21.15.71:0/2240824342 shutdown_connections 2024-04-20T21:20:56.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.387+0000 7fb710200640 1 -- 172.21.15.71:0/2240824342 wait complete. 2024-04-20T21:20:56.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.388+0000 7fb710200640 1 Processor -- start 2024-04-20T21:20:56.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.388+0000 7fb710200640 1 -- start start 2024-04-20T21:20:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.389+0000 7fb710200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb70806dcb0 0x7fb708156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.389+0000 7fb710200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70815b3b0 0x7fb7081f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.389+0000 7fb710200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb70815e0c0 0x7fb70815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.389+0000 7fb710200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb7080aec20 con 0x7fb70806dcb0 2024-04-20T21:20:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.389+0000 7fb710200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7080ae940 con 0x7fb70815b3b0 2024-04-20T21:20:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.389+0000 7fb710200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb70806efe0 con 0x7fb70815e0c0 2024-04-20T21:20:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb70806dcb0 0x7fb708156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb70806dcb0 0x7fb708156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41686/0 (socket says 172.21.15.71:41686) 2024-04-20T21:20:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70d800640 1 -- 172.21.15.71:0/828394815 learned_addr learned my addr 172.21.15.71:0/828394815 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70e200640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb70815e0c0 0x7fb70815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70d800640 1 -- 172.21.15.71:0/828394815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb70815e0c0 msgr2=0x7fb70815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70d800640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb70815e0c0 0x7fb70815e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70ce00640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70815b3b0 0x7fb7081f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70d800640 1 -- 172.21.15.71:0/828394815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70815b3b0 msgr2=0x7fb7081f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70d800640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70815b3b0 0x7fb7081f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70d800640 1 -- 172.21.15.71:0/828394815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70815b940 con 0x7fb70806dcb0 2024-04-20T21:20:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70e200640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb70815e0c0 0x7fb70815e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.390+0000 7fb70d800640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb70806dcb0 0x7fb708156940 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800d800 tx=0x7fb6f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.391+0000 7fb705600640 1 -- 172.21.15.71:0/828394815 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800b6c0 con 0x7fb70806dcb0 2024-04-20T21:20:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.391+0000 7fb705600640 1 -- 172.21.15.71:0/828394815 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f8019070 con 0x7fb70806dcb0 2024-04-20T21:20:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.391+0000 7fb710200640 1 -- 172.21.15.71:0/828394815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70815bc20 con 0x7fb70806dcb0 2024-04-20T21:20:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.391+0000 7fb705600640 1 -- 172.21.15.71:0/828394815 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800ba80 con 0x7fb70806dcb0 2024-04-20T21:20:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.391+0000 7fb710200640 1 -- 172.21.15.71:0/828394815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70815d8c0 con 0x7fb70806dcb0 2024-04-20T21:20:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.392+0000 7fb710200640 1 -- 172.21.15.71:0/828394815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb708068980 con 0x7fb70806dcb0 2024-04-20T21:20:56.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.393+0000 7fb705600640 1 -- 172.21.15.71:0/828394815 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6f800bc20 con 0x7fb70806dcb0 2024-04-20T21:20:56.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.394+0000 7fb705600640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb6e806c8f0 0x7fb6e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.394+0000 7fb705600640 1 -- 172.21.15.71:0/828394815 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fb6f808c510 con 0x7fb70806dcb0 2024-04-20T21:20:56.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.394+0000 7fb70ce00640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb6e806c8f0 0x7fb6e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.395+0000 7fb70ce00640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb6e806c8f0 0x7fb6e806edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4036000 tx=0x7fb6f4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.398+0000 7fb705600640 1 -- 172.21.15.71:0/828394815 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb6f805a480 con 0x7fb70806dcb0 2024-04-20T21:20:56.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.635+0000 7fb710200640 1 -- 172.21.15.71:0/828394815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7081518e0 con 0x7fb70806dcb0 2024-04-20T21:20:56.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.636+0000 7fb705600640 1 -- 172.21.15.71:0/828394815 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5201 (secure 0 0 0) 0x7fb6f8059d80 con 0x7fb70806dcb0 2024-04-20T21:20:56.636 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:56.636 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3502151495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3502151495},{"type":"v1","addr":"172.21.15.137:6833","nonce":3502151495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2603023903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2603023903},{"type":"v1","addr":"172.21.15.137:6835","nonce":2603023903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3246613850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3246613850},{"type":"v1","addr":"172.21.15.71:6835","nonce":3246613850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:19:28.763862+0000","modified":"2024-04-20T21:19:51.195122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/4085222328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":4085222328},{"type":"v1","addr":"172.21.15.71:6837","nonce":4085222328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-20T21:20:56.636 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2024-04-20T21:20:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.638+0000 7fb710200640 1 -- 172.21.15.71:0/828394815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb6e806c8f0 msgr2=0x7fb6e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.638+0000 7fb710200640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb6e806c8f0 0x7fb6e806edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4036000 tx=0x7fb6f4008030 comp rx=0 tx=0).stop 2024-04-20T21:20:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.638+0000 7fb710200640 1 -- 172.21.15.71:0/828394815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb70806dcb0 msgr2=0x7fb708156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.638+0000 7fb710200640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb70806dcb0 0x7fb708156940 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800d800 tx=0x7fb6f800dcc0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.638+0000 7fb710200640 1 -- 172.21.15.71:0/828394815 shutdown_connections 2024-04-20T21:20:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.638+0000 7fb710200640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb6e806c8f0 0x7fb6e806edb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.638+0000 7fb710200640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb70815e0c0 0x7fb70815e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.638+0000 7fb710200640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70815b3b0 0x7fb7081f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.638+0000 7fb710200640 1 --2- 172.21.15.71:0/828394815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb70806dcb0 0x7fb708156940 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.638+0000 7fb710200640 1 -- 172.21.15.71:0/828394815 >> 172.21.15.71:0/828394815 conn(0x7fb7080b3350 msgr2=0x7fb70815ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:56.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.639+0000 7fb710200640 1 -- 172.21.15.71:0/828394815 shutdown_connections 2024-04-20T21:20:56.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.639+0000 7fb710200640 1 -- 172.21.15.71:0/828394815 wait complete. 2024-04-20T21:20:56.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:56.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.855+0000 7f9f88a00640 1 Processor -- start 2024-04-20T21:20:56.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.855+0000 7f9f88a00640 1 -- start start 2024-04-20T21:20:56.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.856+0000 7f9f88a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9f84159e10 0x7f9f84071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.857+0000 7f9f88a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8406da90 0x7f9f84071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.857+0000 7f9f88a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8415cc90 con 0x7f9f8415a1f0 2024-04-20T21:20:56.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.857+0000 7f9f88a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9f84072900 con 0x7f9f84159e10 2024-04-20T21:20:56.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.857+0000 7f9f88a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9f8415ca40 con 0x7f9f8406da90 2024-04-20T21:20:56.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.857+0000 7f9f83e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8406da90 0x7f9f84071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.857+0000 7f9f83400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9f84159e10 0x7f9f84071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.857+0000 7f9f83e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8406da90 0x7f9f84071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:54660/0 (socket says 172.21.15.71:54660) 2024-04-20T21:20:56.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.858+0000 7f9f83e00640 1 -- 172.21.15.71:0/3623494841 learned_addr learned my addr 172.21.15.71:0/3623494841 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:56.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.857+0000 7f9f82a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9f8415a1f0 0x7f9f84160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:33988/0 (socket says 172.21.15.71:33988) 2024-04-20T21:20:56.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.858+0000 7f9f83e00640 1 -- 172.21.15.71:0/3623494841 >> v2:172.21.15.137:3300/0 conn(0x7f9f84159e10 msgr2=0x7f9f84071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:56.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.858+0000 7f9f83e00640 1 --2- 172.21.15.71:0/3623494841 >> v2:172.21.15.137:3300/0 conn(0x7f9f84159e10 0x7f9f84071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.858+0000 7f9f83e00640 1 -- 172.21.15.71:0/3623494841 >> v1:172.21.15.137:6789/0 conn(0x7f9f8415a1f0 legacy=0x7f9f84160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.858+0000 7f9f83e00640 1 -- 172.21.15.71:0/3623494841 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8415cf70 con 0x7f9f8406da90 2024-04-20T21:20:56.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.858+0000 7f9f83400640 1 --2- 172.21.15.71:0/3623494841 >> v2:172.21.15.137:3300/0 conn(0x7f9f84159e10 0x7f9f84071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:20:56.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.860+0000 7f9f83e00640 1 --2- 172.21.15.71:0/3623494841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8406da90 0x7f9f84071fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009e50 tx=0x7f9f7c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20401c7a211b4da5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:56.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.860+0000 7f9f82000640 1 -- 172.21.15.71:0/3623494841 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c02cb00 con 0x7f9f8406da90 2024-04-20T21:20:56.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.861+0000 7f9f82000640 1 -- 172.21.15.71:0/3623494841 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f7c02cca0 con 0x7f9f8406da90 2024-04-20T21:20:56.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.861+0000 7f9f82000640 1 -- 172.21.15.71:0/3623494841 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c034610 con 0x7f9f8406da90 2024-04-20T21:20:56.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.861+0000 7f9f88a00640 1 -- 172.21.15.71:0/3623494841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8406da90 msgr2=0x7f9f84071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.861+0000 7f9f88a00640 1 --2- 172.21.15.71:0/3623494841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8406da90 0x7f9f84071fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009e50 tx=0x7f9f7c02bf60 comp rx=0 tx=0).stop 2024-04-20T21:20:56.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.861+0000 7f9f88a00640 1 -- 172.21.15.71:0/3623494841 shutdown_connections 2024-04-20T21:20:56.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.861+0000 7f9f88a00640 1 --2- 172.21.15.71:0/3623494841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8406da90 0x7f9f84071fc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.861+0000 7f9f88a00640 1 --2- 172.21.15.71:0/3623494841 >> v2:172.21.15.137:3300/0 conn(0x7f9f84159e10 0x7f9f84071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.861+0000 7f9f88a00640 1 -- 172.21.15.71:0/3623494841 >> 172.21.15.71:0/3623494841 conn(0x7f9f840d0040 msgr2=0x7f9f840d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:56.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.861+0000 7f9f88a00640 1 -- 172.21.15.71:0/3623494841 shutdown_connections 2024-04-20T21:20:56.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.861+0000 7f9f88a00640 1 -- 172.21.15.71:0/3623494841 wait complete. 2024-04-20T21:20:56.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.863+0000 7f9f88a00640 1 Processor -- start 2024-04-20T21:20:56.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.863+0000 7f9f88a00640 1 -- start start 2024-04-20T21:20:56.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.864+0000 7f9f88a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f8406da90 0x7f9f8415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.864+0000 7f9f88a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f84159e10 0x7f9f841f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.864+0000 7f9f88a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8415a1f0 0x7f9f84150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.864+0000 7f9f88a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8415d810 con 0x7f9f84159e10 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.864+0000 7f9f88a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8415d530 con 0x7f9f8406da90 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.864+0000 7f9f88a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9f8406b900 con 0x7f9f8415a1f0 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.865+0000 7f9f82a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f84159e10 0x7f9f841f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.865+0000 7f9f82a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f84159e10 0x7f9f841f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41700/0 (socket says 172.21.15.71:41700) 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.865+0000 7f9f82a00640 1 -- 172.21.15.71:0/1013109478 learned_addr learned my addr 172.21.15.71:0/1013109478 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.865+0000 7f9f83e00640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8415a1f0 0x7f9f84150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.865+0000 7f9f83400640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f8406da90 0x7f9f8415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.865+0000 7f9f82a00640 1 -- 172.21.15.71:0/1013109478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8415a1f0 msgr2=0x7f9f84150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.865+0000 7f9f82a00640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8415a1f0 0x7f9f84150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.865+0000 7f9f82a00640 1 -- 172.21.15.71:0/1013109478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f8406da90 msgr2=0x7f9f8415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.865+0000 7f9f82a00640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f8406da90 0x7f9f8415f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:56.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.865+0000 7f9f82a00640 1 -- 172.21.15.71:0/1013109478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f84151450 con 0x7f9f84159e10 2024-04-20T21:20:56.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.865+0000 7f9f82a00640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f84159e10 0x7f9f841f3cf0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000c3c0 tx=0x7f9f7000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:56.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.866+0000 7f9f7b400640 1 -- 172.21.15.71:0/1013109478 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f700074e0 con 0x7f9f84159e10 2024-04-20T21:20:56.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.866+0000 7f9f7b400640 1 -- 172.21.15.71:0/1013109478 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f700076a0 con 0x7f9f84159e10 2024-04-20T21:20:56.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.866+0000 7f9f88a00640 1 -- 172.21.15.71:0/1013109478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f84156540 con 0x7f9f84159e10 2024-04-20T21:20:56.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.866+0000 7f9f7b400640 1 -- 172.21.15.71:0/1013109478 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70004a20 con 0x7f9f84159e10 2024-04-20T21:20:56.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.866+0000 7f9f88a00640 1 -- 172.21.15.71:0/1013109478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f841543e0 con 0x7f9f84159e10 2024-04-20T21:20:56.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.867+0000 7f9f88a00640 1 -- 172.21.15.71:0/1013109478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f84075b60 con 0x7f9f84159e10 2024-04-20T21:20:56.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.868+0000 7f9f7b400640 1 -- 172.21.15.71:0/1013109478 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f7001a020 con 0x7f9f84159e10 2024-04-20T21:20:56.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.869+0000 7f9f7b400640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9f6406c8f0 0x7f9f6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:56.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.869+0000 7f9f7b400640 1 -- 172.21.15.71:0/1013109478 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f9f7008b6f0 con 0x7f9f84159e10 2024-04-20T21:20:56.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.869+0000 7f9f83400640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9f6406c8f0 0x7f9f6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:56.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.870+0000 7f9f83400640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9f6406c8f0 0x7f9f6406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9f8415bf00 tx=0x7f9f7400f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:56.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:56.873+0000 7f9f7b400640 1 -- 172.21.15.71:0/1013109478 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9f70010300 con 0x7f9f84159e10 2024-04-20T21:20:57.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.074+0000 7f9f88a00640 1 -- 172.21.15.71:0/1013109478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f84067cb0 con 0x7f9f84159e10 2024-04-20T21:20:57.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.076+0000 7f9f7b400640 1 -- 172.21.15.71:0/1013109478 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7f9f700596f0 con 0x7f9f84159e10 2024-04-20T21:20:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:57.076 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:57.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.078+0000 7f9f88a00640 1 -- 172.21.15.71:0/1013109478 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9f6406c8f0 msgr2=0x7f9f6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.078+0000 7f9f88a00640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9f6406c8f0 0x7f9f6406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9f8415bf00 tx=0x7f9f7400f040 comp rx=0 tx=0).stop 2024-04-20T21:20:57.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.078+0000 7f9f88a00640 1 -- 172.21.15.71:0/1013109478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f84159e10 msgr2=0x7f9f841f3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.078+0000 7f9f88a00640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f84159e10 0x7f9f841f3cf0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000c3c0 tx=0x7f9f7000c880 comp rx=0 tx=0).stop 2024-04-20T21:20:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.078+0000 7f9f88a00640 1 -- 172.21.15.71:0/1013109478 shutdown_connections 2024-04-20T21:20:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.078+0000 7f9f88a00640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9f6406c8f0 0x7f9f6406edb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.078+0000 7f9f88a00640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f8415a1f0 0x7f9f84150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.078+0000 7f9f88a00640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f84159e10 0x7f9f841f3cf0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.078+0000 7f9f88a00640 1 --2- 172.21.15.71:0/1013109478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f8406da90 0x7f9f8415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.078+0000 7f9f88a00640 1 -- 172.21.15.71:0/1013109478 >> 172.21.15.71:0/1013109478 conn(0x7f9f840d0040 msgr2=0x7f9f840afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.078+0000 7f9f88a00640 1 -- 172.21.15.71:0/1013109478 shutdown_connections 2024-04-20T21:20:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.079+0000 7f9f88a00640 1 -- 172.21.15.71:0/1013109478 wait complete. 2024-04-20T21:20:57.099 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T21:19:26.847376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T21:19:27.750099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T21:19:31.604142+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T21:20:57.099 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:20:57.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.306+0000 7f15bb200640 1 Processor -- start 2024-04-20T21:20:57.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.306+0000 7f15bb200640 1 -- start start 2024-04-20T21:20:57.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.308+0000 7f15bb200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f15bc0cb570 0x7f15bc071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.308+0000 7f15bb200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc15b360 0x7f15bc06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.308+0000 7f15bb200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc06f3b0 con 0x7f15bc15af80 2024-04-20T21:20:57.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.308+0000 7f15bb200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f15bc09e150 con 0x7f15bc0cb570 2024-04-20T21:20:57.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.308+0000 7f15bb200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f15bc06f180 con 0x7f15bc15b360 2024-04-20T21:20:57.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.309+0000 7f15b9e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f15bc15af80 0x7f15bc0cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:33990/0 (socket says 172.21.15.71:33990) 2024-04-20T21:20:57.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.309+0000 7f15ba800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc15b360 0x7f15bc06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.309+0000 7f15b9e00640 1 -- 172.21.15.71:0/1938910248 learned_addr learned my addr 172.21.15.71:0/1938910248 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:57.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.309+0000 7f15b9400640 1 --2- 172.21.15.71:0/1938910248 >> v2:172.21.15.137:3300/0 conn(0x7f15bc0cb570 0x7f15bc071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.310+0000 7f15b9400640 1 -- 172.21.15.71:0/1938910248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc15b360 msgr2=0x7f15bc06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:57.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.310+0000 7f15b9400640 1 --2- 172.21.15.71:0/1938910248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc15b360 0x7f15bc06ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.310+0000 7f15b9400640 1 -- 172.21.15.71:0/1938910248 >> v1:172.21.15.137:6789/0 conn(0x7f15bc15af80 legacy=0x7f15bc0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.310+0000 7f15b8a00640 1 -- 172.21.15.71:0/1938910248 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94645470 0 0) 0x7f15bc06f3b0 con 0x7f15bc15af80 2024-04-20T21:20:57.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.310+0000 7f15b9400640 1 -- 172.21.15.71:0/1938910248 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc06f690 con 0x7f15bc0cb570 2024-04-20T21:20:57.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.310+0000 7f15ba800640 1 --2- 172.21.15.71:0/1938910248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc15b360 0x7f15bc06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:20:57.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.311+0000 7f15b9400640 1 --2- 172.21.15.71:0/1938910248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15bc0cb570 0x7f15bc071a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f15a80097d0 tx=0x7f15a802b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84e7d4ff8d04a43a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:57.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.312+0000 7f15b8a00640 1 -- 172.21.15.71:0/1938910248 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8031770 con 0x7f15bc0cb570 2024-04-20T21:20:57.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.312+0000 7f15b8a00640 1 -- 172.21.15.71:0/1938910248 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8037070 con 0x7f15bc0cb570 2024-04-20T21:20:57.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.312+0000 7f15b8a00640 1 -- 172.21.15.71:0/1938910248 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8031b30 con 0x7f15bc0cb570 2024-04-20T21:20:57.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.312+0000 7f15bb200640 1 -- 172.21.15.71:0/1938910248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15bc0cb570 msgr2=0x7f15bc071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.312+0000 7f15bb200640 1 --2- 172.21.15.71:0/1938910248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15bc0cb570 0x7f15bc071a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f15a80097d0 tx=0x7f15a802b810 comp rx=0 tx=0).stop 2024-04-20T21:20:57.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.313+0000 7f15bb200640 1 -- 172.21.15.71:0/1938910248 shutdown_connections 2024-04-20T21:20:57.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.313+0000 7f15bb200640 1 --2- 172.21.15.71:0/1938910248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc15b360 0x7f15bc06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.313+0000 7f15bb200640 1 --2- 172.21.15.71:0/1938910248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15bc0cb570 0x7f15bc071a60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.313+0000 7f15bb200640 1 -- 172.21.15.71:0/1938910248 >> 172.21.15.71:0/1938910248 conn(0x7f15bc0cffa0 msgr2=0x7f15bc0d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:57.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.313+0000 7f15bb200640 1 -- 172.21.15.71:0/1938910248 shutdown_connections 2024-04-20T21:20:57.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.313+0000 7f15bb200640 1 -- 172.21.15.71:0/1938910248 wait complete. 2024-04-20T21:20:57.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.314+0000 7f15bb200640 1 Processor -- start 2024-04-20T21:20:57.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.314+0000 7f15bb200640 1 -- start start 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.315+0000 7f15bb200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc0cb570 0x7f15bc0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.315+0000 7f15bb200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15bc15af80 0x7f15bc149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.315+0000 7f15bb200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15bc15b360 0x7f15bc14a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.315+0000 7f15bb200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc0ad480 con 0x7f15bc15af80 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.315+0000 7f15bb200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc0acf50 con 0x7f15bc15b360 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.315+0000 7f15bb200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f15bc0ca910 con 0x7f15bc0cb570 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.316+0000 7f15b9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15bc15af80 0x7f15bc149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.316+0000 7f15b9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15bc15af80 0x7f15bc149be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41710/0 (socket says 172.21.15.71:41710) 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.316+0000 7f15b9400640 1 -- 172.21.15.71:0/1195427462 learned_addr learned my addr 172.21.15.71:0/1195427462 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.316+0000 7f15b9e00640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc0cb570 0x7f15bc0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.316+0000 7f15ba800640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15bc15b360 0x7f15bc14a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.316+0000 7f15b9400640 1 -- 172.21.15.71:0/1195427462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc0cb570 msgr2=0x7f15bc0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.316+0000 7f15b9400640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc0cb570 0x7f15bc0cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.316+0000 7f15b9400640 1 -- 172.21.15.71:0/1195427462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15bc15b360 msgr2=0x7f15bc14a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.316+0000 7f15b9400640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15bc15b360 0x7f15bc14a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.316+0000 7f15b9400640 1 -- 172.21.15.71:0/1195427462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc148370 con 0x7f15bc15af80 2024-04-20T21:20:57.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.316+0000 7f15b9e00640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc0cb570 0x7f15bc0cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:20:57.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.317+0000 7f15b9400640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15bc15af80 0x7f15bc149be0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f15a8034040 tx=0x7f15a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:57.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.317+0000 7f15b2000640 1 -- 172.21.15.71:0/1195427462 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8032600 con 0x7f15bc15af80 2024-04-20T21:20:57.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.317+0000 7f15b2000640 1 -- 172.21.15.71:0/1195427462 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a80327c0 con 0x7f15bc15af80 2024-04-20T21:20:57.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.317+0000 7f15b2000640 1 -- 172.21.15.71:0/1195427462 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8032bb0 con 0x7f15bc15af80 2024-04-20T21:20:57.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.317+0000 7f15bb200640 1 -- 172.21.15.71:0/1195427462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15bc148610 con 0x7f15bc15af80 2024-04-20T21:20:57.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.317+0000 7f15bb200640 1 -- 172.21.15.71:0/1195427462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15bc148bd0 con 0x7f15bc15af80 2024-04-20T21:20:57.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.318+0000 7f15bb200640 1 -- 172.21.15.71:0/1195427462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15bc075b30 con 0x7f15bc15af80 2024-04-20T21:20:57.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.319+0000 7f15b2000640 1 -- 172.21.15.71:0/1195427462 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15a804c060 con 0x7f15bc15af80 2024-04-20T21:20:57.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.320+0000 7f15b2000640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f159c06c8f0 0x7f159c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.320+0000 7f15b2000640 1 -- 172.21.15.71:0/1195427462 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f15a80ad4d0 con 0x7f15bc15af80 2024-04-20T21:20:57.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.320+0000 7f15b9e00640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f159c06c8f0 0x7f159c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.321+0000 7f15b9e00640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f159c06c8f0 0x7f159c06edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f15ac007fd0 tx=0x7f15ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:57.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.325+0000 7f15b2000640 1 -- 172.21.15.71:0/1195427462 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f15a8040070 con 0x7f15bc15af80 2024-04-20T21:20:57.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.528+0000 7f15bb200640 1 -- 172.21.15.71:0/1195427462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f15bc0ca6d0 con 0x7f15bc15af80 2024-04-20T21:20:57.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.528+0000 7f15b2000640 1 -- 172.21.15.71:0/1195427462 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f15a807b440 con 0x7f15bc15af80 2024-04-20T21:20:57.528 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:20:57.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 -- 172.21.15.71:0/1195427462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f159c06c8f0 msgr2=0x7f159c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f159c06c8f0 0x7f159c06edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f15ac007fd0 tx=0x7f15ac009040 comp rx=0 tx=0).stop 2024-04-20T21:20:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 -- 172.21.15.71:0/1195427462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15bc15af80 msgr2=0x7f15bc149be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15bc15af80 0x7f15bc149be0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f15a8034040 tx=0x7f15a80046c0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 -- 172.21.15.71:0/1195427462 shutdown_connections 2024-04-20T21:20:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f159c06c8f0 0x7f159c06edb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15bc15b360 0x7f15bc14a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15bc15af80 0x7f15bc149be0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 --2- 172.21.15.71:0/1195427462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15bc0cb570 0x7f15bc0cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 -- 172.21.15.71:0/1195427462 >> 172.21.15.71:0/1195427462 conn(0x7f15bc0cffa0 msgr2=0x7f15bc06b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 -- 172.21.15.71:0/1195427462 shutdown_connections 2024-04-20T21:20:57.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.531+0000 7f15bb200640 1 -- 172.21.15.71:0/1195427462 wait complete. 2024-04-20T21:20:57.550 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T21:20:57.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.755+0000 7f6e5d200640 1 Processor -- start 2024-04-20T21:20:57.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.756+0000 7f6e5d200640 1 -- start start 2024-04-20T21:20:57.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.757+0000 7f6e5d200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e580aeb30 0x7f6e5815ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.757+0000 7f6e5d200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e5806d8b0 0x7f6e580b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.757+0000 7f6e5d200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5815f100 con 0x7f6e58072e00 2024-04-20T21:20:57.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.757+0000 7f6e5d200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6e580adbb0 con 0x7f6e5806d8b0 2024-04-20T21:20:57.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.757+0000 7f6e5d200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e58073260 con 0x7f6e580aeb30 2024-04-20T21:20:57.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.757+0000 7f6e4ea00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6e58072e00 0x7f6e5806d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37104/0 (socket says 172.21.15.71:37104) 2024-04-20T21:20:57.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.757+0000 7f6e4ea00640 1 -- 172.21.15.71:0/3070924403 learned_addr learned my addr 172.21.15.71:0/3070924403 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:57.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e57e00640 1 --2- 172.21.15.71:0/3070924403 >> v2:172.21.15.137:3300/0 conn(0x7f6e5806d8b0 0x7f6e580b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e57400640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e580aeb30 0x7f6e5815ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884578158 0 0) 0x7f6e5815f100 con 0x7f6e58072e00 2024-04-20T21:20:57.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e3c003520 con 0x7f6e58072e00 2024-04-20T21:20:57.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4008595741 0 0) 0x7f6e3c003520 con 0x7f6e58072e00 2024-04-20T21:20:57.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e580aeb30 msgr2=0x7f6e5815ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:57.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e580aeb30 0x7f6e5815ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 >> v2:172.21.15.137:3300/0 conn(0x7f6e5806d8b0 msgr2=0x7f6e580b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 --2- 172.21.15.71:0/3070924403 >> v2:172.21.15.137:3300/0 conn(0x7f6e5806d8b0 0x7f6e580b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5815f3e0 con 0x7f6e58072e00 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f6e40001670 con 0x7f6e58072e00 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 >> v1:172.21.15.71:6789/0 conn(0x7f6e58072e00 legacy=0x7f6e5806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e580aeb30 0x7f6e3c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e3c003f30 0x7f6e3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e3c004d40 0x7f6e3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6e58073260 con 0x7f6e3c003f30 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c00b9c0 con 0x7f6e3c004d40 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.758+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c00bb40 con 0x7f6e580aeb30 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.759+0000 7f6e4ea00640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e3c003f30 0x7f6e3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.759+0000 7f6e57e00640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e3c004d40 0x7f6e3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.759+0000 7f6e57400640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e580aeb30 0x7f6e3c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.759+0000 7f6e4ea00640 1 -- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e580aeb30 msgr2=0x7f6e3c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:57.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.759+0000 7f6e4ea00640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e580aeb30 0x7f6e3c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.759+0000 7f6e4ea00640 1 -- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e3c004d40 msgr2=0x7f6e3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:57.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.759+0000 7f6e4ea00640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e3c004d40 0x7f6e3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.759+0000 7f6e4ea00640 1 -- 172.21.15.71:0/3070924403 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c003520 con 0x7f6e3c003f30 2024-04-20T21:20:57.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.759+0000 7f6e57400640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e580aeb30 0x7f6e3c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:57.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.760+0000 7f6e4ea00640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e3c003f30 0x7f6e3c004800 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000c290 tx=0x7f6e3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed964ecd97c9b5be server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:57.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.760+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40007d50 con 0x7f6e3c003f30 2024-04-20T21:20:57.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.760+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e40030070 con 0x7f6e3c003f30 2024-04-20T21:20:57.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.760+0000 7f6e56a00640 1 -- 172.21.15.71:0/3070924403 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4002cda0 con 0x7f6e3c003f30 2024-04-20T21:20:57.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.761+0000 7f6e5d200640 1 -- 172.21.15.71:0/3070924403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e3c003f30 msgr2=0x7f6e3c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.761+0000 7f6e5d200640 1 --2- 172.21.15.71:0/3070924403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e3c003f30 0x7f6e3c004800 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000c290 tx=0x7f6e3c005830 comp rx=0 tx=0).stop 2024-04-20T21:20:57.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.761+0000 7f6e57e00640 1 -- 172.21.15.71:0/3070924403 reap_dead start 2024-04-20T21:20:57.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.761+0000 7f6e5d200640 1 -- 172.21.15.71:0/3070924403 shutdown_connections 2024-04-20T21:20:57.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.761+0000 7f6e5d200640 1 -- 172.21.15.71:0/3070924403 >> 172.21.15.71:0/3070924403 conn(0x7f6e580721a0 msgr2=0x7f6e580725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:57.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.761+0000 7f6e5d200640 1 -- 172.21.15.71:0/3070924403 shutdown_connections 2024-04-20T21:20:57.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.761+0000 7f6e5d200640 1 -- 172.21.15.71:0/3070924403 wait complete. 2024-04-20T21:20:57.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.763+0000 7f6e5d200640 1 Processor -- start 2024-04-20T21:20:57.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.763+0000 7f6e5d200640 1 -- start start 2024-04-20T21:20:57.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.764+0000 7f6e5d200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e3c003f30 0x7f6e580cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.764+0000 7f6e5d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e581591b0 0x7f6e58157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.764+0000 7f6e5d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e58159610 0x7f6e5814aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.764+0000 7f6e5d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6e580aef10 con 0x7f6e581591b0 2024-04-20T21:20:57.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.764+0000 7f6e5d200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e580b3840 con 0x7f6e58159610 2024-04-20T21:20:57.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.764+0000 7f6e5d200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5815f9a0 con 0x7f6e3c003f30 2024-04-20T21:20:57.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.764+0000 7f6e4ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e581591b0 0x7f6e58157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.764+0000 7f6e4ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e581591b0 0x7f6e58157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41730/0 (socket says 172.21.15.71:41730) 2024-04-20T21:20:57.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.764+0000 7f6e4ea00640 1 -- 172.21.15.71:0/4172525896 learned_addr learned my addr 172.21.15.71:0/4172525896 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.765+0000 7f6e57400640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e3c003f30 0x7f6e580cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.765+0000 7f6e57e00640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e58159610 0x7f6e5814aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.765+0000 7f6e4ea00640 1 -- 172.21.15.71:0/4172525896 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e3c003f30 msgr2=0x7f6e580cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.765+0000 7f6e4ea00640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e3c003f30 0x7f6e580cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.765+0000 7f6e4ea00640 1 -- 172.21.15.71:0/4172525896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e58159610 msgr2=0x7f6e5814aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.765+0000 7f6e4ea00640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e58159610 0x7f6e5814aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.765+0000 7f6e4ea00640 1 -- 172.21.15.71:0/4172525896 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e58159ca0 con 0x7f6e581591b0 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.765+0000 7f6e4ea00640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e581591b0 0x7f6e58157070 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6e40001970 tx=0x7f6e5806e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.766+0000 7f6e4fe00640 1 -- 172.21.15.71:0/4172525896 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40001c80 con 0x7f6e581591b0 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.766+0000 7f6e4fe00640 1 -- 172.21.15.71:0/4172525896 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e40004bf0 con 0x7f6e581591b0 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.766+0000 7f6e4fe00640 1 -- 172.21.15.71:0/4172525896 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40007070 con 0x7f6e581591b0 2024-04-20T21:20:57.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.766+0000 7f6e5d200640 1 -- 172.21.15.71:0/4172525896 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e58159f80 con 0x7f6e581591b0 2024-04-20T21:20:57.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.766+0000 7f6e5d200640 1 -- 172.21.15.71:0/4172525896 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e580cd9d0 con 0x7f6e581591b0 2024-04-20T21:20:57.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.767+0000 7f6e5d200640 1 -- 172.21.15.71:0/4172525896 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e58075b30 con 0x7f6e581591b0 2024-04-20T21:20:57.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.768+0000 7f6e4fe00640 1 -- 172.21.15.71:0/4172525896 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e40047020 con 0x7f6e581591b0 2024-04-20T21:20:57.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.769+0000 7f6e4fe00640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6e3406c8f0 0x7f6e3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:57.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.769+0000 7f6e4fe00640 1 -- 172.21.15.71:0/4172525896 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f6e400ad260 con 0x7f6e581591b0 2024-04-20T21:20:57.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.769+0000 7f6e57400640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6e3406c8f0 0x7f6e3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:57.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.770+0000 7f6e57400640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6e3406c8f0 0x7f6e3406edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6e480099c0 tx=0x7f6e48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:57.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.773+0000 7f6e4fe00640 1 -- 172.21.15.71:0/4172525896 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6e4007b260 con 0x7f6e581591b0 2024-04-20T21:20:57.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.974+0000 7f6e5d200640 1 -- 172.21.15.71:0/4172525896 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6e58161520 con 0x7f6e581591b0 2024-04-20T21:20:57.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.975+0000 7f6e4fe00640 1 -- 172.21.15.71:0/4172525896 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f6e4007ab60 con 0x7f6e581591b0 2024-04-20T21:20:57.975 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:57.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 -- 172.21.15.71:0/4172525896 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6e3406c8f0 msgr2=0x7f6e3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6e3406c8f0 0x7f6e3406edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6e480099c0 tx=0x7f6e48008040 comp rx=0 tx=0).stop 2024-04-20T21:20:57.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 -- 172.21.15.71:0/4172525896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e581591b0 msgr2=0x7f6e58157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:57.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e581591b0 0x7f6e58157070 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6e40001970 tx=0x7f6e5806e110 comp rx=0 tx=0).stop 2024-04-20T21:20:57.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 -- 172.21.15.71:0/4172525896 shutdown_connections 2024-04-20T21:20:57.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6e3406c8f0 0x7f6e3406edb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e58159610 0x7f6e5814aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e581591b0 0x7f6e58157070 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 --2- 172.21.15.71:0/4172525896 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e3c003f30 0x7f6e580cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:57.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 -- 172.21.15.71:0/4172525896 >> 172.21.15.71:0/4172525896 conn(0x7f6e580721a0 msgr2=0x7f6e5806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:57.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 -- 172.21.15.71:0/4172525896 shutdown_connections 2024-04-20T21:20:57.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:57.978+0000 7f6e5d200640 1 -- 172.21.15.71:0/4172525896 wait complete. 2024-04-20T21:20:57.996 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T21:20:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.197+0000 7f7f05600640 1 Processor -- start 2024-04-20T21:20:58.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.197+0000 7f7f05600640 1 -- start start 2024-04-20T21:20:58.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.198+0000 7f7f05600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7f00156c20 0x7f7f0006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.198+0000 7f7f05600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7f0015ca40 0x7f7f000ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.198+0000 7f7f05600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f000ad8e0 0x7f7f000d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.198+0000 7f7f05600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7f00141c60 con 0x7f7f0015ca40 2024-04-20T21:20:58.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.198+0000 7f7f05600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7f0015cf90 con 0x7f7f00156c20 2024-04-20T21:20:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.198+0000 7f7f05600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0015d270 con 0x7f7f000ad8e0 2024-04-20T21:20:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.199+0000 7f7efe000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7f0015ca40 0x7f7f000ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.199+0000 7f7efe000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7f0015ca40 0x7f7f000ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41746/0 (socket says 172.21.15.71:41746) 2024-04-20T21:20:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.199+0000 7f7efe000640 1 -- 172.21.15.71:0/3537613790 learned_addr learned my addr 172.21.15.71:0/3537613790 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.199+0000 7f7efea00640 1 --2- 172.21.15.71:0/3537613790 >> v2:172.21.15.137:3300/0 conn(0x7f7f00156c20 0x7f7f0006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.199+0000 7f7efe000640 1 -- 172.21.15.71:0/3537613790 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f000ad8e0 msgr2=0x7f7f000d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.199+0000 7f7efe000640 1 --2- 172.21.15.71:0/3537613790 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f000ad8e0 0x7f7f000d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.199+0000 7f7efe000640 1 -- 172.21.15.71:0/3537613790 >> v2:172.21.15.137:3300/0 conn(0x7f7f00156c20 msgr2=0x7f7f0006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.199+0000 7f7efe000640 1 --2- 172.21.15.71:0/3537613790 >> v2:172.21.15.137:3300/0 conn(0x7f7f00156c20 0x7f7f0006b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.199+0000 7f7efe000640 1 -- 172.21.15.71:0/3537613790 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0015d550 con 0x7f7f0015ca40 2024-04-20T21:20:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.199+0000 7f7efea00640 1 --2- 172.21.15.71:0/3537613790 >> v2:172.21.15.137:3300/0 conn(0x7f7f00156c20 0x7f7f0006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.200+0000 7f7efe000640 1 --2- 172.21.15.71:0/3537613790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f0015ca40 0x7f7f000ad3a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7f0006fdc0 tx=0x7f7eec02b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c7235100a67187 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.201+0000 7f7efd600640 1 -- 172.21.15.71:0/3537613790 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec035020 con 0x7f7f0015ca40 2024-04-20T21:20:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.201+0000 7f7efd600640 1 -- 172.21.15.71:0/3537613790 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eec031890 con 0x7f7f0015ca40 2024-04-20T21:20:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.201+0000 7f7efd600640 1 -- 172.21.15.71:0/3537613790 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec031c60 con 0x7f7f0015ca40 2024-04-20T21:20:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.201+0000 7f7f05600640 1 -- 172.21.15.71:0/3537613790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f0015ca40 msgr2=0x7f7f000ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.201+0000 7f7f05600640 1 --2- 172.21.15.71:0/3537613790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f0015ca40 0x7f7f000ad3a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7f0006fdc0 tx=0x7f7eec02b930 comp rx=0 tx=0).stop 2024-04-20T21:20:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.202+0000 7f7f05600640 1 -- 172.21.15.71:0/3537613790 shutdown_connections 2024-04-20T21:20:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.202+0000 7f7f05600640 1 --2- 172.21.15.71:0/3537613790 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f000ad8e0 0x7f7f000d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.202+0000 7f7f05600640 1 --2- 172.21.15.71:0/3537613790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f0015ca40 0x7f7f000ad3a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.202+0000 7f7f05600640 1 --2- 172.21.15.71:0/3537613790 >> v2:172.21.15.137:3300/0 conn(0x7f7f00156c20 0x7f7f0006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.202+0000 7f7f05600640 1 -- 172.21.15.71:0/3537613790 >> 172.21.15.71:0/3537613790 conn(0x7f7f000b3350 msgr2=0x7f7f000b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.202+0000 7f7f05600640 1 -- 172.21.15.71:0/3537613790 shutdown_connections 2024-04-20T21:20:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.202+0000 7f7f05600640 1 -- 172.21.15.71:0/3537613790 wait complete. 2024-04-20T21:20:58.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.204+0000 7f7f05600640 1 Processor -- start 2024-04-20T21:20:58.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.204+0000 7f7f05600640 1 -- start start 2024-04-20T21:20:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.205+0000 7f7f05600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000ad8e0 0x7f7f001f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.205+0000 7f7f05600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f00156c20 0x7f7f0006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.205+0000 7f7f05600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f0015ca40 0x7f7f0015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.205+0000 7f7f05600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0006bfc0 con 0x7f7f000ad8e0 2024-04-20T21:20:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.205+0000 7f7f05600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0006be40 con 0x7f7f00156c20 2024-04-20T21:20:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.205+0000 7f7f05600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7f000d08a0 con 0x7f7f0015ca40 2024-04-20T21:20:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.205+0000 7f7efea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000ad8e0 0x7f7f001f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.205+0000 7f7efea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000ad8e0 0x7f7f001f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41758/0 (socket says 172.21.15.71:41758) 2024-04-20T21:20:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.205+0000 7f7efea00640 1 -- 172.21.15.71:0/1084173147 learned_addr learned my addr 172.21.15.71:0/1084173147 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7efea00640 1 -- 172.21.15.71:0/1084173147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f0015ca40 msgr2=0x7f7f0015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7eff400640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f0015ca40 0x7f7f0015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7efe000640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f00156c20 0x7f7f0006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7efea00640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f0015ca40 0x7f7f0015b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7efea00640 1 -- 172.21.15.71:0/1084173147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f00156c20 msgr2=0x7f7f0006dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7efea00640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f00156c20 0x7f7f0006dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7efea00640 1 -- 172.21.15.71:0/1084173147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0015eb10 con 0x7f7f000ad8e0 2024-04-20T21:20:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7eff400640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f0015ca40 0x7f7f0015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7efe000640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f00156c20 0x7f7f0006dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7efea00640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000ad8e0 0x7f7f001f4110 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800cf60 tx=0x7f7ef800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:58.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7ef6a00640 1 -- 172.21.15.71:0/1084173147 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef801a070 con 0x7f7f000ad8e0 2024-04-20T21:20:58.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7ef6a00640 1 -- 172.21.15.71:0/1084173147 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef800d840 con 0x7f7f000ad8e0 2024-04-20T21:20:58.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7ef6a00640 1 -- 172.21.15.71:0/1084173147 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800dc10 con 0x7f7f000ad8e0 2024-04-20T21:20:58.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.206+0000 7f7f05600640 1 -- 172.21.15.71:0/1084173147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f00073380 con 0x7f7f000ad8e0 2024-04-20T21:20:58.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.207+0000 7f7f05600640 1 -- 172.21.15.71:0/1084173147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f001f4650 con 0x7f7f000ad8e0 2024-04-20T21:20:58.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.208+0000 7f7f05600640 1 -- 172.21.15.71:0/1084173147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f00068980 con 0x7f7f000ad8e0 2024-04-20T21:20:58.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.209+0000 7f7ef6a00640 1 -- 172.21.15.71:0/1084173147 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ef801d070 con 0x7f7f000ad8e0 2024-04-20T21:20:58.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.210+0000 7f7ef6a00640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ee006c8f0 0x7f7ee006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.210+0000 7f7ef6a00640 1 -- 172.21.15.71:0/1084173147 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f7ef808c6e0 con 0x7f7f000ad8e0 2024-04-20T21:20:58.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.211+0000 7f7efe000640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ee006c8f0 0x7f7ee006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.211+0000 7f7efe000640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ee006c8f0 0x7f7ee006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7eec036000 tx=0x7f7eec008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:58.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.215+0000 7f7ef6a00640 1 -- 172.21.15.71:0/1084173147 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7ef805a130 con 0x7f7f000ad8e0 2024-04-20T21:20:58.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.414+0000 7f7f05600640 1 -- 172.21.15.71:0/1084173147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7f000cfd90 con 0x7f7f000ad8e0 2024-04-20T21:20:58.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.415+0000 7f7ef6a00640 1 -- 172.21.15.71:0/1084173147 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f7ef805e430 con 0x7f7f000ad8e0 2024-04-20T21:20:58.415 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2024-04-20T21:20:58.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 -- 172.21.15.71:0/1084173147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ee006c8f0 msgr2=0x7f7ee006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ee006c8f0 0x7f7ee006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7eec036000 tx=0x7f7eec008030 comp rx=0 tx=0).stop 2024-04-20T21:20:58.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 -- 172.21.15.71:0/1084173147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000ad8e0 msgr2=0x7f7f001f4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000ad8e0 0x7f7f001f4110 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800cf60 tx=0x7f7ef800cf90 comp rx=0 tx=0).stop 2024-04-20T21:20:58.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 -- 172.21.15.71:0/1084173147 shutdown_connections 2024-04-20T21:20:58.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ee006c8f0 0x7f7ee006edb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f0015ca40 0x7f7f0015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f00156c20 0x7f7f0006dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 --2- 172.21.15.71:0/1084173147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000ad8e0 0x7f7f001f4110 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 -- 172.21.15.71:0/1084173147 >> 172.21.15.71:0/1084173147 conn(0x7f7f000b3350 msgr2=0x7f7f0015f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:58.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 -- 172.21.15.71:0/1084173147 shutdown_connections 2024-04-20T21:20:58.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.418+0000 7f7f05600640 1 -- 172.21.15.71:0/1084173147 wait complete. 2024-04-20T21:20:58.438 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T21:20:58.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.640+0000 7fe9f8200640 1 Processor -- start 2024-04-20T21:20:58.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.640+0000 7fe9f8200640 1 -- start start 2024-04-20T21:20:58.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.641+0000 7fe9f8200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f0156c20 0x7fe9f006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.641+0000 7fe9f8200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f0141c60 con 0x7fe9f015ca40 2024-04-20T21:20:58.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.641+0000 7fe9f8200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f00adab0 con 0x7fe9f00d0360 2024-04-20T21:20:58.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.641+0000 7fe9f8200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f015cf90 con 0x7fe9f0156c20 2024-04-20T21:20:58.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.642+0000 7fe9f4e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe9f015ca40 0x7fe9f00ad3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37108/0 (socket says 172.21.15.71:37108) 2024-04-20T21:20:58.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.642+0000 7fe9f4e00640 1 -- 172.21.15.71:0/273093664 learned_addr learned my addr 172.21.15.71:0/273093664 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:58.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.642+0000 7fe9f5800640 1 --2- 172.21.15.71:0/273093664 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f0156c20 0x7fe9f006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.642+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2930892818 0 0) 0x7fe9f0141c60 con 0x7fe9f015ca40 2024-04-20T21:20:58.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.642+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9d8003520 con 0x7fe9f015ca40 2024-04-20T21:20:58.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1964668876 0 0) 0x7fe9d8003520 con 0x7fe9f015ca40 2024-04-20T21:20:58.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f0156c20 msgr2=0x7fe9f006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 --2- 172.21.15.71:0/273093664 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f0156c20 0x7fe9f006b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 >> v1:172.21.15.137:6789/0 conn(0x7fe9f00d0360 legacy=0x7fe9f0142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f015d270 con 0x7fe9f015ca40 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fe9dc001670 con 0x7fe9f015ca40 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 >> v1:172.21.15.71:6789/0 conn(0x7fe9f015ca40 legacy=0x7fe9f00ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 --2- 172.21.15.71:0/273093664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d80039e0 0x7fe9d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 --2- 172.21.15.71:0/273093664 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f0156c20 0x7fe9d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 --2- 172.21.15.71:0/273093664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8004d40 0x7fe9d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f015cf90 con 0x7fe9d8004d40 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d800ba70 con 0x7fe9d80039e0 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d800bc70 con 0x7fe9f0156c20 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9f6200640 1 --2- 172.21.15.71:0/273093664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8004d40 0x7fe9d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.643+0000 7fe9f5800640 1 --2- 172.21.15.71:0/273093664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d80039e0 0x7fe9d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.644+0000 7fe9f6200640 1 -- 172.21.15.71:0/273093664 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f0156c20 msgr2=0x7fe9d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.644+0000 7fe9f6200640 1 --2- 172.21.15.71:0/273093664 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f0156c20 0x7fe9d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.644+0000 7fe9f6200640 1 -- 172.21.15.71:0/273093664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d80039e0 msgr2=0x7fe9d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:58.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.644+0000 7fe9f6200640 1 --2- 172.21.15.71:0/273093664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d80039e0 0x7fe9d8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.644+0000 7fe9f6200640 1 -- 172.21.15.71:0/273093664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d8003520 con 0x7fe9d8004d40 2024-04-20T21:20:58.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.645+0000 7fe9f6200640 1 --2- 172.21.15.71:0/273093664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8004d40 0x7fe9d80051c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8001e20 tx=0x7fe9d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1717a94dcccdd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:58.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.645+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8001a70 con 0x7fe9d8004d40 2024-04-20T21:20:58.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.645+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e8003b70 con 0x7fe9d8004d40 2024-04-20T21:20:58.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.645+0000 7fe9efe00640 1 -- 172.21.15.71:0/273093664 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80050d0 con 0x7fe9d8004d40 2024-04-20T21:20:58.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.646+0000 7fe9f8200640 1 -- 172.21.15.71:0/273093664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8004d40 msgr2=0x7fe9d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.646+0000 7fe9f8200640 1 --2- 172.21.15.71:0/273093664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8004d40 0x7fe9d80051c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8001e20 tx=0x7fe9d8005830 comp rx=0 tx=0).stop 2024-04-20T21:20:58.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.646+0000 7fe9f6200640 1 -- 172.21.15.71:0/273093664 reap_dead start 2024-04-20T21:20:58.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.646+0000 7fe9f8200640 1 -- 172.21.15.71:0/273093664 shutdown_connections 2024-04-20T21:20:58.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.646+0000 7fe9f8200640 1 -- 172.21.15.71:0/273093664 >> 172.21.15.71:0/273093664 conn(0x7fe9f00b3350 msgr2=0x7fe9f00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:58.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.646+0000 7fe9f8200640 1 -- 172.21.15.71:0/273093664 shutdown_connections 2024-04-20T21:20:58.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.646+0000 7fe9f8200640 1 -- 172.21.15.71:0/273093664 wait complete. 2024-04-20T21:20:58.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.648+0000 7fe9f8200640 1 Processor -- start 2024-04-20T21:20:58.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.648+0000 7fe9f8200640 1 -- start start 2024-04-20T21:20:58.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.649+0000 7fe9f8200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d8004d40 0x7fe9f01f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.649+0000 7fe9f8200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f00b1ff0 0x7fe9f00b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.649+0000 7fe9f8200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f015db70 0x7fe9f015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.649+0000 7fe9f8200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f0142850 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.649+0000 7fe9f8200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f015d830 con 0x7fe9d8004d40 2024-04-20T21:20:58.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.649+0000 7fe9f8200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f01429d0 con 0x7fe9f015db70 2024-04-20T21:20:58.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.649+0000 7fe9f4e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f00b1ff0 0x7fe9f00b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.649+0000 7fe9f4e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f00b1ff0 0x7fe9f00b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41774/0 (socket says 172.21.15.71:41774) 2024-04-20T21:20:58.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.650+0000 7fe9f4e00640 1 -- 172.21.15.71:0/473599234 learned_addr learned my addr 172.21.15.71:0/473599234 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:58.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.650+0000 7fe9f5800640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d8004d40 0x7fe9f01f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.650+0000 7fe9f6200640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f015db70 0x7fe9f015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.650+0000 7fe9f4e00640 1 -- 172.21.15.71:0/473599234 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f015db70 msgr2=0x7fe9f015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.650+0000 7fe9f4e00640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f015db70 0x7fe9f015dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.650+0000 7fe9f4e00640 1 -- 172.21.15.71:0/473599234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d8004d40 msgr2=0x7fe9f01f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.650+0000 7fe9f4e00640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d8004d40 0x7fe9f01f4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.650+0000 7fe9f4e00640 1 -- 172.21.15.71:0/473599234 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f00b2bb0 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.650+0000 7fe9f4e00640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f00b1ff0 0x7fe9f00b2470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00c7a0 tx=0x7fe9dc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:58.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.651+0000 7fe9ed600640 1 -- 172.21.15.71:0/473599234 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc018070 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.651+0000 7fe9ed600640 1 -- 172.21.15.71:0/473599234 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9dc0074e0 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.651+0000 7fe9ed600640 1 -- 172.21.15.71:0/473599234 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc004a20 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.651+0000 7fe9f8200640 1 -- 172.21.15.71:0/473599234 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f00aff70 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.651+0000 7fe9f8200640 1 -- 172.21.15.71:0/473599234 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f00ccf20 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.652+0000 7fe9f8200640 1 -- 172.21.15.71:0/473599234 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f0068980 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.653+0000 7fe9ed600640 1 -- 172.21.15.71:0/473599234 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9dc004bc0 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.654+0000 7fe9ed600640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe9d006c920 0x7fe9d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:58.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.654+0000 7fe9ed600640 1 -- 172.21.15.71:0/473599234 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fe9dc08b520 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.654+0000 7fe9f5800640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe9d006c920 0x7fe9d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:58.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.655+0000 7fe9f5800640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe9d006c920 0x7fe9d006ede0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40099f0 tx=0x7fe9e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:58.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.658+0000 7fe9ed600640 1 -- 172.21.15.71:0/473599234 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe9dc059490 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.858+0000 7fe9f8200640 1 -- 172.21.15.71:0/473599234 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe9f00cfd90 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.859+0000 7fe9ed600640 1 -- 172.21.15.71:0/473599234 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fe9dc058d90 con 0x7fe9f00b1ff0 2024-04-20T21:20:58.859 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2024-04-20T21:20:58.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.861+0000 7fe9f8200640 1 -- 172.21.15.71:0/473599234 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe9d006c920 msgr2=0x7fe9d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.861+0000 7fe9f8200640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe9d006c920 0x7fe9d006ede0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40099f0 tx=0x7fe9e4008040 comp rx=0 tx=0).stop 2024-04-20T21:20:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.861+0000 7fe9f8200640 1 -- 172.21.15.71:0/473599234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f00b1ff0 msgr2=0x7fe9f00b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.861+0000 7fe9f8200640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f00b1ff0 0x7fe9f00b2470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00c7a0 tx=0x7fe9dc00cc60 comp rx=0 tx=0).stop 2024-04-20T21:20:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.862+0000 7fe9f8200640 1 -- 172.21.15.71:0/473599234 shutdown_connections 2024-04-20T21:20:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.862+0000 7fe9f8200640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe9d006c920 0x7fe9d006ede0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.862+0000 7fe9f8200640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9f015db70 0x7fe9f015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.862+0000 7fe9f8200640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f00b1ff0 0x7fe9f00b2470 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.862+0000 7fe9f8200640 1 --2- 172.21.15.71:0/473599234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d8004d40 0x7fe9f01f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.862+0000 7fe9f8200640 1 -- 172.21.15.71:0/473599234 >> 172.21.15.71:0/473599234 conn(0x7fe9f00b3350 msgr2=0x7fe9f0155990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.862+0000 7fe9f8200640 1 -- 172.21.15.71:0/473599234 shutdown_connections 2024-04-20T21:20:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:58.862+0000 7fe9f8200640 1 -- 172.21.15.71:0/473599234 wait complete. 2024-04-20T21:20:58.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:20:59.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.079+0000 7ff5aa200640 1 Processor -- start 2024-04-20T21:20:59.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.079+0000 7ff5aa200640 1 -- start start 2024-04-20T21:20:59.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.080+0000 7ff5aa200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff5a415ca40 0x7ff5a40ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.080+0000 7ff5aa200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5a40ad8e0 0x7ff5a40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.080+0000 7ff5aa200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a4141c60 con 0x7ff5a4156c20 2024-04-20T21:20:59.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.080+0000 7ff5aa200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff5a406c010 con 0x7ff5a415ca40 2024-04-20T21:20:59.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.080+0000 7ff5aa200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a415cf90 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.081+0000 7ff5a3400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff5a4156c20 0x7ff5a406b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37116/0 (socket says 172.21.15.71:37116) 2024-04-20T21:20:59.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.081+0000 7ff5a3400640 1 -- 172.21.15.71:0/1901715861 learned_addr learned my addr 172.21.15.71:0/1901715861 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:59.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.081+0000 7ff59be00640 1 --2- 172.21.15.71:0/1901715861 >> v2:172.21.15.71:3300/0 conn(0x7ff5a415ca40 0x7ff5a40ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.081+0000 7ff5a3e00640 1 --2- 172.21.15.71:0/1901715861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5a40ad8e0 0x7ff5a40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.081+0000 7ff5a2a00640 1 -- 172.21.15.71:0/1901715861 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2252336199 0 0) 0x7ff5a4141c60 con 0x7ff5a4156c20 2024-04-20T21:20:59.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.081+0000 7ff59be00640 1 -- 172.21.15.71:0/1901715861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5a40ad8e0 msgr2=0x7ff5a40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:59.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.081+0000 7ff59be00640 1 --2- 172.21.15.71:0/1901715861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5a40ad8e0 0x7ff5a40d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.081+0000 7ff59be00640 1 -- 172.21.15.71:0/1901715861 >> v1:172.21.15.71:6789/0 conn(0x7ff5a4156c20 legacy=0x7ff5a406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.082+0000 7ff59be00640 1 -- 172.21.15.71:0/1901715861 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a415d270 con 0x7ff5a415ca40 2024-04-20T21:20:59.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.083+0000 7ff59be00640 1 --2- 172.21.15.71:0/1901715861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a415ca40 0x7ff5a40ad3a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0097a0 tx=0x7ff58c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61e86e943e04a97 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.083+0000 7ff5a2a00640 1 -- 172.21.15.71:0/1901715861 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c035020 con 0x7ff5a415ca40 2024-04-20T21:20:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.083+0000 7ff5a2a00640 1 -- 172.21.15.71:0/1901715861 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58c031830 con 0x7ff5a415ca40 2024-04-20T21:20:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.083+0000 7ff5a2a00640 1 -- 172.21.15.71:0/1901715861 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c031c00 con 0x7ff5a415ca40 2024-04-20T21:20:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.083+0000 7ff5aa200640 1 -- 172.21.15.71:0/1901715861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a415ca40 msgr2=0x7ff5a40ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.083+0000 7ff5aa200640 1 --2- 172.21.15.71:0/1901715861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a415ca40 0x7ff5a40ad3a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0097a0 tx=0x7ff58c02b8d0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.084+0000 7ff5aa200640 1 -- 172.21.15.71:0/1901715861 shutdown_connections 2024-04-20T21:20:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.084+0000 7ff5aa200640 1 --2- 172.21.15.71:0/1901715861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5a40ad8e0 0x7ff5a40d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.084+0000 7ff5aa200640 1 --2- 172.21.15.71:0/1901715861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a415ca40 0x7ff5a40ad3a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.084+0000 7ff5aa200640 1 -- 172.21.15.71:0/1901715861 >> 172.21.15.71:0/1901715861 conn(0x7ff5a40b3350 msgr2=0x7ff5a40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.084+0000 7ff5aa200640 1 -- 172.21.15.71:0/1901715861 shutdown_connections 2024-04-20T21:20:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.084+0000 7ff5aa200640 1 -- 172.21.15.71:0/1901715861 wait complete. 2024-04-20T21:20:59.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.085+0000 7ff5aa200640 1 Processor -- start 2024-04-20T21:20:59.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.086+0000 7ff5aa200640 1 -- start start 2024-04-20T21:20:59.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.086+0000 7ff5aa200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a40ad8e0 0x7ff5a415b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.086+0000 7ff5aa200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5a4156c20 0x7ff5a415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.086+0000 7ff5aa200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415ca40 0x7ff5a40cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.086+0000 7ff5aa200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a40d08a0 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.086+0000 7ff5aa200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a415d830 con 0x7ff5a415ca40 2024-04-20T21:20:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.086+0000 7ff5aa200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a40d0a20 con 0x7ff5a4156c20 2024-04-20T21:20:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.087+0000 7ff5a3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a40ad8e0 0x7ff5a415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.087+0000 7ff5a3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a40ad8e0 0x7ff5a415b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41796/0 (socket says 172.21.15.71:41796) 2024-04-20T21:20:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.087+0000 7ff5a3400640 1 -- 172.21.15.71:0/3307619158 learned_addr learned my addr 172.21.15.71:0/3307619158 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.087+0000 7ff59be00640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5a4156c20 0x7ff5a415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.087+0000 7ff5a3e00640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415ca40 0x7ff5a40cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.087+0000 7ff5a3400640 1 -- 172.21.15.71:0/3307619158 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5a4156c20 msgr2=0x7ff5a415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.087+0000 7ff5a3400640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5a4156c20 0x7ff5a415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.087+0000 7ff5a3400640 1 -- 172.21.15.71:0/3307619158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415ca40 msgr2=0x7ff5a40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.087+0000 7ff5a3400640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415ca40 0x7ff5a40cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.087+0000 7ff5a3400640 1 -- 172.21.15.71:0/3307619158 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a406ec70 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.088+0000 7ff5a3400640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a40ad8e0 0x7ff5a415b410 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c4d0 tx=0x7ff59400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.088+0000 7ff59b400640 1 -- 172.21.15.71:0/3307619158 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594018070 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.088+0000 7ff59b400640 1 -- 172.21.15.71:0/3307619158 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff594007500 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.088+0000 7ff5aa200640 1 -- 172.21.15.71:0/3307619158 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a406ef50 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.088+0000 7ff59b400640 1 -- 172.21.15.71:0/3307619158 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594004a20 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.088+0000 7ff5aa200640 1 -- 172.21.15.71:0/3307619158 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a406f510 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.089+0000 7ff5aa200640 1 -- 172.21.15.71:0/3307619158 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a4068980 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.091+0000 7ff59b400640 1 -- 172.21.15.71:0/3307619158 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff59401b070 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.092+0000 7ff59b400640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff58006c920 0x7ff58006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.092+0000 7ff59b400640 1 -- 172.21.15.71:0/3307619158 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ff59408b2e0 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.092+0000 7ff59be00640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff58006c920 0x7ff58006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.093+0000 7ff59be00640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff58006c920 0x7ff58006ede0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff58c036000 tx=0x7ff58c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:59.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.096+0000 7ff59b400640 1 -- 172.21.15.71:0/3307619158 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff5940592e0 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.343+0000 7ff5aa200640 1 -- 172.21.15.71:0/3307619158 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5a40cfd90 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.345+0000 7ff59b400640 1 -- 172.21.15.71:0/3307619158 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5201 (secure 0 0 0) 0x7ff594058be0 con 0x7ff5a40ad8e0 2024-04-20T21:20:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:59.345 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3502151495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3502151495},{"type":"v1","addr":"172.21.15.137:6833","nonce":3502151495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2603023903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2603023903},{"type":"v1","addr":"172.21.15.137:6835","nonce":2603023903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3246613850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3246613850},{"type":"v1","addr":"172.21.15.71:6835","nonce":3246613850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:19:28.763862+0000","modified":"2024-04-20T21:19:51.195122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/4085222328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":4085222328},{"type":"v1","addr":"172.21.15.71:6837","nonce":4085222328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-20T21:20:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2024-04-20T21:20:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.348+0000 7ff5aa200640 1 -- 172.21.15.71:0/3307619158 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff58006c920 msgr2=0x7ff58006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.348+0000 7ff5aa200640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff58006c920 0x7ff58006ede0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff58c036000 tx=0x7ff58c008030 comp rx=0 tx=0).stop 2024-04-20T21:20:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.348+0000 7ff5aa200640 1 -- 172.21.15.71:0/3307619158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a40ad8e0 msgr2=0x7ff5a415b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.348+0000 7ff5aa200640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a40ad8e0 0x7ff5a415b410 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c4d0 tx=0x7ff59400c990 comp rx=0 tx=0).stop 2024-04-20T21:20:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.348+0000 7ff5aa200640 1 -- 172.21.15.71:0/3307619158 shutdown_connections 2024-04-20T21:20:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.348+0000 7ff5aa200640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff58006c920 0x7ff58006ede0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.348+0000 7ff5aa200640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415ca40 0x7ff5a40cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.348+0000 7ff5aa200640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5a4156c20 0x7ff5a415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.348+0000 7ff5aa200640 1 --2- 172.21.15.71:0/3307619158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a40ad8e0 0x7ff5a415b410 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.348+0000 7ff5aa200640 1 -- 172.21.15.71:0/3307619158 >> 172.21.15.71:0/3307619158 conn(0x7ff5a40b3350 msgr2=0x7ff5a415db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.348+0000 7ff5aa200640 1 -- 172.21.15.71:0/3307619158 shutdown_connections 2024-04-20T21:20:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.349+0000 7ff5aa200640 1 -- 172.21.15.71:0/3307619158 wait complete. 2024-04-20T21:20:59.367 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:20:59.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.556+0000 7ff2e7200640 1 Processor -- start 2024-04-20T21:20:59.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.556+0000 7ff2e7200640 1 -- start start 2024-04-20T21:20:59.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.558+0000 7ff2e7200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2e8072190 0x7ff2e80735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.558+0000 7ff2e7200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e815cc90 con 0x7ff2e8159e10 2024-04-20T21:20:59.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.558+0000 7ff2e7200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e815cf70 con 0x7ff2e815a1f0 2024-04-20T21:20:59.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.558+0000 7ff2e7200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff2e8072900 con 0x7ff2e8072190 2024-04-20T21:20:59.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.558+0000 7ff2e6800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2e8072190 0x7ff2e80735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.558+0000 7ff2e5e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff2e8159e10 0x7ff2e8071a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37126/0 (socket says 172.21.15.71:37126) 2024-04-20T21:20:59.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.558+0000 7ff2e6800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2e8072190 0x7ff2e80735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41802/0 (socket says 172.21.15.71:41802) 2024-04-20T21:20:59.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.558+0000 7ff2e5e00640 1 -- 172.21.15.71:0/1185937984 learned_addr learned my addr 172.21.15.71:0/1185937984 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:59.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.558+0000 7ff2e6800640 1 -- 172.21.15.71:0/1185937984 >> v1:172.21.15.137:6789/0 conn(0x7ff2e815a1f0 legacy=0x7ff2e8072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:20:59.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.559+0000 7ff2e6800640 1 -- 172.21.15.71:0/1185937984 >> v1:172.21.15.71:6789/0 conn(0x7ff2e8159e10 legacy=0x7ff2e8071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.559+0000 7ff2e6800640 1 -- 172.21.15.71:0/1185937984 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e815d250 con 0x7ff2e8072190 2024-04-20T21:20:59.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.559+0000 7ff2e4a00640 1 -- 172.21.15.71:0/1185937984 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534154248 0 0) 0x7ff2e815cc90 con 0x7ff2e8159e10 2024-04-20T21:20:59.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.560+0000 7ff2e6800640 1 --2- 172.21.15.71:0/1185937984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e8072190 0x7ff2e80735f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009d90 tx=0x7ff2e002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b296b99ec09359e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:59.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.560+0000 7ff2e4a00640 1 -- 172.21.15.71:0/1185937984 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0039070 con 0x7ff2e8072190 2024-04-20T21:20:59.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.560+0000 7ff2e4a00640 1 -- 172.21.15.71:0/1185937984 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e002cc60 con 0x7ff2e8072190 2024-04-20T21:20:59.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.560+0000 7ff2e4a00640 1 -- 172.21.15.71:0/1185937984 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0034660 con 0x7ff2e8072190 2024-04-20T21:20:59.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.560+0000 7ff2e7200640 1 -- 172.21.15.71:0/1185937984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e8072190 msgr2=0x7ff2e80735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.560+0000 7ff2e7200640 1 --2- 172.21.15.71:0/1185937984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e8072190 0x7ff2e80735f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009d90 tx=0x7ff2e002beb0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.561+0000 7ff2e7200640 1 -- 172.21.15.71:0/1185937984 shutdown_connections 2024-04-20T21:20:59.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.561+0000 7ff2e7200640 1 --2- 172.21.15.71:0/1185937984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e8072190 0x7ff2e80735f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.561+0000 7ff2e7200640 1 -- 172.21.15.71:0/1185937984 >> 172.21.15.71:0/1185937984 conn(0x7ff2e80d0040 msgr2=0x7ff2e80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:59.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.561+0000 7ff2e7200640 1 -- 172.21.15.71:0/1185937984 shutdown_connections 2024-04-20T21:20:59.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.561+0000 7ff2e7200640 1 -- 172.21.15.71:0/1185937984 wait complete. 2024-04-20T21:20:59.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.562+0000 7ff2e7200640 1 Processor -- start 2024-04-20T21:20:59.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.562+0000 7ff2e7200640 1 -- start start 2024-04-20T21:20:59.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.563+0000 7ff2e7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e8072190 0x7ff2e8156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.563+0000 7ff2e7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2e8159e10 0x7ff2e809afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.563+0000 7ff2e7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e815a1f0 0x7ff2e815e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.563+0000 7ff2e7200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e815d810 con 0x7ff2e815a1f0 2024-04-20T21:20:59.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.563+0000 7ff2e7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e815ca40 con 0x7ff2e8072190 2024-04-20T21:20:59.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.563+0000 7ff2e7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e8073b30 con 0x7ff2e8159e10 2024-04-20T21:20:59.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e815a1f0 0x7ff2e815e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e815a1f0 0x7ff2e815e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41804/0 (socket says 172.21.15.71:41804) 2024-04-20T21:20:59.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e6800640 1 -- 172.21.15.71:0/4182428296 learned_addr learned my addr 172.21.15.71:0/4182428296 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:59.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e5e00640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e8072190 0x7ff2e8156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e5400640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2e8159e10 0x7ff2e809afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e6800640 1 -- 172.21.15.71:0/4182428296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2e8159e10 msgr2=0x7ff2e809afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e6800640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2e8159e10 0x7ff2e809afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e6800640 1 -- 172.21.15.71:0/4182428296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e8072190 msgr2=0x7ff2e8156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e6800640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e8072190 0x7ff2e8156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e6800640 1 -- 172.21.15.71:0/4182428296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e80c99d0 con 0x7ff2e815a1f0 2024-04-20T21:20:59.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e5400640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2e8159e10 0x7ff2e809afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:20:59.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.564+0000 7ff2e6800640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e815a1f0 0x7ff2e815e340 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009d90 tx=0x7ff2e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:59.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.565+0000 7ff2de000640 1 -- 172.21.15.71:0/4182428296 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0044020 con 0x7ff2e815a1f0 2024-04-20T21:20:59.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.565+0000 7ff2de000640 1 -- 172.21.15.71:0/4182428296 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e003f470 con 0x7ff2e815a1f0 2024-04-20T21:20:59.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.565+0000 7ff2e7200640 1 -- 172.21.15.71:0/4182428296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e80c9cb0 con 0x7ff2e815a1f0 2024-04-20T21:20:59.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.565+0000 7ff2de000640 1 -- 172.21.15.71:0/4182428296 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0039040 con 0x7ff2e815a1f0 2024-04-20T21:20:59.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.565+0000 7ff2e7200640 1 -- 172.21.15.71:0/4182428296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e80ca270 con 0x7ff2e815a1f0 2024-04-20T21:20:59.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.566+0000 7ff2e7200640 1 -- 172.21.15.71:0/4182428296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e80cc460 con 0x7ff2e815a1f0 2024-04-20T21:20:59.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.567+0000 7ff2de000640 1 -- 172.21.15.71:0/4182428296 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2e0047020 con 0x7ff2e815a1f0 2024-04-20T21:20:59.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.568+0000 7ff2de000640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff2c406c8f0 0x7ff2c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.568+0000 7ff2de000640 1 -- 172.21.15.71:0/4182428296 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ff2e00aeb10 con 0x7ff2e815a1f0 2024-04-20T21:20:59.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.568+0000 7ff2e5e00640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff2c406c8f0 0x7ff2c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.569+0000 7ff2e5e00640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff2c406c8f0 0x7ff2c406edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0000f60 tx=0x7ff2d0007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:59.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.572+0000 7ff2de000640 1 -- 172.21.15.71:0/4182428296 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff2e80cc460 con 0x7ff2e815a1f0 2024-04-20T21:20:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.759+0000 7ff2e7200640 1 -- 172.21.15.71:0/4182428296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2e8071e90 con 0x7ff2e815a1f0 2024-04-20T21:20:59.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.761+0000 7ff2de000640 1 -- 172.21.15.71:0/4182428296 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7ff2e004e030 con 0x7ff2e815a1f0 2024-04-20T21:20:59.762 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:20:59.762 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:20:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 -- 172.21.15.71:0/4182428296 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff2c406c8f0 msgr2=0x7ff2c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff2c406c8f0 0x7ff2c406edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0000f60 tx=0x7ff2d0007b50 comp rx=0 tx=0).stop 2024-04-20T21:20:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 -- 172.21.15.71:0/4182428296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e815a1f0 msgr2=0x7ff2e815e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e815a1f0 0x7ff2e815e340 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009d90 tx=0x7ff2e0004a40 comp rx=0 tx=0).stop 2024-04-20T21:20:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 -- 172.21.15.71:0/4182428296 shutdown_connections 2024-04-20T21:20:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff2c406c8f0 0x7ff2c406edb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e815a1f0 0x7ff2e815e340 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2e8159e10 0x7ff2e809afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 --2- 172.21.15.71:0/4182428296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e8072190 0x7ff2e8156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 -- 172.21.15.71:0/4182428296 >> 172.21.15.71:0/4182428296 conn(0x7ff2e80d0040 msgr2=0x7ff2e80b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 -- 172.21.15.71:0/4182428296 shutdown_connections 2024-04-20T21:20:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.764+0000 7ff2e7200640 1 -- 172.21.15.71:0/4182428296 wait complete. 2024-04-20T21:20:59.782 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-20T21:20:59.782 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:20:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.980+0000 7fe92be00640 1 Processor -- start 2024-04-20T21:20:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.980+0000 7fe92be00640 1 -- start start 2024-04-20T21:20:59.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.982+0000 7fe92be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe92c0b2f70 0x7fe92c0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.982+0000 7fe92be00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92c071a80 con 0x7fe92c06b900 2024-04-20T21:20:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.982+0000 7fe92be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92c0ae3f0 con 0x7fe92c0adf60 2024-04-20T21:20:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.982+0000 7fe92be00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe92c071cf0 con 0x7fe92c0b2f70 2024-04-20T21:20:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.982+0000 7fe92b400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe92c06b900 0x7fe92c06bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37130/0 (socket says 172.21.15.71:37130) 2024-04-20T21:20:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.982+0000 7fe92b400640 1 -- 172.21.15.71:0/2775669666 learned_addr learned my addr 172.21.15.71:0/2775669666 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:20:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.982+0000 7fe92aa00640 1 --2- 172.21.15.71:0/2775669666 >> v2:172.21.15.71:3300/0 conn(0x7fe92c0b2f70 0x7fe92c0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.983+0000 7fe929600640 1 -- 172.21.15.71:0/2775669666 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777776671 0 0) 0x7fe92c071a80 con 0x7fe92c06b900 2024-04-20T21:20:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.983+0000 7fe929600640 1 -- 172.21.15.71:0/2775669666 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe910003520 con 0x7fe92c06b900 2024-04-20T21:20:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.983+0000 7fe92aa00640 1 -- 172.21.15.71:0/2775669666 >> v1:172.21.15.137:6789/0 conn(0x7fe92c0adf60 legacy=0x7fe92c15f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.983+0000 7fe92aa00640 1 -- 172.21.15.71:0/2775669666 >> v1:172.21.15.71:6789/0 conn(0x7fe92c06b900 legacy=0x7fe92c06bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.983+0000 7fe92aa00640 1 -- 172.21.15.71:0/2775669666 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c071fd0 con 0x7fe92c0b2f70 2024-04-20T21:20:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.984+0000 7fe92aa00640 1 --2- 172.21.15.71:0/2775669666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe92c0b2f70 0x7fe92c0b4320 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0097a0 tx=0x7fe91c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569e28f378add055 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.984+0000 7fe929600640 1 -- 172.21.15.71:0/2775669666 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c034070 con 0x7fe92c0b2f70 2024-04-20T21:20:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.984+0000 7fe929600640 1 -- 172.21.15.71:0/2775669666 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c030610 con 0x7fe92c0b2f70 2024-04-20T21:20:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.984+0000 7fe929600640 1 -- 172.21.15.71:0/2775669666 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0309c0 con 0x7fe92c0b2f70 2024-04-20T21:20:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.985+0000 7fe92be00640 1 -- 172.21.15.71:0/2775669666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe92c0b2f70 msgr2=0x7fe92c0b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.985+0000 7fe92be00640 1 --2- 172.21.15.71:0/2775669666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe92c0b2f70 0x7fe92c0b4320 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0097a0 tx=0x7fe91c02b960 comp rx=0 tx=0).stop 2024-04-20T21:20:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.985+0000 7fe92be00640 1 -- 172.21.15.71:0/2775669666 shutdown_connections 2024-04-20T21:20:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.985+0000 7fe92be00640 1 --2- 172.21.15.71:0/2775669666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe92c0b2f70 0x7fe92c0b4320 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.985+0000 7fe92be00640 1 -- 172.21.15.71:0/2775669666 >> 172.21.15.71:0/2775669666 conn(0x7fe92c0d0040 msgr2=0x7fe92c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:20:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.985+0000 7fe92be00640 1 -- 172.21.15.71:0/2775669666 shutdown_connections 2024-04-20T21:20:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.985+0000 7fe92be00640 1 -- 172.21.15.71:0/2775669666 wait complete. 2024-04-20T21:20:59.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.986+0000 7fe92be00640 1 Processor -- start 2024-04-20T21:20:59.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.987+0000 7fe92be00640 1 -- start start 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.987+0000 7fe92be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe92c06b900 0x7fe92c15e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.987+0000 7fe92be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe92c0adf60 0x7fe92c149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.987+0000 7fe92be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c0b2f70 0x7fe92c1e5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.987+0000 7fe92be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c15fcc0 con 0x7fe92c06b900 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.987+0000 7fe92be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c0736c0 con 0x7fe92c0b2f70 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.987+0000 7fe92be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe92c15fe40 con 0x7fe92c0adf60 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.988+0000 7fe92aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe92c06b900 0x7fe92c15e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.988+0000 7fe92aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe92c06b900 0x7fe92c15e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41818/0 (socket says 172.21.15.71:41818) 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.988+0000 7fe92aa00640 1 -- 172.21.15.71:0/3808990937 learned_addr learned my addr 172.21.15.71:0/3808990937 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.988+0000 7fe92aa00640 1 -- 172.21.15.71:0/3808990937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe92c0adf60 msgr2=0x7fe92c149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.988+0000 7fe92aa00640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe92c0adf60 0x7fe92c149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.988+0000 7fe92aa00640 1 -- 172.21.15.71:0/3808990937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c0b2f70 msgr2=0x7fe92c1e5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:20:59.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.988+0000 7fe92aa00640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c0b2f70 0x7fe92c1e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:20:59.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.988+0000 7fe92aa00640 1 -- 172.21.15.71:0/3808990937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c15d280 con 0x7fe92c06b900 2024-04-20T21:20:59.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.988+0000 7fe92aa00640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe92c06b900 0x7fe92c15e320 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0097a0 tx=0x7fe91c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:59.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.989+0000 7fe923400640 1 -- 172.21.15.71:0/3808990937 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c047070 con 0x7fe92c06b900 2024-04-20T21:20:59.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.989+0000 7fe923400640 1 -- 172.21.15.71:0/3808990937 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c030410 con 0x7fe92c06b900 2024-04-20T21:20:59.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.989+0000 7fe923400640 1 -- 172.21.15.71:0/3808990937 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c034040 con 0x7fe92c06b900 2024-04-20T21:20:59.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.989+0000 7fe92be00640 1 -- 172.21.15.71:0/3808990937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92c15d560 con 0x7fe92c06b900 2024-04-20T21:20:59.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.989+0000 7fe92be00640 1 -- 172.21.15.71:0/3808990937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92c15db20 con 0x7fe92c06b900 2024-04-20T21:20:59.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.990+0000 7fe92be00640 1 -- 172.21.15.71:0/3808990937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe92c075b60 con 0x7fe92c06b900 2024-04-20T21:20:59.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.991+0000 7fe923400640 1 -- 172.21.15.71:0/3808990937 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe91c04a070 con 0x7fe92c06b900 2024-04-20T21:20:59.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.992+0000 7fe923400640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90c06c8f0 0x7fe90c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:20:59.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.992+0000 7fe923400640 1 -- 172.21.15.71:0/3808990937 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fe91c0ad720 con 0x7fe92c06b900 2024-04-20T21:20:59.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.992+0000 7fe92a000640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90c06c8f0 0x7fe90c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:20:59.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.993+0000 7fe92a000640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90c06c8f0 0x7fe90c06edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe918000f60 tx=0x7fe9180079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:20:59.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:20:59.996+0000 7fe923400640 1 -- 172.21.15.71:0/3808990937 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe91c07b0e0 con 0x7fe92c06b900 2024-04-20T21:21:00.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.234+0000 7fe92be00640 1 -- 172.21.15.71:0/3808990937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe92c09d3a0 con 0x7fe92c06b900 2024-04-20T21:21:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.235+0000 7fe923400640 1 -- 172.21.15.71:0/3808990937 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5201 (secure 0 0 0) 0x7fe91c07f3e0 con 0x7fe92c06b900 2024-04-20T21:21:00.316 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:00.317 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3502151495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3502151495},{"type":"v1","addr":"172.21.15.137:6833","nonce":3502151495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2603023903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2603023903},{"type":"v1","addr":"172.21.15.137:6835","nonce":2603023903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3246613850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3246613850},{"type":"v1","addr":"172.21.15.71:6835","nonce":3246613850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:19:28.763862+0000","modified":"2024-04-20T21:19:51.195122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/4085222328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":4085222328},{"type":"v1","addr":"172.21.15.71:6837","nonce":4085222328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-20T21:21:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2024-04-20T21:21:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 -- 172.21.15.71:0/3808990937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90c06c8f0 msgr2=0x7fe90c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90c06c8f0 0x7fe90c06edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe918000f60 tx=0x7fe9180079d0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 -- 172.21.15.71:0/3808990937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe92c06b900 msgr2=0x7fe92c15e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe92c06b900 0x7fe92c15e320 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0097a0 tx=0x7fe91c0046c0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 -- 172.21.15.71:0/3808990937 shutdown_connections 2024-04-20T21:21:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe90c06c8f0 0x7fe90c06edb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c0b2f70 0x7fe92c1e5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe92c0adf60 0x7fe92c149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 --2- 172.21.15.71:0/3808990937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe92c06b900 0x7fe92c15e320 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 -- 172.21.15.71:0/3808990937 >> 172.21.15.71:0/3808990937 conn(0x7fe92c0d0040 msgr2=0x7fe92c06db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 -- 172.21.15.71:0/3808990937 shutdown_connections 2024-04-20T21:21:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.238+0000 7fe92be00640 1 -- 172.21.15.71:0/3808990937 wait complete. 2024-04-20T21:21:00.319 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:21:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.521+0000 7f9d6a200640 1 Processor -- start 2024-04-20T21:21:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.521+0000 7f9d6a200640 1 -- start start 2024-04-20T21:21:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.522+0000 7f9d6a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d64159e10 0x7f9d64071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.523+0000 7f9d6a200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d64160e50 con 0x7f9d6406da90 2024-04-20T21:21:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.523+0000 7f9d6a200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6415cc90 con 0x7f9d6415a1f0 2024-04-20T21:21:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.523+0000 7f9d6a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9d64072900 con 0x7f9d64159e10 2024-04-20T21:21:00.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.523+0000 7f9d69800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9d6406da90 0x7f9d64160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37146/0 (socket says 172.21.15.71:37146) 2024-04-20T21:21:00.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.523+0000 7f9d69800640 1 -- 172.21.15.71:0/2335679203 learned_addr learned my addr 172.21.15.71:0/2335679203 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:00.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.523+0000 7f9d68e00640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d64159e10 0x7f9d64071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.523+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529565560 0 0) 0x7f9d64160e50 con 0x7f9d6406da90 2024-04-20T21:21:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.523+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d48003520 con 0x7f9d6406da90 2024-04-20T21:21:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 939360069 0 0) 0x7f9d48003520 con 0x7f9d6406da90 2024-04-20T21:21:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d64159e10 msgr2=0x7f9d64071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d64159e10 0x7f9d64071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 >> v1:172.21.15.137:6789/0 conn(0x7f9d6415a1f0 legacy=0x7f9d64160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6415cf70 con 0x7f9d6406da90 2024-04-20T21:21:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f9d5c0019f0 con 0x7f9d6406da90 2024-04-20T21:21:00.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 >> v1:172.21.15.71:6789/0 conn(0x7f9d6406da90 legacy=0x7f9d64160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d480039e0 0x7f9d48003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d64159e10 0x7f9d48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d48004d40 0x7f9d480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4800bba0 con 0x7f9d48004d40 2024-04-20T21:21:00.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4800bd20 con 0x7f9d480039e0 2024-04-20T21:21:00.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9d4800bf20 con 0x7f9d64159e10 2024-04-20T21:21:00.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.524+0000 7f9d69800640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d48004d40 0x7f9d480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.525+0000 7f9d68e00640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d480039e0 0x7f9d48003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.525+0000 7f9d5be00640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d64159e10 0x7f9d48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.525+0000 7f9d69800640 1 -- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d64159e10 msgr2=0x7f9d48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:00.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.525+0000 7f9d69800640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d64159e10 0x7f9d48004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.525+0000 7f9d69800640 1 -- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d480039e0 msgr2=0x7f9d48003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:00.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.525+0000 7f9d69800640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d480039e0 0x7f9d48003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.525+0000 7f9d69800640 1 -- 172.21.15.71:0/2335679203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d48003520 con 0x7f9d48004d40 2024-04-20T21:21:00.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.525+0000 7f9d68e00640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d480039e0 0x7f9d48003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:00.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.526+0000 7f9d69800640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d48004d40 0x7f9d480051c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00a790 tx=0x7f9d48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98cf4c86401a6e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:00.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.526+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c00a3b0 con 0x7f9d48004d40 2024-04-20T21:21:00.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.526+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5c034650 con 0x7f9d48004d40 2024-04-20T21:21:00.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.526+0000 7f9d63e00640 1 -- 172.21.15.71:0/2335679203 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c034a40 con 0x7f9d48004d40 2024-04-20T21:21:00.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.526+0000 7f9d6a200640 1 -- 172.21.15.71:0/2335679203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d48004d40 msgr2=0x7f9d480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.526+0000 7f9d6a200640 1 --2- 172.21.15.71:0/2335679203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d48004d40 0x7f9d480051c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00a790 tx=0x7f9d48005830 comp rx=0 tx=0).stop 2024-04-20T21:21:00.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.527+0000 7f9d69800640 1 -- 172.21.15.71:0/2335679203 reap_dead start 2024-04-20T21:21:00.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.527+0000 7f9d6a200640 1 -- 172.21.15.71:0/2335679203 shutdown_connections 2024-04-20T21:21:00.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.527+0000 7f9d6a200640 1 -- 172.21.15.71:0/2335679203 >> 172.21.15.71:0/2335679203 conn(0x7f9d640d0040 msgr2=0x7f9d640d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:00.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.527+0000 7f9d6a200640 1 -- 172.21.15.71:0/2335679203 shutdown_connections 2024-04-20T21:21:00.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.527+0000 7f9d6a200640 1 -- 172.21.15.71:0/2335679203 wait complete. 2024-04-20T21:21:00.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.528+0000 7f9d6a200640 1 Processor -- start 2024-04-20T21:21:00.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.529+0000 7f9d6a200640 1 -- start start 2024-04-20T21:21:00.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d6a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d48004d40 0x7f9d6414dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d6a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d6415ab00 0x7f9d6415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d6a200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6415b590 0x7f9d6415ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d6a200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6415d530 con 0x7f9d6415b590 2024-04-20T21:21:00.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d6a200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6415ca40 con 0x7f9d6415ab00 2024-04-20T21:21:00.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d6a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9d6415d810 con 0x7f9d48004d40 2024-04-20T21:21:00.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d69800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6415b590 0x7f9d6415ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d69800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6415b590 0x7f9d6415ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41840/0 (socket says 172.21.15.71:41840) 2024-04-20T21:21:00.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d69800640 1 -- 172.21.15.71:0/2954893529 learned_addr learned my addr 172.21.15.71:0/2954893529 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:00.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d68e00640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d48004d40 0x7f9d6414dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d69800640 1 -- 172.21.15.71:0/2954893529 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d48004d40 msgr2=0x7f9d6414dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d69800640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d48004d40 0x7f9d6414dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d69800640 1 -- 172.21.15.71:0/2954893529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d6415ab00 msgr2=0x7f9d6415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d69800640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d6415ab00 0x7f9d6415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.530+0000 7f9d69800640 1 -- 172.21.15.71:0/2954893529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6414e200 con 0x7f9d6415b590 2024-04-20T21:21:00.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.531+0000 7f9d69800640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6415b590 0x7f9d6415ba10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00a790 tx=0x7f9d6415ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:00.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.531+0000 7f9d61600640 1 -- 172.21.15.71:0/2954893529 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c001250 con 0x7f9d6415b590 2024-04-20T21:21:00.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.531+0000 7f9d61600640 1 -- 172.21.15.71:0/2954893529 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5c044070 con 0x7f9d6415b590 2024-04-20T21:21:00.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.531+0000 7f9d6a200640 1 -- 172.21.15.71:0/2954893529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d640cada0 con 0x7f9d6415b590 2024-04-20T21:21:00.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.531+0000 7f9d61600640 1 -- 172.21.15.71:0/2954893529 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c034a00 con 0x7f9d6415b590 2024-04-20T21:21:00.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.531+0000 7f9d6a200640 1 -- 172.21.15.71:0/2954893529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d6415dcf0 con 0x7f9d6415b590 2024-04-20T21:21:00.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.532+0000 7f9d6a200640 1 -- 172.21.15.71:0/2954893529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d64075b60 con 0x7f9d6415b590 2024-04-20T21:21:00.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.533+0000 7f9d61600640 1 -- 172.21.15.71:0/2954893529 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d5c034ba0 con 0x7f9d6415b590 2024-04-20T21:21:00.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.534+0000 7f9d61600640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9d4006cac0 0x7f9d4006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.534+0000 7f9d61600640 1 -- 172.21.15.71:0/2954893529 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f9d5c0ae4a0 con 0x7f9d6415b590 2024-04-20T21:21:00.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.534+0000 7f9d68e00640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9d4006cac0 0x7f9d4006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.535+0000 7f9d68e00640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9d4006cac0 0x7f9d4006ef80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9d54006fd0 tx=0x7f9d54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:00.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.539+0000 7f9d61600640 1 -- 172.21.15.71:0/2954893529 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9d5c07c410 con 0x7f9d6415b590 2024-04-20T21:21:00.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.759+0000 7f9d6a200640 1 -- 172.21.15.71:0/2954893529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d640cb2c0 con 0x7f9d6415b590 2024-04-20T21:21:00.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.760+0000 7f9d61600640 1 -- 172.21.15.71:0/2954893529 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5201 (secure 0 0 0) 0x7f9d5c07bd10 con 0x7f9d6415b590 2024-04-20T21:21:00.760 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:00.760 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3502151495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3502151495},{"type":"v1","addr":"172.21.15.137:6833","nonce":3502151495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2603023903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2603023903},{"type":"v1","addr":"172.21.15.137:6835","nonce":2603023903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3246613850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3246613850},{"type":"v1","addr":"172.21.15.71:6835","nonce":3246613850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:19:28.763862+0000","modified":"2024-04-20T21:19:51.195122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/4085222328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":4085222328},{"type":"v1","addr":"172.21.15.71:6837","nonce":4085222328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-20T21:21:00.760 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 -- 172.21.15.71:0/2954893529 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9d4006cac0 msgr2=0x7f9d4006ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9d4006cac0 0x7f9d4006ef80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9d54006fd0 tx=0x7f9d54008040 comp rx=0 tx=0).stop 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 -- 172.21.15.71:0/2954893529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6415b590 msgr2=0x7f9d6415ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6415b590 0x7f9d6415ba10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00a790 tx=0x7f9d6415ce60 comp rx=0 tx=0).stop 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 -- 172.21.15.71:0/2954893529 shutdown_connections 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9d4006cac0 0x7f9d4006ef80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6415b590 0x7f9d6415ba10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d6415ab00 0x7f9d6415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 --2- 172.21.15.71:0/2954893529 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d48004d40 0x7f9d6414dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 -- 172.21.15.71:0/2954893529 >> 172.21.15.71:0/2954893529 conn(0x7f9d640d0040 msgr2=0x7f9d64071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 -- 172.21.15.71:0/2954893529 shutdown_connections 2024-04-20T21:21:00.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.763+0000 7f9d6a200640 1 -- 172.21.15.71:0/2954893529 wait complete. 2024-04-20T21:21:00.781 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:21:00.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.970+0000 7f82bbe00640 1 Processor -- start 2024-04-20T21:21:00.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.970+0000 7f82bbe00640 1 -- start start 2024-04-20T21:21:00.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.972+0000 7f82bbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f82bc161d50 0x7f82bc0d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.972+0000 7f82bbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82bc06cde0 0x7f82bc0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.972+0000 7f82bbe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82bc06c190 con 0x7f82bc0b3330 2024-04-20T21:21:00.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.972+0000 7f82bbe00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f82bc162130 con 0x7f82bc161d50 2024-04-20T21:21:00.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.972+0000 7f82bbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f82bc06c470 con 0x7f82bc06cde0 2024-04-20T21:21:00.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.972+0000 7f82baa00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f82bc161d50 0x7f82bc0d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.972+0000 7f82baa00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f82bc161d50 0x7f82bc0d38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41846/0 (socket says 172.21.15.71:41846) 2024-04-20T21:21:00.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.972+0000 7f82baa00640 1 -- 172.21.15.71:0/3419511088 learned_addr learned my addr 172.21.15.71:0/3419511088 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.973+0000 7f82bb400640 1 --2- 172.21.15.71:0/3419511088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82bc06cde0 0x7f82bc0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.973+0000 7f82baa00640 1 -- 172.21.15.71:0/3419511088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82bc06cde0 msgr2=0x7f82bc0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.973+0000 7f82baa00640 1 --2- 172.21.15.71:0/3419511088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82bc06cde0 0x7f82bc0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.973+0000 7f82baa00640 1 -- 172.21.15.71:0/3419511088 >> v1:172.21.15.137:6789/0 conn(0x7f82bc0b3330 legacy=0x7f82bc06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.973+0000 7f82baa00640 1 -- 172.21.15.71:0/3419511088 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc0d2e00 con 0x7f82bc161d50 2024-04-20T21:21:00.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.973+0000 7f82bb400640 1 --2- 172.21.15.71:0/3419511088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82bc06cde0 0x7f82bc0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:00.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.974+0000 7f82baa00640 1 --2- 172.21.15.71:0/3419511088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82bc161d50 0x7f82bc0d38e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0b6f50 tx=0x7f82ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac920ce71ed4adfa server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:00.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.975+0000 7f82b9600640 1 -- 172.21.15.71:0/3419511088 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac035020 con 0x7f82bc161d50 2024-04-20T21:21:00.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.975+0000 7f82b9600640 1 -- 172.21.15.71:0/3419511088 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ac031830 con 0x7f82bc161d50 2024-04-20T21:21:00.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.975+0000 7f82b9600640 1 -- 172.21.15.71:0/3419511088 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac031c00 con 0x7f82bc161d50 2024-04-20T21:21:00.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.975+0000 7f82bbe00640 1 -- 172.21.15.71:0/3419511088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82bc161d50 msgr2=0x7f82bc0d38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.975+0000 7f82bbe00640 1 --2- 172.21.15.71:0/3419511088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82bc161d50 0x7f82bc0d38e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0b6f50 tx=0x7f82ac02b8d0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.975+0000 7f82bbe00640 1 -- 172.21.15.71:0/3419511088 shutdown_connections 2024-04-20T21:21:00.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.975+0000 7f82bbe00640 1 --2- 172.21.15.71:0/3419511088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82bc06cde0 0x7f82bc0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.975+0000 7f82bbe00640 1 --2- 172.21.15.71:0/3419511088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82bc161d50 0x7f82bc0d38e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.975+0000 7f82bbe00640 1 -- 172.21.15.71:0/3419511088 >> 172.21.15.71:0/3419511088 conn(0x7f82bc0d4450 msgr2=0x7f82bc0d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:00.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.976+0000 7f82bbe00640 1 -- 172.21.15.71:0/3419511088 shutdown_connections 2024-04-20T21:21:00.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.976+0000 7f82bbe00640 1 -- 172.21.15.71:0/3419511088 wait complete. 2024-04-20T21:21:00.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.977+0000 7f82bbe00640 1 Processor -- start 2024-04-20T21:21:00.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.977+0000 7f82bbe00640 1 -- start start 2024-04-20T21:21:00.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.978+0000 7f82bbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82bc06cde0 0x7f82bc0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.978+0000 7f82bbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82bc0b3330 0x7f82bc14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.978+0000 7f82bbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82bc161d50 0x7f82bc0b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.978+0000 7f82bbe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc0b7660 con 0x7f82bc06cde0 2024-04-20T21:21:00.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.978+0000 7f82bbe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc0d33c0 con 0x7f82bc161d50 2024-04-20T21:21:00.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.978+0000 7f82bbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f82bc0b77e0 con 0x7f82bc0b3330 2024-04-20T21:21:00.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.979+0000 7f82baa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82bc06cde0 0x7f82bc0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.979+0000 7f82baa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82bc06cde0 0x7f82bc0c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41852/0 (socket says 172.21.15.71:41852) 2024-04-20T21:21:00.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.979+0000 7f82baa00640 1 -- 172.21.15.71:0/136684736 learned_addr learned my addr 172.21.15.71:0/136684736 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:00.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.979+0000 7f82bb400640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82bc161d50 0x7f82bc0b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.979+0000 7f82ba000640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82bc0b3330 0x7f82bc14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.979+0000 7f82baa00640 1 -- 172.21.15.71:0/136684736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82bc0b3330 msgr2=0x7f82bc14db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.979+0000 7f82baa00640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82bc0b3330 0x7f82bc14db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.979+0000 7f82baa00640 1 -- 172.21.15.71:0/136684736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82bc161d50 msgr2=0x7f82bc0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:00.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.979+0000 7f82baa00640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82bc161d50 0x7f82bc0b4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:00.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.979+0000 7f82baa00640 1 -- 172.21.15.71:0/136684736 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc0c9840 con 0x7f82bc06cde0 2024-04-20T21:21:00.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.979+0000 7f82baa00640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82bc06cde0 0x7f82bc0c8970 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f82ac000c00 tx=0x7f82ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:00.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.980+0000 7f82b2a00640 1 -- 172.21.15.71:0/136684736 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac03a930 con 0x7f82bc06cde0 2024-04-20T21:21:00.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.980+0000 7f82b2a00640 1 -- 172.21.15.71:0/136684736 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ac03aad0 con 0x7f82bc06cde0 2024-04-20T21:21:00.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.980+0000 7f82b2a00640 1 -- 172.21.15.71:0/136684736 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0443f0 con 0x7f82bc06cde0 2024-04-20T21:21:00.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.980+0000 7f82bbe00640 1 -- 172.21.15.71:0/136684736 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82bc0c9b20 con 0x7f82bc06cde0 2024-04-20T21:21:00.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.980+0000 7f82bbe00640 1 -- 172.21.15.71:0/136684736 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82bc0ca0e0 con 0x7f82bc06cde0 2024-04-20T21:21:00.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.981+0000 7f82bbe00640 1 -- 172.21.15.71:0/136684736 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82bc075b60 con 0x7f82bc06cde0 2024-04-20T21:21:00.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.982+0000 7f82b2a00640 1 -- 172.21.15.71:0/136684736 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82ac04b060 con 0x7f82bc06cde0 2024-04-20T21:21:00.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.983+0000 7f82b2a00640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f829806c8f0 0x7f829806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:00.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.983+0000 7f82b2a00640 1 -- 172.21.15.71:0/136684736 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f82ac0adcf0 con 0x7f82bc06cde0 2024-04-20T21:21:00.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.983+0000 7f82ba000640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f829806c8f0 0x7f829806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:00.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.984+0000 7f82ba000640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f829806c8f0 0x7f829806edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82a4007fd0 tx=0x7f82a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:00.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:00.987+0000 7f82b2a00640 1 -- 172.21.15.71:0/136684736 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f82ac03f070 con 0x7f82bc06cde0 2024-04-20T21:21:01.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.191+0000 7f82bbe00640 1 -- 172.21.15.71:0/136684736 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82bc0d03e0 con 0x7f82bc06cde0 2024-04-20T21:21:01.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.195+0000 7f82b2a00640 1 -- 172.21.15.71:0/136684736 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18925 (secure 0 0 0) 0x7f82ac07bc70 con 0x7f82bc06cde0 2024-04-20T21:21:01.195 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:01.195 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:20:10.860363+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:19:26.847376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T21:19:27.750099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T21:19:31.604142+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:21:01.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.198+0000 7f82bbe00640 1 -- 172.21.15.71:0/136684736 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f829806c8f0 msgr2=0x7f829806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.198+0000 7f82bbe00640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f829806c8f0 0x7f829806edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82a4007fd0 tx=0x7f82a4009040 comp rx=0 tx=0).stop 2024-04-20T21:21:01.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.198+0000 7f82bbe00640 1 -- 172.21.15.71:0/136684736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82bc06cde0 msgr2=0x7f82bc0c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.198+0000 7f82bbe00640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82bc06cde0 0x7f82bc0c8970 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f82ac000c00 tx=0x7f82ac0046c0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.198+0000 7f82bbe00640 1 -- 172.21.15.71:0/136684736 shutdown_connections 2024-04-20T21:21:01.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.198+0000 7f82bbe00640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f829806c8f0 0x7f829806edb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.198+0000 7f82bbe00640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82bc161d50 0x7f82bc0b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.198+0000 7f82bbe00640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82bc0b3330 0x7f82bc14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.198+0000 7f82bbe00640 1 --2- 172.21.15.71:0/136684736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82bc06cde0 0x7f82bc0c8970 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.198+0000 7f82bbe00640 1 -- 172.21.15.71:0/136684736 >> 172.21.15.71:0/136684736 conn(0x7f82bc0d4450 msgr2=0x7f82bc15f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.199+0000 7f82bbe00640 1 -- 172.21.15.71:0/136684736 shutdown_connections 2024-04-20T21:21:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.199+0000 7f82bbe00640 1 -- 172.21.15.71:0/136684736 wait complete. 2024-04-20T21:21:01.218 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-20T21:21:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.407+0000 7f2eae200640 1 Processor -- start 2024-04-20T21:21:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.408+0000 7f2eae200640 1 -- start start 2024-04-20T21:21:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.409+0000 7f2eae200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ea80d4380 0x7f2ea80d4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.409+0000 7f2eae200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ea81621d0 0x7f2ea81625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.409+0000 7f2eae200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea80cf950 con 0x7f2ea815e550 2024-04-20T21:21:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.409+0000 7f2eae200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea8162e90 con 0x7f2ea81621d0 2024-04-20T21:21:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.409+0000 7f2eae200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea80cfbf0 con 0x7f2ea80d4380 2024-04-20T21:21:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.410+0000 7f2ead800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ea81621d0 0x7f2ea81625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.410+0000 7f2ead800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ea81621d0 0x7f2ea81625e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41866/0 (socket says 172.21.15.71:41866) 2024-04-20T21:21:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.410+0000 7f2ead800640 1 -- 172.21.15.71:0/3738959248 learned_addr learned my addr 172.21.15.71:0/3738959248 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.410+0000 7f2e9fe00640 1 --2- 172.21.15.71:0/3738959248 >> v2:172.21.15.137:3300/0 conn(0x7f2ea80d4380 0x7f2ea80d4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.410+0000 7f2ead800640 1 -- 172.21.15.71:0/3738959248 >> v2:172.21.15.137:3300/0 conn(0x7f2ea80d4380 msgr2=0x7f2ea80d4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.410+0000 7f2ead800640 1 --2- 172.21.15.71:0/3738959248 >> v2:172.21.15.137:3300/0 conn(0x7f2ea80d4380 0x7f2ea80d4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.410+0000 7f2ead800640 1 -- 172.21.15.71:0/3738959248 >> v1:172.21.15.137:6789/0 conn(0x7f2ea815e550 legacy=0x7f2ea80d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.410+0000 7f2ead800640 1 -- 172.21.15.71:0/3738959248 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea80cfed0 con 0x7f2ea81621d0 2024-04-20T21:21:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.412+0000 7f2ead800640 1 --2- 172.21.15.71:0/3738959248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea81621d0 0x7f2ea81625e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80b9680 tx=0x7f2ea002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33853820103b5165 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.412+0000 7f2ea7e00640 1 -- 172.21.15.71:0/3738959248 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0035020 con 0x7f2ea81621d0 2024-04-20T21:21:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.412+0000 7f2ea7e00640 1 -- 172.21.15.71:0/3738959248 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea0031870 con 0x7f2ea81621d0 2024-04-20T21:21:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.412+0000 7f2ea7e00640 1 -- 172.21.15.71:0/3738959248 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0031c40 con 0x7f2ea81621d0 2024-04-20T21:21:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.412+0000 7f2eae200640 1 -- 172.21.15.71:0/3738959248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea81621d0 msgr2=0x7f2ea81625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.412+0000 7f2eae200640 1 --2- 172.21.15.71:0/3738959248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea81621d0 0x7f2ea81625e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80b9680 tx=0x7f2ea002b910 comp rx=0 tx=0).stop 2024-04-20T21:21:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.413+0000 7f2eae200640 1 -- 172.21.15.71:0/3738959248 shutdown_connections 2024-04-20T21:21:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.413+0000 7f2eae200640 1 --2- 172.21.15.71:0/3738959248 >> v2:172.21.15.137:3300/0 conn(0x7f2ea80d4380 0x7f2ea80d4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.413+0000 7f2eae200640 1 --2- 172.21.15.71:0/3738959248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea81621d0 0x7f2ea81625e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.413+0000 7f2eae200640 1 -- 172.21.15.71:0/3738959248 >> 172.21.15.71:0/3738959248 conn(0x7f2ea808bf80 msgr2=0x7f2ea809d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.413+0000 7f2eae200640 1 -- 172.21.15.71:0/3738959248 shutdown_connections 2024-04-20T21:21:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.413+0000 7f2eae200640 1 -- 172.21.15.71:0/3738959248 wait complete. 2024-04-20T21:21:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.414+0000 7f2eae200640 1 Processor -- start 2024-04-20T21:21:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.415+0000 7f2eae200640 1 -- start start 2024-04-20T21:21:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.415+0000 7f2eae200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea80d4380 0x7f2ea814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.415+0000 7f2eae200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ea815e550 0x7f2ea8161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eae200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea81621d0 0x7f2ea8161740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eae200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea815eab0 con 0x7f2ea80d4380 2024-04-20T21:21:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eae200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea815e930 con 0x7f2ea81621d0 2024-04-20T21:21:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eae200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea80d1fc0 con 0x7f2ea815e550 2024-04-20T21:21:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eace00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea80d4380 0x7f2ea814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eace00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea80d4380 0x7f2ea814d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41868/0 (socket says 172.21.15.71:41868) 2024-04-20T21:21:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eace00640 1 -- 172.21.15.71:0/2607682031 learned_addr learned my addr 172.21.15.71:0/2607682031 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2ead800640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea81621d0 0x7f2ea8161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2e9fe00640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ea815e550 0x7f2ea8161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eace00640 1 -- 172.21.15.71:0/2607682031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ea815e550 msgr2=0x7f2ea8161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eace00640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ea815e550 0x7f2ea8161200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eace00640 1 -- 172.21.15.71:0/2607682031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea81621d0 msgr2=0x7f2ea8161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eace00640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea81621d0 0x7f2ea8161740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.416+0000 7f2eace00640 1 -- 172.21.15.71:0/2607682031 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea80b4d20 con 0x7f2ea80d4380 2024-04-20T21:21:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.417+0000 7f2eace00640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea80d4380 0x7f2ea814d580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c7c0 tx=0x7f2e9800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.417+0000 7f2ea5600640 1 -- 172.21.15.71:0/2607682031 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98003b90 con 0x7f2ea80d4380 2024-04-20T21:21:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.417+0000 7f2ea5600640 1 -- 172.21.15.71:0/2607682031 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e98003d30 con 0x7f2ea80d4380 2024-04-20T21:21:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.417+0000 7f2eae200640 1 -- 172.21.15.71:0/2607682031 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea80b5000 con 0x7f2ea80d4380 2024-04-20T21:21:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.417+0000 7f2ea5600640 1 -- 172.21.15.71:0/2607682031 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9800aa90 con 0x7f2ea80d4380 2024-04-20T21:21:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.417+0000 7f2eae200640 1 -- 172.21.15.71:0/2607682031 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea815f1f0 con 0x7f2ea80d4380 2024-04-20T21:21:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.418+0000 7f2eae200640 1 -- 172.21.15.71:0/2607682031 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea815ed40 con 0x7f2ea80d4380 2024-04-20T21:21:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.419+0000 7f2ea5600640 1 -- 172.21.15.71:0/2607682031 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e9800ac30 con 0x7f2ea80d4380 2024-04-20T21:21:01.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.423+0000 7f2ea5600640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e8406c8f0 0x7f2e8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.423+0000 7f2e9fe00640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e8406c8f0 0x7f2e8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:01.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.423+0000 7f2ea5600640 1 -- 172.21.15.71:0/2607682031 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f2e9808bf80 con 0x7f2ea80d4380 2024-04-20T21:21:01.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.424+0000 7f2e9fe00640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e8406c8f0 0x7f2e8406edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80cab40 tx=0x7f2e90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.433+0000 7f2ea5600640 1 -- 172.21.15.71:0/2607682031 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2e98059ef0 con 0x7f2ea80d4380 2024-04-20T21:21:01.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.676+0000 7f2eae200640 1 -- 172.21.15.71:0/2607682031 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2ea80b9730 con 0x7f2ea80d4380 2024-04-20T21:21:01.677 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-04-20T21:21:01.678+0000 7fa4b0a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T21:21:01.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.682+0000 7f2ea5600640 1 -- 172.21.15.71:0/2607682031 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f2e980597f0 con 0x7f2ea80d4380 2024-04-20T21:21:01.682 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-20T21:21:01.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.685+0000 7f2eae200640 1 -- 172.21.15.71:0/2607682031 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e8406c8f0 msgr2=0x7f2e8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.685+0000 7f2eae200640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e8406c8f0 0x7f2e8406edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80cab40 tx=0x7f2e90008040 comp rx=0 tx=0).stop 2024-04-20T21:21:01.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.685+0000 7f2eae200640 1 -- 172.21.15.71:0/2607682031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea80d4380 msgr2=0x7f2ea814d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.685+0000 7f2eae200640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea80d4380 0x7f2ea814d580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c7c0 tx=0x7f2e9800cc80 comp rx=0 tx=0).stop 2024-04-20T21:21:01.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.685+0000 7f2eae200640 1 -- 172.21.15.71:0/2607682031 shutdown_connections 2024-04-20T21:21:01.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.685+0000 7f2eae200640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e8406c8f0 0x7f2e8406edb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.685+0000 7f2eae200640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea81621d0 0x7f2ea8161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.685+0000 7f2eae200640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ea815e550 0x7f2ea8161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.685+0000 7f2eae200640 1 --2- 172.21.15.71:0/2607682031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea80d4380 0x7f2ea814d580 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.685+0000 7f2eae200640 1 -- 172.21.15.71:0/2607682031 >> 172.21.15.71:0/2607682031 conn(0x7f2ea808bf80 msgr2=0x7f2ea80d4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:01.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.686+0000 7f2eae200640 1 -- 172.21.15.71:0/2607682031 shutdown_connections 2024-04-20T21:21:01.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.686+0000 7f2eae200640 1 -- 172.21.15.71:0/2607682031 wait complete. 2024-04-20T21:21:01.705 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-20T21:21:01.719 INFO:tasks.ceph.mds.a.smithi071.stderr: -6067> 2024-04-20T21:19:29.929+0000 7f71d2000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T21:21:01.791 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2024-04-20T21:21:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.897+0000 7fb22fe00640 1 Processor -- start 2024-04-20T21:21:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.897+0000 7fb22fe00640 1 -- start start 2024-04-20T21:21:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.899+0000 7fb22fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb228156c20 0x7fb22806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.899+0000 7fb22fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb2280d0360 0x7fb2280d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.899+0000 7fb22fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb228141c60 con 0x7fb22815ca40 2024-04-20T21:21:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.899+0000 7fb22fe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb2280adab0 con 0x7fb2280d0360 2024-04-20T21:21:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.899+0000 7fb22fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb22815cf90 con 0x7fb228156c20 2024-04-20T21:21:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.899+0000 7fb22ca00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb22815ca40 0x7fb2280ad3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:34056/0 (socket says 172.21.15.71:34056) 2024-04-20T21:21:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.899+0000 7fb22ca00640 1 -- 172.21.15.71:0/2938362296 learned_addr learned my addr 172.21.15.71:0/2938362296 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.899+0000 7fb22d400640 1 --2- 172.21.15.71:0/2938362296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb228156c20 0x7fb22806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.900+0000 7fb22de00640 1 --2- 172.21.15.71:0/2938362296 >> v2:172.21.15.137:3300/0 conn(0x7fb2280d0360 0x7fb2280d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.900+0000 7fb227e00640 1 -- 172.21.15.71:0/2938362296 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810932206 0 0) 0x7fb228141c60 con 0x7fb22815ca40 2024-04-20T21:21:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.900+0000 7fb22d400640 1 -- 172.21.15.71:0/2938362296 >> v2:172.21.15.137:3300/0 conn(0x7fb2280d0360 msgr2=0x7fb2280d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.900+0000 7fb22d400640 1 --2- 172.21.15.71:0/2938362296 >> v2:172.21.15.137:3300/0 conn(0x7fb2280d0360 0x7fb2280d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.900+0000 7fb22d400640 1 -- 172.21.15.71:0/2938362296 >> v1:172.21.15.137:6789/0 conn(0x7fb22815ca40 legacy=0x7fb2280ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.900+0000 7fb22d400640 1 -- 172.21.15.71:0/2938362296 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22815d270 con 0x7fb228156c20 2024-04-20T21:21:01.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.902+0000 7fb22d400640 1 --2- 172.21.15.71:0/2938362296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb228156c20 0x7fb22806b900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0097a0 tx=0x7fb21c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=672af5714e0577bb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:01.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.902+0000 7fb227e00640 1 -- 172.21.15.71:0/2938362296 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c035020 con 0x7fb228156c20 2024-04-20T21:21:01.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.902+0000 7fb227e00640 1 -- 172.21.15.71:0/2938362296 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb21c031830 con 0x7fb228156c20 2024-04-20T21:21:01.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.902+0000 7fb227e00640 1 -- 172.21.15.71:0/2938362296 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c031c00 con 0x7fb228156c20 2024-04-20T21:21:01.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.903+0000 7fb22fe00640 1 -- 172.21.15.71:0/2938362296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb228156c20 msgr2=0x7fb22806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.903+0000 7fb22fe00640 1 --2- 172.21.15.71:0/2938362296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb228156c20 0x7fb22806b900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0097a0 tx=0x7fb21c02b8d0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.903+0000 7fb22fe00640 1 -- 172.21.15.71:0/2938362296 shutdown_connections 2024-04-20T21:21:01.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.903+0000 7fb22fe00640 1 --2- 172.21.15.71:0/2938362296 >> v2:172.21.15.137:3300/0 conn(0x7fb2280d0360 0x7fb2280d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.903+0000 7fb22fe00640 1 --2- 172.21.15.71:0/2938362296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb228156c20 0x7fb22806b900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.903+0000 7fb22fe00640 1 -- 172.21.15.71:0/2938362296 >> 172.21.15.71:0/2938362296 conn(0x7fb2280b3350 msgr2=0x7fb2280b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:01.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.903+0000 7fb22fe00640 1 -- 172.21.15.71:0/2938362296 shutdown_connections 2024-04-20T21:21:01.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.903+0000 7fb22fe00640 1 -- 172.21.15.71:0/2938362296 wait complete. 2024-04-20T21:21:01.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.905+0000 7fb22fe00640 1 Processor -- start 2024-04-20T21:21:01.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.905+0000 7fb22fe00640 1 -- start start 2024-04-20T21:21:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.906+0000 7fb22fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2280d0360 0x7fb22806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.906+0000 7fb22fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb228156c20 0x7fb22806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.906+0000 7fb22fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb22815ca40 0x7fb2280aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.906+0000 7fb22fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb22806be40 con 0x7fb22815ca40 2024-04-20T21:21:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.906+0000 7fb22fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb22815d830 con 0x7fb2280d0360 2024-04-20T21:21:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.906+0000 7fb22fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb22806bfc0 con 0x7fb228156c20 2024-04-20T21:21:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.906+0000 7fb22de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb22815ca40 0x7fb2280aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.906+0000 7fb22de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb22815ca40 0x7fb2280aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41900/0 (socket says 172.21.15.71:41900) 2024-04-20T21:21:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.906+0000 7fb22de00640 1 -- 172.21.15.71:0/1849382124 learned_addr learned my addr 172.21.15.71:0/1849382124 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb22d400640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2280d0360 0x7fb22806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb22de00640 1 -- 172.21.15.71:0/1849382124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb228156c20 msgr2=0x7fb22806efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb22de00640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb228156c20 0x7fb22806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb22de00640 1 -- 172.21.15.71:0/1849382124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2280d0360 msgr2=0x7fb22806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb22de00640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2280d0360 0x7fb22806eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb22de00640 1 -- 172.21.15.71:0/1849382124 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22806dce0 con 0x7fb22815ca40 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb22de00640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb22815ca40 0x7fb2280aefd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb22000ec10 tx=0x7fb22000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb225600640 1 -- 172.21.15.71:0/1849382124 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220018020 con 0x7fb22815ca40 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb225600640 1 -- 172.21.15.71:0/1849382124 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22000cd20 con 0x7fb22815ca40 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb22fe00640 1 -- 172.21.15.71:0/1849382124 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22806dfc0 con 0x7fb22815ca40 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb225600640 1 -- 172.21.15.71:0/1849382124 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2200146c0 con 0x7fb22815ca40 2024-04-20T21:21:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.907+0000 7fb22fe00640 1 -- 172.21.15.71:0/1849382124 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22815bb70 con 0x7fb22815ca40 2024-04-20T21:21:01.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.909+0000 7fb22fe00640 1 -- 172.21.15.71:0/1849382124 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb228068980 con 0x7fb22815ca40 2024-04-20T21:21:01.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.910+0000 7fb225600640 1 -- 172.21.15.71:0/1849382124 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb22001b020 con 0x7fb22815ca40 2024-04-20T21:21:01.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.911+0000 7fb225600640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb20806c8f0 0x7fb20806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:01.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.911+0000 7fb225600640 1 -- 172.21.15.71:0/1849382124 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6850+0+0 (secure 0 0 0) 0x7fb22008cd20 con 0x7fb22815ca40 2024-04-20T21:21:01.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.911+0000 7fb22d400640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb20806c8f0 0x7fb20806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:01.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.912+0000 7fb22d400640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb20806c8f0 0x7fb20806edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb21c036000 tx=0x7fb21c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:01.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:01.915+0000 7fb225600640 1 -- 172.21.15.71:0/1849382124 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb220022020 con 0x7fb22815ca40 2024-04-20T21:21:02.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.160+0000 7fb22fe00640 1 -- 172.21.15.71:0/1849382124 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb2280cfd90 con 0x7fb22815ca40 2024-04-20T21:21:02.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.694+0000 7fb225600640 1 -- 172.21.15.71:0/1849382124 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fb220010040 con 0x7fb22815ca40 2024-04-20T21:21:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.697+0000 7fb22fe00640 1 -- 172.21.15.71:0/1849382124 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb20806c8f0 msgr2=0x7fb20806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.697+0000 7fb22fe00640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb20806c8f0 0x7fb20806edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb21c036000 tx=0x7fb21c008030 comp rx=0 tx=0).stop 2024-04-20T21:21:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.697+0000 7fb22fe00640 1 -- 172.21.15.71:0/1849382124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb22815ca40 msgr2=0x7fb2280aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.697+0000 7fb22fe00640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb22815ca40 0x7fb2280aefd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb22000ec10 tx=0x7fb22000c490 comp rx=0 tx=0).stop 2024-04-20T21:21:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.697+0000 7fb22fe00640 1 -- 172.21.15.71:0/1849382124 shutdown_connections 2024-04-20T21:21:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.697+0000 7fb22fe00640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fb20806c8f0 0x7fb20806edb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.697+0000 7fb22fe00640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb22815ca40 0x7fb2280aefd0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.697+0000 7fb22fe00640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb228156c20 0x7fb22806efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.697+0000 7fb22fe00640 1 --2- 172.21.15.71:0/1849382124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2280d0360 0x7fb22806eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.697+0000 7fb22fe00640 1 -- 172.21.15.71:0/1849382124 >> 172.21.15.71:0/1849382124 conn(0x7fb2280b3350 msgr2=0x7fb22815ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.697+0000 7fb22fe00640 1 -- 172.21.15.71:0/1849382124 shutdown_connections 2024-04-20T21:21:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.698+0000 7fb22fe00640 1 -- 172.21.15.71:0/1849382124 wait complete. 2024-04-20T21:21:02.720 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-20T21:21:02.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.972+0000 7f3676e00640 1 Processor -- start 2024-04-20T21:21:02.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.973+0000 7f3676e00640 1 -- start start 2024-04-20T21:21:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.974+0000 7f3676e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f367015ca40 0x7f36700ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.974+0000 7f3676e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36700ad8e0 0x7f36700d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.974+0000 7f3676e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3670141c60 con 0x7f3670156c20 2024-04-20T21:21:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.974+0000 7f3676e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f367006c010 con 0x7f367015ca40 2024-04-20T21:21:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.974+0000 7f3676e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f367015cf90 con 0x7f36700ad8e0 2024-04-20T21:21:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.974+0000 7f366fe00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3670156c20 0x7f367006b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57392/0 (socket says 172.21.15.71:57392) 2024-04-20T21:21:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.974+0000 7f366fe00640 1 -- 172.21.15.71:0/926800167 learned_addr learned my addr 172.21.15.71:0/926800167 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.974+0000 7f366f400640 1 --2- 172.21.15.71:0/926800167 >> v2:172.21.15.71:3300/0 conn(0x7f367015ca40 0x7f36700ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.975+0000 7f3674e00640 1 --2- 172.21.15.71:0/926800167 >> v2:172.21.15.137:3300/0 conn(0x7f36700ad8e0 0x7f36700d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.975+0000 7f366ea00640 1 -- 172.21.15.71:0/926800167 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 540501314 0 0) 0x7f3670141c60 con 0x7f3670156c20 2024-04-20T21:21:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.975+0000 7f366ea00640 1 -- 172.21.15.71:0/926800167 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3654003520 con 0x7f3670156c20 2024-04-20T21:21:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.975+0000 7f366f400640 1 -- 172.21.15.71:0/926800167 >> v2:172.21.15.137:3300/0 conn(0x7f36700ad8e0 msgr2=0x7f36700d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.975+0000 7f366f400640 1 --2- 172.21.15.71:0/926800167 >> v2:172.21.15.137:3300/0 conn(0x7f36700ad8e0 0x7f36700d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:02.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.975+0000 7f366f400640 1 -- 172.21.15.71:0/926800167 >> v1:172.21.15.71:6789/0 conn(0x7f3670156c20 legacy=0x7f367006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:02.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.975+0000 7f366f400640 1 -- 172.21.15.71:0/926800167 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367015d270 con 0x7f367015ca40 2024-04-20T21:21:02.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.975+0000 7f3674e00640 1 --2- 172.21.15.71:0/926800167 >> v2:172.21.15.137:3300/0 conn(0x7f36700ad8e0 0x7f36700d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:21:02.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.976+0000 7f366f400640 1 --2- 172.21.15.71:0/926800167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f367015ca40 0x7f36700ad3a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f367006ff40 tx=0x7f365c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b51eee2b2f11b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:02.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.977+0000 7f366ea00640 1 -- 172.21.15.71:0/926800167 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c035020 con 0x7f367015ca40 2024-04-20T21:21:02.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.977+0000 7f366ea00640 1 -- 172.21.15.71:0/926800167 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c031830 con 0x7f367015ca40 2024-04-20T21:21:02.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.977+0000 7f366ea00640 1 -- 172.21.15.71:0/926800167 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c031c00 con 0x7f367015ca40 2024-04-20T21:21:02.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.977+0000 7f3676e00640 1 -- 172.21.15.71:0/926800167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f367015ca40 msgr2=0x7f36700ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:02.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.977+0000 7f3676e00640 1 --2- 172.21.15.71:0/926800167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f367015ca40 0x7f36700ad3a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f367006ff40 tx=0x7f365c02b8d0 comp rx=0 tx=0).stop 2024-04-20T21:21:02.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.977+0000 7f3676e00640 1 -- 172.21.15.71:0/926800167 shutdown_connections 2024-04-20T21:21:02.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.977+0000 7f3676e00640 1 --2- 172.21.15.71:0/926800167 >> v2:172.21.15.137:3300/0 conn(0x7f36700ad8e0 0x7f36700d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:02.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.977+0000 7f3676e00640 1 --2- 172.21.15.71:0/926800167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f367015ca40 0x7f36700ad3a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:02.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.978+0000 7f3676e00640 1 -- 172.21.15.71:0/926800167 >> 172.21.15.71:0/926800167 conn(0x7f36700b3350 msgr2=0x7f36700b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:02.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.978+0000 7f3676e00640 1 -- 172.21.15.71:0/926800167 shutdown_connections 2024-04-20T21:21:02.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.978+0000 7f3676e00640 1 -- 172.21.15.71:0/926800167 wait complete. 2024-04-20T21:21:02.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.979+0000 7f3676e00640 1 Processor -- start 2024-04-20T21:21:02.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.979+0000 7f3676e00640 1 -- start start 2024-04-20T21:21:02.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.980+0000 7f3676e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36700ad8e0 0x7f36701f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:02.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.980+0000 7f3676e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3670156c20 0x7f3670151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:02.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.980+0000 7f3676e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f367015ca40 0x7f367015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:02.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.980+0000 7f3676e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36700d08a0 con 0x7f36700ad8e0 2024-04-20T21:21:02.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.980+0000 7f3676e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f367015d830 con 0x7f367015ca40 2024-04-20T21:21:02.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.980+0000 7f3676e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f36700d0a20 con 0x7f3670156c20 2024-04-20T21:21:02.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.981+0000 7f366fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36700ad8e0 0x7f36701f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:02.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.981+0000 7f366fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36700ad8e0 0x7f36701f4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34482/0 (socket says 172.21.15.71:34482) 2024-04-20T21:21:02.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.981+0000 7f366fe00640 1 -- 172.21.15.71:0/3026070025 learned_addr learned my addr 172.21.15.71:0/3026070025 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:02.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.981+0000 7f3674e00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f367015ca40 0x7f367015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:02.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.981+0000 7f366f400640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3670156c20 0x7f3670151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:02.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.981+0000 7f366fe00640 1 -- 172.21.15.71:0/3026070025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3670156c20 msgr2=0x7f3670151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:02.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.981+0000 7f366fe00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3670156c20 0x7f3670151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:02.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.981+0000 7f366fe00640 1 -- 172.21.15.71:0/3026070025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f367015ca40 msgr2=0x7f367015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:02.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.981+0000 7f366fe00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f367015ca40 0x7f367015b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:02.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.981+0000 7f366fe00640 1 -- 172.21.15.71:0/3026070025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3670152070 con 0x7f36700ad8e0 2024-04-20T21:21:02.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.981+0000 7f3674e00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f367015ca40 0x7f367015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:02.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.982+0000 7f366fe00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36700ad8e0 0x7f36701f4050 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f366000c430 tx=0x7f366000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:02.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.982+0000 7f3667e00640 1 -- 172.21.15.71:0/3026070025 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660017070 con 0x7f36700ad8e0 2024-04-20T21:21:02.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.982+0000 7f3667e00640 1 -- 172.21.15.71:0/3026070025 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3660005ce0 con 0x7f36700ad8e0 2024-04-20T21:21:02.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.982+0000 7f3676e00640 1 -- 172.21.15.71:0/3026070025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36700cede0 con 0x7f36700ad8e0 2024-04-20T21:21:02.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.982+0000 7f3667e00640 1 -- 172.21.15.71:0/3026070025 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36600072f0 con 0x7f36700ad8e0 2024-04-20T21:21:02.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.982+0000 7f3676e00640 1 -- 172.21.15.71:0/3026070025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36700cf8c0 con 0x7f36700ad8e0 2024-04-20T21:21:02.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.983+0000 7f3676e00640 1 -- 172.21.15.71:0/3026070025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36700cc790 con 0x7f36700ad8e0 2024-04-20T21:21:02.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.984+0000 7f3667e00640 1 -- 172.21.15.71:0/3026070025 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f366001a070 con 0x7f36700ad8e0 2024-04-20T21:21:02.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.985+0000 7f3667e00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f365006c8f0 0x7f365006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:02.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.985+0000 7f3667e00640 1 -- 172.21.15.71:0/3026070025 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6850+0+0 (secure 0 0 0) 0x7f366008b4c0 con 0x7f36700ad8e0 2024-04-20T21:21:02.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.985+0000 7f366f400640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f365006c8f0 0x7f365006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:02.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.986+0000 7f366f400640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f365006c8f0 0x7f365006edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f365c036000 tx=0x7f365c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:02.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:02.990+0000 7f3667e00640 1 -- 172.21.15.71:0/3026070025 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f36700cc790 con 0x7f36700ad8e0 2024-04-20T21:21:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.188+0000 7f3676e00640 1 -- 172.21.15.71:0/3026070025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3670068980 con 0x7f36700ad8e0 2024-04-20T21:21:03.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.698+0000 7f3667e00640 1 -- 172.21.15.71:0/3026070025 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f3660059460 con 0x7f36700ad8e0 2024-04-20T21:21:03.698 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 -- 172.21.15.71:0/3026070025 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f365006c8f0 msgr2=0x7f365006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f365006c8f0 0x7f365006edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f365c036000 tx=0x7f365c008030 comp rx=0 tx=0).stop 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 -- 172.21.15.71:0/3026070025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36700ad8e0 msgr2=0x7f36701f4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36700ad8e0 0x7f36701f4050 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f366000c430 tx=0x7f366000c8f0 comp rx=0 tx=0).stop 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 -- 172.21.15.71:0/3026070025 shutdown_connections 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f365006c8f0 0x7f365006edb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f367015ca40 0x7f367015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3670156c20 0x7f3670151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 --2- 172.21.15.71:0/3026070025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36700ad8e0 0x7f36701f4050 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 -- 172.21.15.71:0/3026070025 >> 172.21.15.71:0/3026070025 conn(0x7f36700b3350 msgr2=0x7f36700afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 -- 172.21.15.71:0/3026070025 shutdown_connections 2024-04-20T21:21:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.702+0000 7f3676e00640 1 -- 172.21.15.71:0/3026070025 wait complete. 2024-04-20T21:21:03.725 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-20T21:21:03.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.929+0000 7fac31400640 1 Processor -- start 2024-04-20T21:21:03.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.930+0000 7fac31400640 1 -- start start 2024-04-20T21:21:03.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.931+0000 7fac31400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fac2c15c400 0x7fac2c06f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:03.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.931+0000 7fac31400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c06d020 0x7fac2c15c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:03.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.931+0000 7fac31400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac2c06de90 con 0x7fac2c06d920 2024-04-20T21:21:03.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.931+0000 7fac31400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fac2c06e170 con 0x7fac2c15c400 2024-04-20T21:21:03.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.931+0000 7fac31400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fac2c071ee0 con 0x7fac2c06d020 2024-04-20T21:21:03.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.932+0000 7fac23e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fac2c06d920 0x7fac2c06c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57404/0 (socket says 172.21.15.71:57404) 2024-04-20T21:21:03.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.932+0000 7fac23e00640 1 -- 172.21.15.71:0/409804615 learned_addr learned my addr 172.21.15.71:0/409804615 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:03.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.932+0000 7fac2be00640 1 --2- 172.21.15.71:0/409804615 >> v2:172.21.15.137:3300/0 conn(0x7fac2c15c400 0x7fac2c06f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:03.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.932+0000 7fac30a00640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c06d020 0x7fac2c15c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:03.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.932+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460354800 0 0) 0x7fac2c06de90 con 0x7fac2c06d920 2024-04-20T21:21:03.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.932+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac10003520 con 0x7fac2c06d920 2024-04-20T21:21:03.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 814022534 0 0) 0x7fac10003520 con 0x7fac2c06d920 2024-04-20T21:21:03.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c06d020 msgr2=0x7fac2c15c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:03.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c06d020 0x7fac2c15c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 >> v2:172.21.15.137:3300/0 conn(0x7fac2c15c400 msgr2=0x7fac2c06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 --2- 172.21.15.71:0/409804615 >> v2:172.21.15.137:3300/0 conn(0x7fac2c15c400 0x7fac2c06f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2c072130 con 0x7fac2c06d920 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fac14001670 con 0x7fac2c06d920 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 >> v1:172.21.15.71:6789/0 conn(0x7fac2c06d920 legacy=0x7fac2c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 0x7fac10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c06d020 0x7fac10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac10004d40 0x7fac100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c06e170 con 0x7fac100039b0 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c071ee0 con 0x7fac10004d40 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fac1000b9c0 con 0x7fac2c06d020 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.933+0000 7fac2be00640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 0x7fac10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:03.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.934+0000 7fac23e00640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c06d020 0x7fac10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:03.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.934+0000 7fac30a00640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac10004d40 0x7fac100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:03.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.934+0000 7fac2be00640 1 -- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c06d020 msgr2=0x7fac10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:03.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.934+0000 7fac2be00640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c06d020 0x7fac10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:03.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.934+0000 7fac2be00640 1 -- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac10004d40 msgr2=0x7fac100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:03.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.934+0000 7fac2be00640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac10004d40 0x7fac100051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:03.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.934+0000 7fac2be00640 1 -- 172.21.15.71:0/409804615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac10003520 con 0x7fac100039b0 2024-04-20T21:21:03.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.934+0000 7fac23e00640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c06d020 0x7fac10004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.935+0000 7fac2be00640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 0x7fac10003dd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009af0 tx=0x7fac10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc3f65aadb6d9f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.935+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c039070 con 0x7fac100039b0 2024-04-20T21:21:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.935+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c02c710 con 0x7fac100039b0 2024-04-20T21:21:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.935+0000 7fac2b400640 1 -- 172.21.15.71:0/409804615 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c009690 con 0x7fac100039b0 2024-04-20T21:21:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.936+0000 7fac31400640 1 -- 172.21.15.71:0/409804615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 msgr2=0x7fac10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.936+0000 7fac31400640 1 --2- 172.21.15.71:0/409804615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 0x7fac10003dd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009af0 tx=0x7fac10005830 comp rx=0 tx=0).stop 2024-04-20T21:21:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.936+0000 7fac30a00640 1 -- 172.21.15.71:0/409804615 reap_dead start 2024-04-20T21:21:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.936+0000 7fac31400640 1 -- 172.21.15.71:0/409804615 shutdown_connections 2024-04-20T21:21:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.936+0000 7fac31400640 1 -- 172.21.15.71:0/409804615 >> 172.21.15.71:0/409804615 conn(0x7fac2c0cc9b0 msgr2=0x7fac2c0ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.936+0000 7fac31400640 1 -- 172.21.15.71:0/409804615 shutdown_connections 2024-04-20T21:21:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.936+0000 7fac31400640 1 -- 172.21.15.71:0/409804615 wait complete. 2024-04-20T21:21:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.938+0000 7fac31400640 1 Processor -- start 2024-04-20T21:21:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.938+0000 7fac31400640 1 -- start start 2024-04-20T21:21:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.939+0000 7fac31400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 0x7fac2c15c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.939+0000 7fac31400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c15cd20 0x7fac2c15e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.939+0000 7fac31400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac2c15ec60 0x7fac2c15f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.939+0000 7fac31400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c071bd0 con 0x7fac100039b0 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.939+0000 7fac31400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c072780 con 0x7fac2c15ec60 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.939+0000 7fac31400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fac2c072c10 con 0x7fac2c15cd20 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.939+0000 7fac2be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 0x7fac2c15c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.939+0000 7fac2be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 0x7fac2c15c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34506/0 (socket says 172.21.15.71:34506) 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.939+0000 7fac2be00640 1 -- 172.21.15.71:0/1380565497 learned_addr learned my addr 172.21.15.71:0/1380565497 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.940+0000 7fac2be00640 1 -- 172.21.15.71:0/1380565497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c15cd20 msgr2=0x7fac2c15e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.940+0000 7fac2be00640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c15cd20 0x7fac2c15e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.940+0000 7fac2be00640 1 -- 172.21.15.71:0/1380565497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac2c15ec60 msgr2=0x7fac2c15f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.940+0000 7fac2be00640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac2c15ec60 0x7fac2c15f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.940+0000 7fac2be00640 1 -- 172.21.15.71:0/1380565497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2c15f620 con 0x7fac100039b0 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.940+0000 7fac2be00640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 0x7fac2c15c7e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009af0 tx=0x7fac1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.940+0000 7fac28c00640 1 -- 172.21.15.71:0/1380565497 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c042020 con 0x7fac100039b0 2024-04-20T21:21:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.940+0000 7fac28c00640 1 -- 172.21.15.71:0/1380565497 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c03a040 con 0x7fac100039b0 2024-04-20T21:21:03.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.940+0000 7fac28c00640 1 -- 172.21.15.71:0/1380565497 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c039070 con 0x7fac100039b0 2024-04-20T21:21:03.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.940+0000 7fac31400640 1 -- 172.21.15.71:0/1380565497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2c09ab90 con 0x7fac100039b0 2024-04-20T21:21:03.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.940+0000 7fac31400640 1 -- 172.21.15.71:0/1380565497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac2c09b150 con 0x7fac100039b0 2024-04-20T21:21:03.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.942+0000 7fac31400640 1 -- 172.21.15.71:0/1380565497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac2c0b18c0 con 0x7fac100039b0 2024-04-20T21:21:03.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.942+0000 7fac28c00640 1 -- 172.21.15.71:0/1380565497 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac1c045020 con 0x7fac100039b0 2024-04-20T21:21:03.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.943+0000 7fac28c00640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fac0806c920 0x7fac0806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:03.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.943+0000 7fac28c00640 1 -- 172.21.15.71:0/1380565497 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6412+0+0 (secure 0 0 0) 0x7fac1c0ad4f0 con 0x7fac100039b0 2024-04-20T21:21:03.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.944+0000 7fac23e00640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fac0806c920 0x7fac0806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:03.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.944+0000 7fac23e00640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fac0806c920 0x7fac0806ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fac2c15e440 tx=0x7fac14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:03.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:03.948+0000 7fac28c00640 1 -- 172.21.15.71:0/1380565497 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fac1c04c030 con 0x7fac100039b0 2024-04-20T21:21:04.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.143+0000 7fac31400640 1 -- 172.21.15.71:0/1380565497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac2c075b30 con 0x7fac100039b0 2024-04-20T21:21:04.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.708+0000 7fac28c00640 1 -- 172.21.15.71:0/1380565497 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7fac1c07b5c0 con 0x7fac100039b0 2024-04-20T21:21:04.708 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2024-04-20T21:21:04.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.711+0000 7fac31400640 1 -- 172.21.15.71:0/1380565497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fac0806c920 msgr2=0x7fac0806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:04.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.711+0000 7fac31400640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fac0806c920 0x7fac0806ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fac2c15e440 tx=0x7fac14009040 comp rx=0 tx=0).stop 2024-04-20T21:21:04.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.711+0000 7fac31400640 1 -- 172.21.15.71:0/1380565497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 msgr2=0x7fac2c15c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:04.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.711+0000 7fac31400640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 0x7fac2c15c7e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009af0 tx=0x7fac1c004730 comp rx=0 tx=0).stop 2024-04-20T21:21:04.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.711+0000 7fac31400640 1 -- 172.21.15.71:0/1380565497 shutdown_connections 2024-04-20T21:21:04.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.711+0000 7fac31400640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fac0806c920 0x7fac0806ede0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:04.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.711+0000 7fac31400640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac2c15ec60 0x7fac2c15f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:04.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.711+0000 7fac31400640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac2c15cd20 0x7fac2c15e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:04.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.711+0000 7fac31400640 1 --2- 172.21.15.71:0/1380565497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac100039b0 0x7fac2c15c7e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:04.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.711+0000 7fac31400640 1 -- 172.21.15.71:0/1380565497 >> 172.21.15.71:0/1380565497 conn(0x7fac2c0cc9b0 msgr2=0x7fac2c0ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:04.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.712+0000 7fac31400640 1 -- 172.21.15.71:0/1380565497 shutdown_connections 2024-04-20T21:21:04.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.712+0000 7fac31400640 1 -- 172.21.15.71:0/1380565497 wait complete. 2024-04-20T21:21:04.739 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-20T21:21:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.936+0000 7fe6f0600640 1 Processor -- start 2024-04-20T21:21:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.936+0000 7fe6f0600640 1 -- start start 2024-04-20T21:21:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.937+0000 7fe6f0600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe6e8156c20 0x7fe6e806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.938+0000 7fe6f0600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e8141c60 con 0x7fe6e80d0360 2024-04-20T21:21:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.938+0000 7fe6f0600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e80adab0 con 0x7fe6e815ca40 2024-04-20T21:21:04.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.938+0000 7fe6f0600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe6e815cf90 con 0x7fe6e8156c20 2024-04-20T21:21:04.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.938+0000 7fe6ee600640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe6e80d0360 0x7fe6e8142140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57420/0 (socket says 172.21.15.71:57420) 2024-04-20T21:21:04.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.938+0000 7fe6ee600640 1 -- 172.21.15.71:0/1591551525 learned_addr learned my addr 172.21.15.71:0/1591551525 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.938+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 113212553 0 0) 0x7fe6e8141c60 con 0x7fe6e80d0360 2024-04-20T21:21:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.938+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6d0003520 con 0x7fe6e80d0360 2024-04-20T21:21:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6edc00640 1 --2- 172.21.15.71:0/1591551525 >> v2:172.21.15.137:3300/0 conn(0x7fe6e8156c20 0x7fe6e806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1168208555 0 0) 0x7fe6d0003520 con 0x7fe6e80d0360 2024-04-20T21:21:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 >> v2:172.21.15.137:3300/0 conn(0x7fe6e8156c20 msgr2=0x7fe6e806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 --2- 172.21.15.71:0/1591551525 >> v2:172.21.15.137:3300/0 conn(0x7fe6e8156c20 0x7fe6e806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 >> v1:172.21.15.137:6789/0 conn(0x7fe6e815ca40 legacy=0x7fe6e80ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e815d270 con 0x7fe6e80d0360 2024-04-20T21:21:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fe6e00019f0 con 0x7fe6e80d0360 2024-04-20T21:21:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 >> v1:172.21.15.71:6789/0 conn(0x7fe6e80d0360 legacy=0x7fe6e8142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 --2- 172.21.15.71:0/1591551525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d00039b0 0x7fe6d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 --2- 172.21.15.71:0/1591551525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6d0004800 0x7fe6d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 --2- 172.21.15.71:0/1591551525 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d00051c0 0x7fe6d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e815cf90 con 0x7fe6d0004800 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d000c110 con 0x7fe6d00039b0 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d000c310 con 0x7fe6d00051c0 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.939+0000 7fe6ed200640 1 --2- 172.21.15.71:0/1591551525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6d0004800 0x7fe6d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.940+0000 7fe6ed200640 1 -- 172.21.15.71:0/1591551525 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d00051c0 msgr2=0x7fe6d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.940+0000 7fe6ed200640 1 --2- 172.21.15.71:0/1591551525 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d00051c0 0x7fe6d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.940+0000 7fe6ed200640 1 -- 172.21.15.71:0/1591551525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d00039b0 msgr2=0x7fe6d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.940+0000 7fe6ed200640 1 --2- 172.21.15.71:0/1591551525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d00039b0 0x7fe6d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.940+0000 7fe6ed200640 1 -- 172.21.15.71:0/1591551525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d0003520 con 0x7fe6d0004800 2024-04-20T21:21:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.940+0000 7fe6ee600640 1 -- 172.21.15.71:0/1591551525 reap_dead start 2024-04-20T21:21:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.941+0000 7fe6ed200640 1 --2- 172.21.15.71:0/1591551525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6d0004800 0x7fe6d0004c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4001750 tx=0x7fe6d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1176fc9aefa8a95f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.941+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4001370 con 0x7fe6d0004800 2024-04-20T21:21:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.941+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d40052d0 con 0x7fe6d0004800 2024-04-20T21:21:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.941+0000 7fe6e7e00640 1 -- 172.21.15.71:0/1591551525 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4003830 con 0x7fe6d0004800 2024-04-20T21:21:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.942+0000 7fe6f0600640 1 -- 172.21.15.71:0/1591551525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6d0004800 msgr2=0x7fe6d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.942+0000 7fe6f0600640 1 --2- 172.21.15.71:0/1591551525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6d0004800 0x7fe6d0004c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4001750 tx=0x7fe6d0005830 comp rx=0 tx=0).stop 2024-04-20T21:21:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.942+0000 7fe6f0600640 1 -- 172.21.15.71:0/1591551525 shutdown_connections 2024-04-20T21:21:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.942+0000 7fe6f0600640 1 --2- 172.21.15.71:0/1591551525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6d0004800 0x7fe6d0004c80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.942+0000 7fe6f0600640 1 -- 172.21.15.71:0/1591551525 >> 172.21.15.71:0/1591551525 conn(0x7fe6e80b3350 msgr2=0x7fe6e80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.942+0000 7fe6f0600640 1 -- 172.21.15.71:0/1591551525 shutdown_connections 2024-04-20T21:21:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.942+0000 7fe6f0600640 1 -- 172.21.15.71:0/1591551525 wait complete. 2024-04-20T21:21:04.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.944+0000 7fe6f0600640 1 Processor -- start 2024-04-20T21:21:04.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.944+0000 7fe6f0600640 1 -- start start 2024-04-20T21:21:04.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6f0600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d0004800 0x7fe6e81f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:04.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6f0600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6e80afdd0 0x7fe6e81ee970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:04.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6f0600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6e815b410 0x7fe6e815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:04.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6f0600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e80d07d0 con 0x7fe6e80afdd0 2024-04-20T21:21:04.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6f0600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e815d830 con 0x7fe6e815b410 2024-04-20T21:21:04.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6f0600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e80d0950 con 0x7fe6d0004800 2024-04-20T21:21:04.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6ed200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6e80afdd0 0x7fe6e81ee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:04.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6ed200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6e80afdd0 0x7fe6e81ee970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34524/0 (socket says 172.21.15.71:34524) 2024-04-20T21:21:04.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6ed200640 1 -- 172.21.15.71:0/2752146884 learned_addr learned my addr 172.21.15.71:0/2752146884 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6ed200640 1 -- 172.21.15.71:0/2752146884 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d0004800 msgr2=0x7fe6e81f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6ed200640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d0004800 0x7fe6e81f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6ed200640 1 -- 172.21.15.71:0/2752146884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6e815b410 msgr2=0x7fe6e815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6ed200640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6e815b410 0x7fe6e815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.945+0000 7fe6ed200640 1 -- 172.21.15.71:0/2752146884 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e81f4da0 con 0x7fe6e80afdd0 2024-04-20T21:21:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.946+0000 7fe6ed200640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6e80afdd0 0x7fe6e81ee970 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4005040 tx=0x7fe6d4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.946+0000 7fe6e5600640 1 -- 172.21.15.71:0/2752146884 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4041020 con 0x7fe6e80afdd0 2024-04-20T21:21:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.946+0000 7fe6e5600640 1 -- 172.21.15.71:0/2752146884 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d4005480 con 0x7fe6e80afdd0 2024-04-20T21:21:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.946+0000 7fe6f0600640 1 -- 172.21.15.71:0/2752146884 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e81f5080 con 0x7fe6e80afdd0 2024-04-20T21:21:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.946+0000 7fe6e5600640 1 -- 172.21.15.71:0/2752146884 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4007a30 con 0x7fe6e80afdd0 2024-04-20T21:21:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.946+0000 7fe6f0600640 1 -- 172.21.15.71:0/2752146884 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e81f5640 con 0x7fe6e80afdd0 2024-04-20T21:21:04.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.948+0000 7fe6f0600640 1 -- 172.21.15.71:0/2752146884 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e80cc720 con 0x7fe6e80afdd0 2024-04-20T21:21:04.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.948+0000 7fe6e5600640 1 -- 172.21.15.71:0/2752146884 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6d4044020 con 0x7fe6e80afdd0 2024-04-20T21:21:04.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.949+0000 7fe6e5600640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe6c806c920 0x7fe6c806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:04.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.949+0000 7fe6e5600640 1 -- 172.21.15.71:0/2752146884 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7fe6d40ad610 con 0x7fe6e80afdd0 2024-04-20T21:21:04.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.950+0000 7fe6edc00640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe6c806c920 0x7fe6c806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:04.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.950+0000 7fe6edc00640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe6c806c920 0x7fe6c806ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc006e80 tx=0x7fe6dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:04.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:04.954+0000 7fe6e5600640 1 -- 172.21.15.71:0/2752146884 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe6e80cc720 con 0x7fe6e80afdd0 2024-04-20T21:21:05.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.157+0000 7fe6f0600640 1 -- 172.21.15.71:0/2752146884 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe6e8068980 con 0x7fe6e80afdd0 2024-04-20T21:21:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.721+0000 7fe6e5600640 1 -- 172.21.15.71:0/2752146884 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7fe6d404b030 con 0x7fe6e80afdd0 2024-04-20T21:21:05.721 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data_ec' removed 2024-04-20T21:21:05.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.724+0000 7fe6f0600640 1 -- 172.21.15.71:0/2752146884 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe6c806c920 msgr2=0x7fe6c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.724+0000 7fe6f0600640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe6c806c920 0x7fe6c806ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc006e80 tx=0x7fe6dc008040 comp rx=0 tx=0).stop 2024-04-20T21:21:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.724+0000 7fe6f0600640 1 -- 172.21.15.71:0/2752146884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6e80afdd0 msgr2=0x7fe6e81ee970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.724+0000 7fe6f0600640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6e80afdd0 0x7fe6e81ee970 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4005040 tx=0x7fe6d4001120 comp rx=0 tx=0).stop 2024-04-20T21:21:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.724+0000 7fe6f0600640 1 -- 172.21.15.71:0/2752146884 shutdown_connections 2024-04-20T21:21:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.724+0000 7fe6f0600640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fe6c806c920 0x7fe6c806ede0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.724+0000 7fe6f0600640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6e815b410 0x7fe6e815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:05.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.724+0000 7fe6f0600640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6e80afdd0 0x7fe6e81ee970 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:05.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.724+0000 7fe6f0600640 1 --2- 172.21.15.71:0/2752146884 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d0004800 0x7fe6e81f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:05.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.724+0000 7fe6f0600640 1 -- 172.21.15.71:0/2752146884 >> 172.21.15.71:0/2752146884 conn(0x7fe6e80b3350 msgr2=0x7fe6e815db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:05.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.725+0000 7fe6f0600640 1 -- 172.21.15.71:0/2752146884 shutdown_connections 2024-04-20T21:21:05.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:05.725+0000 7fe6f0600640 1 -- 172.21.15.71:0/2752146884 wait complete. 2024-04-20T21:21:05.746 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-20T21:21:05.746 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-20T21:21:05.747 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-20T21:21:05.747 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T21:21:05.747 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-20T21:21:05.747 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-20T21:21:05.747 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-20T21:21:05.747 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T21:21:05.747 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-20T21:21:05.748 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-20T21:21:05.748 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-20T21:21:05.748 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T21:21:05.748 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-20T21:21:05.748 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-20T21:21:05.748 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-20T21:21:05.748 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T21:21:05.766 INFO:tasks.ceph.mds.c:Stopped 2024-04-20T21:21:05.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-20T21:21:05.767 INFO:tasks.ceph.mds.a:Stopped 2024-04-20T21:21:05.768 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-20T21:21:05.773 INFO:tasks.ceph.mds.b:Stopped 2024-04-20T21:21:05.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-20T21:21:05.775 INFO:tasks.ceph.mds.d:Stopped 2024-04-20T21:21:05.775 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-20T21:21:05.812 INFO:tasks.ceph.mds.c:Started 2024-04-20T21:21:05.812 DEBUG:teuthology.parallel:result is None 2024-04-20T21:21:05.816 INFO:tasks.ceph.mds.a:Started 2024-04-20T21:21:05.816 DEBUG:teuthology.parallel:result is None 2024-04-20T21:21:05.822 INFO:tasks.ceph.mds.b:Started 2024-04-20T21:21:05.822 DEBUG:teuthology.parallel:result is None 2024-04-20T21:21:05.828 INFO:tasks.ceph.mds.d:Started 2024-04-20T21:21:05.828 DEBUG:teuthology.parallel:result is None 2024-04-20T21:21:05.828 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-20T21:21:05.957 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2024-04-20T21:21:05.963 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2024-04-20T21:21:05.975 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-04-20T21:21:05.975 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-04-20T21:21:05.977 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-20T21:21:05.978+0000 7f4e3b400640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-20T21:21:06.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.006+0000 7f6c7b000640 1 Processor -- start 2024-04-20T21:21:06.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.006+0000 7f6c7b000640 1 -- start start 2024-04-20T21:21:06.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.007+0000 7f6c7b000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c74156c20 0x7f6c7406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.007+0000 7f6c7b000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6c7415ca40 0x7f6c740ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.007+0000 7f6c7b000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c74141c60 con 0x7f6c740ad8e0 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.007+0000 7f6c7b000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6c7415cf90 con 0x7f6c7415ca40 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.007+0000 7f6c7b000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7415d270 con 0x7f6c74156c20 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.007+0000 7f6c6b400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6c7415ca40 0x7f6c740ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.007+0000 7f6c6b400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6c7415ca40 0x7f6c740ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34566/0 (socket says 172.21.15.71:34566) 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.007+0000 7f6c6b400640 1 -- 172.21.15.71:0/862760372 learned_addr learned my addr 172.21.15.71:0/862760372 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.008+0000 7f6c73e00640 1 --2- 172.21.15.71:0/862760372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c74156c20 0x7f6c7406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.008+0000 7f6c6b400640 1 -- 172.21.15.71:0/862760372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c74156c20 msgr2=0x7f6c7406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.008+0000 7f6c6b400640 1 --2- 172.21.15.71:0/862760372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c74156c20 0x7f6c7406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.008+0000 7f6c6b400640 1 -- 172.21.15.71:0/862760372 >> v1:172.21.15.71:6789/0 conn(0x7f6c740ad8e0 legacy=0x7f6c740d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.008+0000 7f6c6b400640 1 -- 172.21.15.71:0/862760372 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7415d550 con 0x7f6c7415ca40 2024-04-20T21:21:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.008+0000 7f6c73e00640 1 --2- 172.21.15.71:0/862760372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c74156c20 0x7f6c7406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.009+0000 7f6c6b400640 1 --2- 172.21.15.71:0/862760372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c7415ca40 0x7f6c740ad3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009870 tx=0x7f6c5c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0db3d734fd5a715 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.009+0000 7f6c73400640 1 -- 172.21.15.71:0/862760372 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c034070 con 0x7f6c7415ca40 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.009+0000 7f6c73400640 1 -- 172.21.15.71:0/862760372 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c5c030840 con 0x7f6c7415ca40 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.009+0000 7f6c73400640 1 -- 172.21.15.71:0/862760372 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c030c10 con 0x7f6c7415ca40 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.010+0000 7f6c7b000640 1 -- 172.21.15.71:0/862760372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c7415ca40 msgr2=0x7f6c740ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.010+0000 7f6c7b000640 1 --2- 172.21.15.71:0/862760372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c7415ca40 0x7f6c740ad3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009870 tx=0x7f6c5c02b980 comp rx=0 tx=0).stop 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.010+0000 7f6c7b000640 1 -- 172.21.15.71:0/862760372 shutdown_connections 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.010+0000 7f6c7b000640 1 --2- 172.21.15.71:0/862760372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c7415ca40 0x7f6c740ad3a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.010+0000 7f6c7b000640 1 --2- 172.21.15.71:0/862760372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c74156c20 0x7f6c7406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.010+0000 7f6c7b000640 1 -- 172.21.15.71:0/862760372 >> 172.21.15.71:0/862760372 conn(0x7f6c740b3350 msgr2=0x7f6c740b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.010+0000 7f6c7b000640 1 -- 172.21.15.71:0/862760372 shutdown_connections 2024-04-20T21:21:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.010+0000 7f6c7b000640 1 -- 172.21.15.71:0/862760372 wait complete. 2024-04-20T21:21:06.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.012+0000 7f6c7b000640 1 Processor -- start 2024-04-20T21:21:06.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.012+0000 7f6c7b000640 1 -- start start 2024-04-20T21:21:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c7b000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c740ad8e0 0x7f6c740999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c7b000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c74156c20 0x7f6c740b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c7b000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c7415ca40 0x7f6c740b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c7b000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7406bfc0 con 0x7f6c7415ca40 2024-04-20T21:21:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c7b000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7406be40 con 0x7f6c74156c20 2024-04-20T21:21:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c7b000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6c740d0a70 con 0x7f6c740ad8e0 2024-04-20T21:21:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c79000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c7415ca40 0x7f6c740b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c79000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c7415ca40 0x7f6c740b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34580/0 (socket says 172.21.15.71:34580) 2024-04-20T21:21:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c79000640 1 -- 172.21.15.71:0/247736123 learned_addr learned my addr 172.21.15.71:0/247736123 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c73e00640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c740ad8e0 0x7f6c740999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c6b400640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c74156c20 0x7f6c740b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c79000640 1 -- 172.21.15.71:0/247736123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c740ad8e0 msgr2=0x7f6c740999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.013+0000 7f6c79000640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c740ad8e0 0x7f6c740999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.014+0000 7f6c79000640 1 -- 172.21.15.71:0/247736123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c74156c20 msgr2=0x7f6c740b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.014+0000 7f6c79000640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c74156c20 0x7f6c740b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.014+0000 7f6c79000640 1 -- 172.21.15.71:0/247736123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c741506f0 con 0x7f6c7415ca40 2024-04-20T21:21:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.014+0000 7f6c73e00640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c740ad8e0 0x7f6c740999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:21:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.014+0000 7f6c79000640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c7415ca40 0x7f6c740b0c70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00c390 tx=0x7f6c6c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.014+0000 7f6c70c00640 1 -- 172.21.15.71:0/247736123 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c017070 con 0x7f6c7415ca40 2024-04-20T21:21:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.014+0000 7f6c70c00640 1 -- 172.21.15.71:0/247736123 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6c0052d0 con 0x7f6c7415ca40 2024-04-20T21:21:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.014+0000 7f6c70c00640 1 -- 172.21.15.71:0/247736123 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0037f0 con 0x7f6c7415ca40 2024-04-20T21:21:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.014+0000 7f6c7b000640 1 -- 172.21.15.71:0/247736123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c740ccd80 con 0x7f6c7415ca40 2024-04-20T21:21:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.014+0000 7f6c7b000640 1 -- 172.21.15.71:0/247736123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7414fb60 con 0x7f6c7415ca40 2024-04-20T21:21:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.016+0000 7f6c7b000640 1 -- 172.21.15.71:0/247736123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c74068980 con 0x7f6c7415ca40 2024-04-20T21:21:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.016+0000 7f6c70c00640 1 -- 172.21.15.71:0/247736123 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c6c01a070 con 0x7f6c7415ca40 2024-04-20T21:21:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.017+0000 7f6c70c00640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c5006c8f0 0x7f6c5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.017+0000 7f6c70c00640 1 -- 172.21.15.71:0/247736123 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7f6c6c08ab10 con 0x7f6c7415ca40 2024-04-20T21:21:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.018+0000 7f6c73e00640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c5006c8f0 0x7f6c5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.018+0000 7f6c73e00640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c5006c8f0 0x7f6c5006edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6c7406c400 tx=0x7f6c640076e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:06.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.022+0000 7f6c70c00640 1 -- 172.21.15.71:0/247736123 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6c6c058af0 con 0x7f6c7415ca40 2024-04-20T21:21:06.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.233+0000 7f6c7b000640 1 -- 172.21.15.71:0/247736123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6c740cfd90 con 0x7f6c7415ca40 2024-04-20T21:21:06.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.747+0000 7f6c70c00640 1 -- 172.21.15.71:0/247736123 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7f6c6c05cdf0 con 0x7f6c7415ca40 2024-04-20T21:21:06.748 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2024-04-20T21:21:06.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.752+0000 7f6c7b000640 1 -- 172.21.15.71:0/247736123 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c5006c8f0 msgr2=0x7f6c5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:06.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.752+0000 7f6c7b000640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c5006c8f0 0x7f6c5006edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6c7406c400 tx=0x7f6c640076e0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.752+0000 7f6c7b000640 1 -- 172.21.15.71:0/247736123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c7415ca40 msgr2=0x7f6c740b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:06.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.752+0000 7f6c7b000640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c7415ca40 0x7f6c740b0c70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00c390 tx=0x7f6c6c00c850 comp rx=0 tx=0).stop 2024-04-20T21:21:06.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.753+0000 7f6c7b000640 1 -- 172.21.15.71:0/247736123 shutdown_connections 2024-04-20T21:21:06.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.753+0000 7f6c7b000640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c5006c8f0 0x7f6c5006edb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.753+0000 7f6c7b000640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c7415ca40 0x7f6c740b0c70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.753+0000 7f6c7b000640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c74156c20 0x7f6c740b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.753+0000 7f6c7b000640 1 --2- 172.21.15.71:0/247736123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c740ad8e0 0x7f6c740999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.753+0000 7f6c7b000640 1 -- 172.21.15.71:0/247736123 >> 172.21.15.71:0/247736123 conn(0x7f6c740b3350 msgr2=0x7f6c741521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:06.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.754+0000 7f6c7b000640 1 -- 172.21.15.71:0/247736123 shutdown_connections 2024-04-20T21:21:06.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.754+0000 7f6c7b000640 1 -- 172.21.15.71:0/247736123 wait complete. 2024-04-20T21:21:06.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-20T21:21:06.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.950+0000 7ffadf400640 1 Processor -- start 2024-04-20T21:21:06.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.951+0000 7ffadf400640 1 -- start start 2024-04-20T21:21:06.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.952+0000 7ffadf400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffad81600f0 0x7ffad80b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.952+0000 7ffadf400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffad815cb00 0x7ffad80716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.952+0000 7ffadf400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffad80b2a20 0x7ffad8071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.952+0000 7ffadf400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ffad813f910 con 0x7ffad81600f0 2024-04-20T21:21:06.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.952+0000 7ffadf400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ffad80c74c0 con 0x7ffad815cb00 2024-04-20T21:21:06.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.952+0000 7ffadf400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ffad815cfc0 con 0x7ffad80b2a20 2024-04-20T21:21:06.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.952+0000 7ffadca00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffad81600f0 0x7ffad80b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.953+0000 7ffadca00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffad81600f0 0x7ffad80b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34596/0 (socket says 172.21.15.71:34596) 2024-04-20T21:21:06.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.953+0000 7ffadca00640 1 -- 172.21.15.71:0/3568196290 learned_addr learned my addr 172.21.15.71:0/3568196290 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:06.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.953+0000 7ffadca00640 1 -- 172.21.15.71:0/3568196290 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffad80b2a20 msgr2=0x7ffad8071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:06.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.953+0000 7ffadd400640 1 --2- 172.21.15.71:0/3568196290 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffad80b2a20 0x7ffad8071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.953+0000 7ffadca00640 1 --2- 172.21.15.71:0/3568196290 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffad80b2a20 0x7ffad8071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.953+0000 7ffadca00640 1 -- 172.21.15.71:0/3568196290 >> v2:172.21.15.137:3300/0 conn(0x7ffad815cb00 msgr2=0x7ffad80716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:06.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.953+0000 7ffad7e00640 1 --2- 172.21.15.71:0/3568196290 >> v2:172.21.15.137:3300/0 conn(0x7ffad815cb00 0x7ffad80716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.953+0000 7ffadca00640 1 --2- 172.21.15.71:0/3568196290 >> v2:172.21.15.137:3300/0 conn(0x7ffad815cb00 0x7ffad80716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.953+0000 7ffadca00640 1 -- 172.21.15.71:0/3568196290 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad815d2a0 con 0x7ffad81600f0 2024-04-20T21:21:06.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.953+0000 7ffad7e00640 1 --2- 172.21.15.71:0/3568196290 >> v2:172.21.15.137:3300/0 conn(0x7ffad815cb00 0x7ffad80716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:06.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.954+0000 7ffadca00640 1 --2- 172.21.15.71:0/3568196290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffad81600f0 0x7ffad80b24e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffad80b33a0 tx=0x7ffac802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c0010bca0b327f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.955+0000 7ffad7400640 1 -- 172.21.15.71:0/3568196290 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac8035020 con 0x7ffad81600f0 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.955+0000 7ffad7400640 1 -- 172.21.15.71:0/3568196290 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac8031870 con 0x7ffad81600f0 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.955+0000 7ffad7400640 1 -- 172.21.15.71:0/3568196290 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac8031c40 con 0x7ffad81600f0 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.955+0000 7ffadf400640 1 -- 172.21.15.71:0/3568196290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffad81600f0 msgr2=0x7ffad80b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.955+0000 7ffadf400640 1 --2- 172.21.15.71:0/3568196290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffad81600f0 0x7ffad80b24e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffad80b33a0 tx=0x7ffac802b910 comp rx=0 tx=0).stop 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.955+0000 7ffadf400640 1 -- 172.21.15.71:0/3568196290 shutdown_connections 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.956+0000 7ffadf400640 1 --2- 172.21.15.71:0/3568196290 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffad80b2a20 0x7ffad8071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.956+0000 7ffadf400640 1 --2- 172.21.15.71:0/3568196290 >> v2:172.21.15.137:3300/0 conn(0x7ffad815cb00 0x7ffad80716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.956+0000 7ffadf400640 1 --2- 172.21.15.71:0/3568196290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffad81600f0 0x7ffad80b24e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.956+0000 7ffadf400640 1 -- 172.21.15.71:0/3568196290 >> 172.21.15.71:0/3568196290 conn(0x7ffad80cede0 msgr2=0x7ffad80cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.956+0000 7ffadf400640 1 -- 172.21.15.71:0/3568196290 shutdown_connections 2024-04-20T21:21:06.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.956+0000 7ffadf400640 1 -- 172.21.15.71:0/3568196290 wait complete. 2024-04-20T21:21:06.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.957+0000 7ffadf400640 1 Processor -- start 2024-04-20T21:21:06.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.958+0000 7ffadf400640 1 -- start start 2024-04-20T21:21:06.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.958+0000 7ffadf400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffad80b2a20 0x7ffad80b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.958+0000 7ffadf400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffad815cb00 0x7ffad813c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadf400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffad81600f0 0x7ffad813ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadf400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffad81604d0 con 0x7ffad81600f0 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadf400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffad815d860 con 0x7ffad80b2a20 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadf400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ffad8160650 con 0x7ffad815cb00 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffad81600f0 0x7ffad813ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffad81600f0 0x7ffad813ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34604/0 (socket says 172.21.15.71:34604) 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadd400640 1 -- 172.21.15.71:0/1515078738 learned_addr learned my addr 172.21.15.71:0/1515078738 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadca00640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffad80b2a20 0x7ffad80b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffad7e00640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffad815cb00 0x7ffad813c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadd400640 1 -- 172.21.15.71:0/1515078738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffad815cb00 msgr2=0x7ffad813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadd400640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffad815cb00 0x7ffad813c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadd400640 1 -- 172.21.15.71:0/1515078738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffad80b2a20 msgr2=0x7ffad80b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:06.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadd400640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffad80b2a20 0x7ffad80b79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:06.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.959+0000 7ffadd400640 1 -- 172.21.15.71:0/1515078738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad80cc030 con 0x7ffad81600f0 2024-04-20T21:21:06.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.960+0000 7ffadd400640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffad81600f0 0x7ffad813ca50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffad000cd70 tx=0x7ffad000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:06.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.960+0000 7ffad4c00640 1 -- 172.21.15.71:0/1515078738 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0003b90 con 0x7ffad81600f0 2024-04-20T21:21:06.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.960+0000 7ffad4c00640 1 -- 172.21.15.71:0/1515078738 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffad0003d30 con 0x7ffad81600f0 2024-04-20T21:21:06.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.960+0000 7ffad4c00640 1 -- 172.21.15.71:0/1515078738 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0004240 con 0x7ffad81600f0 2024-04-20T21:21:06.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.960+0000 7ffadf400640 1 -- 172.21.15.71:0/1515078738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad81f5610 con 0x7ffad81600f0 2024-04-20T21:21:06.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.960+0000 7ffadf400640 1 -- 172.21.15.71:0/1515078738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad81f5c20 con 0x7ffad81600f0 2024-04-20T21:21:06.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.961+0000 7ffadf400640 1 -- 172.21.15.71:0/1515078738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad8069090 con 0x7ffad81600f0 2024-04-20T21:21:06.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.962+0000 7ffad4c00640 1 -- 172.21.15.71:0/1515078738 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffad00043e0 con 0x7ffad81600f0 2024-04-20T21:21:06.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.963+0000 7ffad4c00640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffab806c8f0 0x7ffab806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:06.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.963+0000 7ffad4c00640 1 -- 172.21.15.71:0/1515078738 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7ffad008c510 con 0x7ffad81600f0 2024-04-20T21:21:06.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.964+0000 7ffadca00640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffab806c8f0 0x7ffab806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:06.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.964+0000 7ffadca00640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffab806c8f0 0x7ffab806edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffac8036000 tx=0x7ffac803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:06.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:06.968+0000 7ffad4c00640 1 -- 172.21.15.71:0/1515078738 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ffad80cc030 con 0x7ffad81600f0 2024-04-20T21:21:07.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.252+0000 7ffadf400640 1 -- 172.21.15.71:0/1515078738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ffad80b36b0 con 0x7ffad81600f0 2024-04-20T21:21:07.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.253+0000 7ffad4c00640 1 -- 172.21.15.71:0/1515078738 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7ffad005aa60 con 0x7ffad81600f0 2024-04-20T21:21:07.253 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:07.253 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-20T21:21:07.253 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2024-04-20T21:21:07.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.253 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAhMSRmc23ILxAAScYMtIu+/WMy6jZuH6NPcA==", 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAiMSRmt2AfDxAAd7jEzbZXFB1pem/Pfmn89Q==", 2024-04-20T21:21:07.254 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAiMSRm6mtTABAAqAjiCFmvi/O77FTuVG9zyw==", 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2024-04-20T21:21:07.255 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAiMSRmTCC2HBAAq7padk3XNf2DJJuikyxZUw==", 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2024-04-20T21:21:07.256 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.257 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2024-04-20T21:21:07.257 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAmMSRmFKxCIRAATO2CL53EzAJaGeKG48OgrQ==", 2024-04-20T21:21:07.257 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.257 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2024-04-20T21:21:07.257 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2024-04-20T21:21:07.257 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQApMSRm4M6RLBAAncjZyWTnWQCAS3BHoF40Gg==", 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2024-04-20T21:21:07.258 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAsMSRmRY+rNhAAb/9T+r/YcjekP2BQr1vaEw==", 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAwMSRmvZ8XBhAA+gbY3hosO36P5RFhzmAukg==", 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2024-04-20T21:21:07.259 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQA2MSRm5lJGFxAA8+tM9iz2DtRtQTAmOaxmeg==", 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQA5MSRmyRA3MBAAgv27liO92ZlnKa6uhVIkdw==", 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQA8MSRmlnoBOhAAbQp+9wzBJdZVgyjzOvijAw==", 2024-04-20T21:21:07.261 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.262 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2024-04-20T21:21:07.262 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2024-04-20T21:21:07.262 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.262 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2024-04-20T21:21:07.262 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBAMSRmjcv+CBAAQWkkeqvIkvObYUslhvmhTQ==", 2024-04-20T21:21:07.262 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.262 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2024-04-20T21:21:07.262 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAiMSRmBYIpKBAAXd3vf56ttxfmvMK2YXpHOg==", 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAiMSRm9YjeORAAG9pTTD8Tmv6Awhjo26t6BA==", 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2024-04-20T21:21:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAiMSRmG3koMBAAlDOy0tz0naK1+lk4ITsMwg==", 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAjMSRmpXtyBxAAYAvmCwtumpheJd4pQ5FgPg==", 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.265 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAgMSRmQNyGLhAAqg4+CRXLLBsixKav3co0AQ==", 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2024-04-20T21:21:07.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-mds", 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBIMSRmWmVFIxAA379I7V1go7Wm/Ed+FwltcQ==", 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-mds" 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.267 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-mgr", 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBIMSRm8W5FIxAAYW+jS8zwwImE+q2WuS9WRA==", 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-osd", 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBIMSRmh3dFIxAAqTkuieBu0wd8Shg7stM1yw==", 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-osd" 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.269 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rbd", 2024-04-20T21:21:07.269 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBIMSRmxn9FIxAAGwM8ho4qKl5iTU5i0jX9XA==", 2024-04-20T21:21:07.269 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.269 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-20T21:21:07.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.269 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-20T21:21:07.269 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBIMSRm84dFIxAAxghM2XLtpIdpatQWQo0L8g==", 2024-04-20T21:21:07.269 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.269 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rgw", 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBIMSRmi5BFIxAAiJ4T263qVvpwQ8aYOl3SOw==", 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2024-04-20T21:21:07.270 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAhMSRmmSyPJhAA+kjZMv8Wian5J9TXnhAfuQ==", 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAhMSRmvw9LHBAAfBY+B69mgIG99gmBIYl/HQ==", 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2024-04-20T21:21:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2024-04-20T21:21:07.272 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2024-04-20T21:21:07.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:07.272 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-20T21:21:07.272 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-20T21:21:07.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.256+0000 7ffadf400640 1 -- 172.21.15.71:0/1515078738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffab806c8f0 msgr2=0x7ffab806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:07.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.256+0000 7ffadf400640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffab806c8f0 0x7ffab806edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffac8036000 tx=0x7ffac803c040 comp rx=0 tx=0).stop 2024-04-20T21:21:07.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.256+0000 7ffadf400640 1 -- 172.21.15.71:0/1515078738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffad81600f0 msgr2=0x7ffad813ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:07.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.256+0000 7ffadf400640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffad81600f0 0x7ffad813ca50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffad000cd70 tx=0x7ffad000a660 comp rx=0 tx=0).stop 2024-04-20T21:21:07.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.256+0000 7ffadf400640 1 -- 172.21.15.71:0/1515078738 shutdown_connections 2024-04-20T21:21:07.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.256+0000 7ffadf400640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ffab806c8f0 0x7ffab806edb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.256+0000 7ffadf400640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffad81600f0 0x7ffad813ca50 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.256+0000 7ffadf400640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffad815cb00 0x7ffad813c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.256+0000 7ffadf400640 1 --2- 172.21.15.71:0/1515078738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffad80b2a20 0x7ffad80b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.256+0000 7ffadf400640 1 -- 172.21.15.71:0/1515078738 >> 172.21.15.71:0/1515078738 conn(0x7ffad80cede0 msgr2=0x7ffad8140580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:07.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.257+0000 7ffadf400640 1 -- 172.21.15.71:0/1515078738 shutdown_connections 2024-04-20T21:21:07.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.257+0000 7ffadf400640 1 -- 172.21.15.71:0/1515078738 wait complete. 2024-04-20T21:21:07.276 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-20T21:21:07.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.469+0000 7fc1bc000640 1 Processor -- start 2024-04-20T21:21:07.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.470+0000 7fc1bc000640 1 -- start start 2024-04-20T21:21:07.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.471+0000 7fc1bc000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1b415ca40 0x7fc1b40ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.471+0000 7fc1bc000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1b40ad8e0 0x7fc1b40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.471+0000 7fc1bc000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b4141c60 con 0x7fc1b4156c20 2024-04-20T21:21:07.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.471+0000 7fc1bc000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b406c010 con 0x7fc1b415ca40 2024-04-20T21:21:07.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.471+0000 7fc1bc000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b415cf90 con 0x7fc1b40ad8e0 2024-04-20T21:21:07.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.471+0000 7fc1b9600640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc1b4156c20 0x7fc1b406b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57474/0 (socket says 172.21.15.71:57474) 2024-04-20T21:21:07.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.471+0000 7fc1b9600640 1 -- 172.21.15.71:0/3051450691 learned_addr learned my addr 172.21.15.71:0/3051450691 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:07.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1ba000640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1b40ad8e0 0x7fc1b40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b8c00640 1 --2- 172.21.15.71:0/3051450691 >> v2:172.21.15.137:3300/0 conn(0x7fc1b415ca40 0x7fc1b40ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172171587 0 0) 0x7fc1b4141c60 con 0x7fc1b4156c20 2024-04-20T21:21:07.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc19c003520 con 0x7fc1b4156c20 2024-04-20T21:21:07.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4162188060 0 0) 0x7fc19c003520 con 0x7fc1b4156c20 2024-04-20T21:21:07.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1b40ad8e0 msgr2=0x7fc1b40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1b40ad8e0 0x7fc1b40d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 >> v2:172.21.15.137:3300/0 conn(0x7fc1b415ca40 msgr2=0x7fc1b40ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 --2- 172.21.15.71:0/3051450691 >> v2:172.21.15.137:3300/0 conn(0x7fc1b415ca40 0x7fc1b40ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b415d270 con 0x7fc1b4156c20 2024-04-20T21:21:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fc1a4001670 con 0x7fc1b4156c20 2024-04-20T21:21:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 >> v1:172.21.15.71:6789/0 conn(0x7fc1b4156c20 legacy=0x7fc1b406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc19c0039b0 0x7fc19c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.472+0000 7fc1b3e00640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc19c004800 0x7fc19c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1b3e00640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc19c0051c0 0x7fc19c00fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b406c010 con 0x7fc19c0051c0 2024-04-20T21:21:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b415cf90 con 0x7fc19c0039b0 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc19c010340 con 0x7fc19c004800 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1ba000640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1b40ad8e0 0x7fc1b40d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1ba000640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc19c0051c0 0x7fc19c00fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1b8c00640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc19c004800 0x7fc19c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1b9600640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc19c0039b0 0x7fc19c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1ba000640 1 -- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc19c004800 msgr2=0x7fc19c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1ba000640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc19c004800 0x7fc19c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1ba000640 1 -- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc19c0039b0 msgr2=0x7fc19c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1ba000640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc19c0039b0 0x7fc19c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1ba000640 1 -- 172.21.15.71:0/3051450691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c003520 con 0x7fc19c0051c0 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.473+0000 7fc1b9600640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc19c0039b0 0x7fc19c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:07.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.474+0000 7fc1ba000640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc19c0051c0 0x7fc19c00fdd0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40d00d0 tx=0x7fc19c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4888b4326bbb3f19 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:07.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.475+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac032070 con 0x7fc19c0051c0 2024-04-20T21:21:07.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.475+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ac030070 con 0x7fc19c0051c0 2024-04-20T21:21:07.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.475+0000 7fc1b3e00640 1 -- 172.21.15.71:0/3051450691 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac009b50 con 0x7fc19c0051c0 2024-04-20T21:21:07.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.475+0000 7fc1bc000640 1 -- 172.21.15.71:0/3051450691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc19c0051c0 msgr2=0x7fc19c00fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:07.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.475+0000 7fc1bc000640 1 --2- 172.21.15.71:0/3051450691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc19c0051c0 0x7fc19c00fdd0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40d00d0 tx=0x7fc19c005830 comp rx=0 tx=0).stop 2024-04-20T21:21:07.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.475+0000 7fc1ba000640 1 -- 172.21.15.71:0/3051450691 reap_dead start 2024-04-20T21:21:07.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.475+0000 7fc1bc000640 1 -- 172.21.15.71:0/3051450691 shutdown_connections 2024-04-20T21:21:07.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.475+0000 7fc1bc000640 1 -- 172.21.15.71:0/3051450691 >> 172.21.15.71:0/3051450691 conn(0x7fc1b40b3350 msgr2=0x7fc1b40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:07.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.475+0000 7fc1bc000640 1 -- 172.21.15.71:0/3051450691 shutdown_connections 2024-04-20T21:21:07.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.475+0000 7fc1bc000640 1 -- 172.21.15.71:0/3051450691 wait complete. 2024-04-20T21:21:07.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.477+0000 7fc1bc000640 1 Processor -- start 2024-04-20T21:21:07.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.477+0000 7fc1bc000640 1 -- start start 2024-04-20T21:21:07.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.478+0000 7fc1bc000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc19c0051c0 0x7fc1b409d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.478+0000 7fc1bc000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b40cf320 0x7fc1b4155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.478+0000 7fc1bc000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1b4155770 0x7fc1b406ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.478+0000 7fc1bc000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b40d0360 con 0x7fc1b40cf320 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.478+0000 7fc1bc000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b415d830 con 0x7fc1b4155770 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.478+0000 7fc1bc000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b40d04e0 con 0x7fc19c0051c0 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.478+0000 7fc1b8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b40cf320 0x7fc1b4155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.478+0000 7fc1b8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b40cf320 0x7fc1b4155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34618/0 (socket says 172.21.15.71:34618) 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.478+0000 7fc1b8c00640 1 -- 172.21.15.71:0/432142313 learned_addr learned my addr 172.21.15.71:0/432142313 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1b9600640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc19c0051c0 0x7fc1b409d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1ba000640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1b4155770 0x7fc1b406ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1b8c00640 1 -- 172.21.15.71:0/432142313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc19c0051c0 msgr2=0x7fc1b409d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1b8c00640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc19c0051c0 0x7fc1b409d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1b8c00640 1 -- 172.21.15.71:0/432142313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1b4155770 msgr2=0x7fc1b406ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:07.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1b8c00640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1b4155770 0x7fc1b406ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1b8c00640 1 -- 172.21.15.71:0/432142313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b4071ce0 con 0x7fc1b40cf320 2024-04-20T21:21:07.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1ba000640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1b4155770 0x7fc1b406ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:07.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1b8c00640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b40cf320 0x7fc1b4155230 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80116d0 tx=0x7fc1a8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:07.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1b1600640 1 -- 172.21.15.71:0/432142313 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a800f9c0 con 0x7fc1b40cf320 2024-04-20T21:21:07.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1b1600640 1 -- 172.21.15.71:0/432142313 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a800fb60 con 0x7fc1b40cf320 2024-04-20T21:21:07.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1b1600640 1 -- 172.21.15.71:0/432142313 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8015460 con 0x7fc1b40cf320 2024-04-20T21:21:07.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1bc000640 1 -- 172.21.15.71:0/432142313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b40ccf10 con 0x7fc1b40cf320 2024-04-20T21:21:07.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.479+0000 7fc1bc000640 1 -- 172.21.15.71:0/432142313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b4071fa0 con 0x7fc1b40cf320 2024-04-20T21:21:07.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.480+0000 7fc1bc000640 1 -- 172.21.15.71:0/432142313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b4068980 con 0x7fc1b40cf320 2024-04-20T21:21:07.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.481+0000 7fc1b1600640 1 -- 172.21.15.71:0/432142313 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc1a8015600 con 0x7fc1b40cf320 2024-04-20T21:21:07.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.483+0000 7fc1b1600640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c920 0x7fc19806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.483+0000 7fc1b1600640 1 -- 172.21.15.71:0/432142313 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fc1a808bff0 con 0x7fc1b40cf320 2024-04-20T21:21:07.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.483+0000 7fc1b9600640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c920 0x7fc19806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.484+0000 7fc1b9600640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c920 0x7fc19806ede0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40079b0 tx=0x7fc1a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:07.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.487+0000 7fc1b1600640 1 -- 172.21.15.71:0/432142313 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc1a8019030 con 0x7fc1b40cf320 2024-04-20T21:21:07.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.760+0000 7fc1bc000640 1 -- 172.21.15.71:0/432142313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fc1b4155b50 con 0x7fc1b40cf320 2024-04-20T21:21:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.764+0000 7fc1b1600640 1 -- 172.21.15.71:0/432142313 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fc1a8059f10 con 0x7fc1b40cf320 2024-04-20T21:21:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.766+0000 7fc1bc000640 1 -- 172.21.15.71:0/432142313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c920 msgr2=0x7fc19806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.767+0000 7fc1bc000640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c920 0x7fc19806ede0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40079b0 tx=0x7fc1a4009040 comp rx=0 tx=0).stop 2024-04-20T21:21:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.767+0000 7fc1bc000640 1 -- 172.21.15.71:0/432142313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b40cf320 msgr2=0x7fc1b4155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.767+0000 7fc1bc000640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b40cf320 0x7fc1b4155230 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80116d0 tx=0x7fc1a8011b90 comp rx=0 tx=0).stop 2024-04-20T21:21:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.767+0000 7fc1bc000640 1 -- 172.21.15.71:0/432142313 shutdown_connections 2024-04-20T21:21:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.767+0000 7fc1bc000640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc19806c920 0x7fc19806ede0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.767+0000 7fc1bc000640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1b4155770 0x7fc1b406ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.767+0000 7fc1bc000640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b40cf320 0x7fc1b4155230 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.767+0000 7fc1bc000640 1 --2- 172.21.15.71:0/432142313 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc19c0051c0 0x7fc1b409d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.767+0000 7fc1bc000640 1 -- 172.21.15.71:0/432142313 >> 172.21.15.71:0/432142313 conn(0x7fc1b40b3350 msgr2=0x7fc1b40b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.767+0000 7fc1bc000640 1 -- 172.21.15.71:0/432142313 shutdown_connections 2024-04-20T21:21:07.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.767+0000 7fc1bc000640 1 -- 172.21.15.71:0/432142313 wait complete. 2024-04-20T21:21:07.785 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-20T21:21:07.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.966+0000 7ff510a00640 1 Processor -- start 2024-04-20T21:21:07.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.966+0000 7ff510a00640 1 -- start start 2024-04-20T21:21:07.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff510a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff50c162210 0x7ff50c162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff510a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff50c0b6400 0x7ff50c0b6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff510a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c0b3ba0 con 0x7ff50c15e770 2024-04-20T21:21:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff510a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff50c15eb50 con 0x7ff50c0b6400 2024-04-20T21:21:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff510a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff50c0d3590 con 0x7ff50c162210 2024-04-20T21:21:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff50be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff50c0b6400 0x7ff50c0b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff50be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff50c0b6400 0x7ff50c0b6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34620/0 (socket says 172.21.15.71:34620) 2024-04-20T21:21:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff50be00640 1 -- 172.21.15.71:0/3608385618 learned_addr learned my addr 172.21.15.71:0/3608385618 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff50be00640 1 -- 172.21.15.71:0/3608385618 >> v2:172.21.15.137:3300/0 conn(0x7ff50c162210 msgr2=0x7ff50c162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff50be00640 1 --2- 172.21.15.71:0/3608385618 >> v2:172.21.15.137:3300/0 conn(0x7ff50c162210 0x7ff50c162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff50be00640 1 -- 172.21.15.71:0/3608385618 >> v1:172.21.15.137:6789/0 conn(0x7ff50c15e770 legacy=0x7ff50c0b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.967+0000 7ff50be00640 1 -- 172.21.15.71:0/3608385618 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c0d3870 con 0x7ff50c0b6400 2024-04-20T21:21:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.968+0000 7ff50be00640 1 --2- 172.21.15.71:0/3608385618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff50c0b6400 0x7ff50c0b6870 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0b9a60 tx=0x7ff50402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305adc4878fd7b5b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.969+0000 7ff50aa00640 1 -- 172.21.15.71:0/3608385618 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50402c9f0 con 0x7ff50c0b6400 2024-04-20T21:21:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.969+0000 7ff50aa00640 1 -- 172.21.15.71:0/3608385618 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50402cb90 con 0x7ff50c0b6400 2024-04-20T21:21:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.969+0000 7ff50aa00640 1 -- 172.21.15.71:0/3608385618 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5040343f0 con 0x7ff50c0b6400 2024-04-20T21:21:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.969+0000 7ff510a00640 1 -- 172.21.15.71:0/3608385618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff50c0b6400 msgr2=0x7ff50c0b6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.969+0000 7ff510a00640 1 --2- 172.21.15.71:0/3608385618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff50c0b6400 0x7ff50c0b6870 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0b9a60 tx=0x7ff50402be50 comp rx=0 tx=0).stop 2024-04-20T21:21:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.969+0000 7ff510a00640 1 -- 172.21.15.71:0/3608385618 shutdown_connections 2024-04-20T21:21:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.969+0000 7ff510a00640 1 --2- 172.21.15.71:0/3608385618 >> v2:172.21.15.137:3300/0 conn(0x7ff50c162210 0x7ff50c162670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.969+0000 7ff510a00640 1 --2- 172.21.15.71:0/3608385618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff50c0b6400 0x7ff50c0b6870 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.969+0000 7ff510a00640 1 -- 172.21.15.71:0/3608385618 >> 172.21.15.71:0/3608385618 conn(0x7ff50c09d6d0 msgr2=0x7ff50c0b92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.969+0000 7ff510a00640 1 -- 172.21.15.71:0/3608385618 shutdown_connections 2024-04-20T21:21:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.969+0000 7ff510a00640 1 -- 172.21.15.71:0/3608385618 wait complete. 2024-04-20T21:21:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.971+0000 7ff510a00640 1 Processor -- start 2024-04-20T21:21:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.971+0000 7ff510a00640 1 -- start start 2024-04-20T21:21:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.972+0000 7ff510a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff50c0b6400 0x7ff50c15f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.972+0000 7ff510a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff50c15e770 0x7ff50c15c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.972+0000 7ff510a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff50c162210 0x7ff50c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.972+0000 7ff510a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c0d3e30 con 0x7ff50c162210 2024-04-20T21:21:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.972+0000 7ff510a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c0b5ee0 con 0x7ff50c0b6400 2024-04-20T21:21:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.972+0000 7ff510a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff50c0d3120 con 0x7ff50c15e770 2024-04-20T21:21:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.972+0000 7ff50be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff50c162210 0x7ff50c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.972+0000 7ff50be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff50c162210 0x7ff50c15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34626/0 (socket says 172.21.15.71:34626) 2024-04-20T21:21:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.972+0000 7ff50be00640 1 -- 172.21.15.71:0/3061345792 learned_addr learned my addr 172.21.15.71:0/3061345792 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.973+0000 7ff50be00640 1 -- 172.21.15.71:0/3061345792 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff50c15e770 msgr2=0x7ff50c15c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.973+0000 7ff50be00640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff50c15e770 0x7ff50c15c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.973+0000 7ff50be00640 1 -- 172.21.15.71:0/3061345792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff50c0b6400 msgr2=0x7ff50c15f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.973+0000 7ff50be00640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff50c0b6400 0x7ff50c15f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.973+0000 7ff50be00640 1 -- 172.21.15.71:0/3061345792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c1e7cc0 con 0x7ff50c162210 2024-04-20T21:21:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.973+0000 7ff50be00640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff50c162210 0x7ff50c15ca70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff504009f40 tx=0x7ff504004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:07.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.973+0000 7ff503e00640 1 -- 172.21.15.71:0/3061345792 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504043020 con 0x7ff50c162210 2024-04-20T21:21:07.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.973+0000 7ff503e00640 1 -- 172.21.15.71:0/3061345792 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50403e450 con 0x7ff50c162210 2024-04-20T21:21:07.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.973+0000 7ff510a00640 1 -- 172.21.15.71:0/3061345792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50c1e7fa0 con 0x7ff50c162210 2024-04-20T21:21:07.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.973+0000 7ff503e00640 1 -- 172.21.15.71:0/3061345792 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50403e820 con 0x7ff50c162210 2024-04-20T21:21:07.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.973+0000 7ff510a00640 1 -- 172.21.15.71:0/3061345792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50c15ff20 con 0x7ff50c162210 2024-04-20T21:21:07.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.975+0000 7ff510a00640 1 -- 172.21.15.71:0/3061345792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50c075b30 con 0x7ff50c162210 2024-04-20T21:21:07.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.975+0000 7ff503e00640 1 -- 172.21.15.71:0/3061345792 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff504046020 con 0x7ff50c162210 2024-04-20T21:21:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.976+0000 7ff503e00640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff4e806c8f0 0x7ff4e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.976+0000 7ff503e00640 1 -- 172.21.15.71:0/3061345792 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7ff5040ae3c0 con 0x7ff50c162210 2024-04-20T21:21:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.976+0000 7ff50b400640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff4e806c8f0 0x7ff4e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.977+0000 7ff50b400640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff4e806c8f0 0x7ff4e806edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc001560 tx=0x7ff4fc007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:07.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:07.982+0000 7ff503e00640 1 -- 172.21.15.71:0/3061345792 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff50404d030 con 0x7ff50c162210 2024-04-20T21:21:08.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.249+0000 7ff510a00640 1 -- 172.21.15.71:0/3061345792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7ff50c0cb170 con 0x7ff50c162210 2024-04-20T21:21:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.254+0000 7ff503e00640 1 -- 172.21.15.71:0/3061345792 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7ff50407c910 con 0x7ff50c162210 2024-04-20T21:21:08.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.256+0000 7ff510a00640 1 -- 172.21.15.71:0/3061345792 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff4e806c8f0 msgr2=0x7ff4e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.256+0000 7ff510a00640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff4e806c8f0 0x7ff4e806edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc001560 tx=0x7ff4fc007990 comp rx=0 tx=0).stop 2024-04-20T21:21:08.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.256+0000 7ff510a00640 1 -- 172.21.15.71:0/3061345792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff50c162210 msgr2=0x7ff50c15ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.256+0000 7ff510a00640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff50c162210 0x7ff50c15ca70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff504009f40 tx=0x7ff504004a40 comp rx=0 tx=0).stop 2024-04-20T21:21:08.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.256+0000 7ff510a00640 1 -- 172.21.15.71:0/3061345792 shutdown_connections 2024-04-20T21:21:08.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.256+0000 7ff510a00640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7ff4e806c8f0 0x7ff4e806edb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.256+0000 7ff510a00640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff50c162210 0x7ff50c15ca70 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.256+0000 7ff510a00640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff50c15e770 0x7ff50c15c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.256+0000 7ff510a00640 1 --2- 172.21.15.71:0/3061345792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff50c0b6400 0x7ff50c15f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.256+0000 7ff510a00640 1 -- 172.21.15.71:0/3061345792 >> 172.21.15.71:0/3061345792 conn(0x7ff50c09d6d0 msgr2=0x7ff50c0b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:08.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.256+0000 7ff510a00640 1 -- 172.21.15.71:0/3061345792 shutdown_connections 2024-04-20T21:21:08.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.257+0000 7ff510a00640 1 -- 172.21.15.71:0/3061345792 wait complete. 2024-04-20T21:21:08.273 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-20T21:21:08.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.467+0000 7f9ce6800640 1 Processor -- start 2024-04-20T21:21:08.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.468+0000 7f9ce6800640 1 -- start start 2024-04-20T21:21:08.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce6800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ce0161b40 0x7f9ce00c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce6800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9ce00ae3e0 0x7f9ce00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce6800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ce00cdea0 0x7f9ce01620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce6800640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce00aded0 con 0x7f9ce00cdea0 2024-04-20T21:21:08.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce6800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce00ad2c0 con 0x7f9ce00ae3e0 2024-04-20T21:21:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce6800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce00ad5a0 con 0x7f9ce0161b40 2024-04-20T21:21:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce5e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ce00cdea0 0x7f9ce01620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce5e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ce00cdea0 0x7f9ce01620d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34636/0 (socket says 172.21.15.71:34636) 2024-04-20T21:21:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce5e00640 1 -- 172.21.15.71:0/404748713 learned_addr learned my addr 172.21.15.71:0/404748713 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce5400640 1 --2- 172.21.15.71:0/404748713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ce0161b40 0x7f9ce00c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce5e00640 1 -- 172.21.15.71:0/404748713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ce0161b40 msgr2=0x7f9ce00c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:08.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce5e00640 1 --2- 172.21.15.71:0/404748713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ce0161b40 0x7f9ce00c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce5e00640 1 -- 172.21.15.71:0/404748713 >> v2:172.21.15.137:3300/0 conn(0x7f9ce00ae3e0 msgr2=0x7f9ce00c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce4a00640 1 --2- 172.21.15.71:0/404748713 >> v2:172.21.15.137:3300/0 conn(0x7f9ce00ae3e0 0x7f9ce00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce5e00640 1 --2- 172.21.15.71:0/404748713 >> v2:172.21.15.137:3300/0 conn(0x7f9ce00ae3e0 0x7f9ce00c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.470+0000 7f9ce5e00640 1 -- 172.21.15.71:0/404748713 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce00ad880 con 0x7f9ce00cdea0 2024-04-20T21:21:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.471+0000 7f9ce5e00640 1 --2- 172.21.15.71:0/404748713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce00cdea0 0x7f9ce01620d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9ce006d6b0 tx=0x7f9cd802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e18a4afef9d3f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.471+0000 7f9cdfe00640 1 -- 172.21.15.71:0/404748713 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd802ca70 con 0x7f9ce00cdea0 2024-04-20T21:21:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.471+0000 7f9cdfe00640 1 -- 172.21.15.71:0/404748713 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd802cc10 con 0x7f9ce00cdea0 2024-04-20T21:21:08.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.471+0000 7f9cdfe00640 1 -- 172.21.15.71:0/404748713 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80343f0 con 0x7f9ce00cdea0 2024-04-20T21:21:08.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.472+0000 7f9ce6800640 1 -- 172.21.15.71:0/404748713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce00cdea0 msgr2=0x7f9ce01620d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.472+0000 7f9ce6800640 1 --2- 172.21.15.71:0/404748713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce00cdea0 0x7f9ce01620d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9ce006d6b0 tx=0x7f9cd802bed0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.472+0000 7f9ce6800640 1 -- 172.21.15.71:0/404748713 shutdown_connections 2024-04-20T21:21:08.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.472+0000 7f9ce6800640 1 --2- 172.21.15.71:0/404748713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce00cdea0 0x7f9ce01620d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.472+0000 7f9ce6800640 1 --2- 172.21.15.71:0/404748713 >> v2:172.21.15.137:3300/0 conn(0x7f9ce00ae3e0 0x7f9ce00c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.472+0000 7f9ce6800640 1 --2- 172.21.15.71:0/404748713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ce0161b40 0x7f9ce00c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.472+0000 7f9ce6800640 1 -- 172.21.15.71:0/404748713 >> 172.21.15.71:0/404748713 conn(0x7f9ce00cffa0 msgr2=0x7f9ce00d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.472+0000 7f9ce6800640 1 -- 172.21.15.71:0/404748713 shutdown_connections 2024-04-20T21:21:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.472+0000 7f9ce6800640 1 -- 172.21.15.71:0/404748713 wait complete. 2024-04-20T21:21:08.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.475+0000 7f9ce6800640 1 Processor -- start 2024-04-20T21:21:08.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.475+0000 7f9ce6800640 1 -- start start 2024-04-20T21:21:08.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ce00ae3e0 0x7f9ce01f8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce6800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ce00cdea0 0x7f9ce015a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce0161b40 0x7f9ce0152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce6800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0162610 con 0x7f9ce0161b40 2024-04-20T21:21:08.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce6800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00acf50 con 0x7f9ce00ae3e0 2024-04-20T21:21:08.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce6800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce0162790 con 0x7f9ce00cdea0 2024-04-20T21:21:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce0161b40 0x7f9ce0152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce0161b40 0x7f9ce0152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34640/0 (socket says 172.21.15.71:34640) 2024-04-20T21:21:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce5e00640 1 -- 172.21.15.71:0/446177457 learned_addr learned my addr 172.21.15.71:0/446177457 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce5e00640 1 -- 172.21.15.71:0/446177457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ce00cdea0 msgr2=0x7f9ce015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce5e00640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ce00cdea0 0x7f9ce015a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce5e00640 1 -- 172.21.15.71:0/446177457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ce00ae3e0 msgr2=0x7f9ce01f8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce5e00640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ce00ae3e0 0x7f9ce01f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce5e00640 1 -- 172.21.15.71:0/446177457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce0153090 con 0x7f9ce0161b40 2024-04-20T21:21:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce5e00640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce0161b40 0x7f9ce0152b50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009f40 tx=0x7f9cd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9cdd600640 1 -- 172.21.15.71:0/446177457 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8043020 con 0x7f9ce0161b40 2024-04-20T21:21:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9cdd600640 1 -- 172.21.15.71:0/446177457 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd803e450 con 0x7f9ce0161b40 2024-04-20T21:21:08.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9cdd600640 1 -- 172.21.15.71:0/446177457 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8009510 con 0x7f9ce0161b40 2024-04-20T21:21:08.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce6800640 1 -- 172.21.15.71:0/446177457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce015b0d0 con 0x7f9ce0161b40 2024-04-20T21:21:08.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.476+0000 7f9ce6800640 1 -- 172.21.15.71:0/446177457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce015ab10 con 0x7f9ce0161b40 2024-04-20T21:21:08.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.477+0000 7f9ce6800640 1 -- 172.21.15.71:0/446177457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce0075b30 con 0x7f9ce0161b40 2024-04-20T21:21:08.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.478+0000 7f9cdd600640 1 -- 172.21.15.71:0/446177457 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9cd8046020 con 0x7f9ce0161b40 2024-04-20T21:21:08.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.479+0000 7f9cdd600640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9cc006c8f0 0x7f9cc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.479+0000 7f9cdd600640 1 -- 172.21.15.71:0/446177457 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9cd80ae260 con 0x7f9ce0161b40 2024-04-20T21:21:08.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.479+0000 7f9ce5400640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9cc006c8f0 0x7f9cc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.480+0000 7f9ce5400640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9cc006c8f0 0x7f9cc006edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4006fd0 tx=0x7f9cd4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.484+0000 7f9cdd600640 1 -- 172.21.15.71:0/446177457 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9cd804d030 con 0x7f9ce0161b40 2024-04-20T21:21:08.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.759+0000 7f9ce6800640 1 -- 172.21.15.71:0/446177457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f9ce00ae110 con 0x7f9ce0161b40 2024-04-20T21:21:08.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.762+0000 7f9cdd600640 1 -- 172.21.15.71:0/446177457 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f9ce0153090 con 0x7f9ce0161b40 2024-04-20T21:21:08.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 -- 172.21.15.71:0/446177457 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9cc006c8f0 msgr2=0x7f9cc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9cc006c8f0 0x7f9cc006edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4006fd0 tx=0x7f9cd4008040 comp rx=0 tx=0).stop 2024-04-20T21:21:08.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 -- 172.21.15.71:0/446177457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce0161b40 msgr2=0x7f9ce0152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce0161b40 0x7f9ce0152b50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009f40 tx=0x7f9cd8004a40 comp rx=0 tx=0).stop 2024-04-20T21:21:08.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 -- 172.21.15.71:0/446177457 shutdown_connections 2024-04-20T21:21:08.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f9cc006c8f0 0x7f9cc006edb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce0161b40 0x7f9ce0152b50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ce00cdea0 0x7f9ce015a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 --2- 172.21.15.71:0/446177457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ce00ae3e0 0x7f9ce01f8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 -- 172.21.15.71:0/446177457 >> 172.21.15.71:0/446177457 conn(0x7f9ce00cffa0 msgr2=0x7f9ce00d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:08.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 -- 172.21.15.71:0/446177457 shutdown_connections 2024-04-20T21:21:08.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.765+0000 7f9ce6800640 1 -- 172.21.15.71:0/446177457 wait complete. 2024-04-20T21:21:08.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-20T21:21:08.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.985+0000 7fa19fc00640 1 Processor -- start 2024-04-20T21:21:08.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.986+0000 7fa19fc00640 1 -- start start 2024-04-20T21:21:08.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.987+0000 7fa19fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1980b5340 0x7fa198167210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.987+0000 7fa19fc00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa198145c10 con 0x7fa1980b6160 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.987+0000 7fa19fc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1980cbb20 con 0x7fa198145830 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.987+0000 7fa19fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa19815caf0 con 0x7fa1980b5340 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.987+0000 7fa197e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa1980b6160 0x7fa1980b4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57486/0 (socket says 172.21.15.71:57486) 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.987+0000 7fa197e00640 1 -- 172.21.15.71:0/3895795378 learned_addr learned my addr 172.21.15.71:0/3895795378 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa19dc00640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1980b5340 0x7fa198167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443305227 0 0) 0x7fa198145c10 con 0x7fa1980b6160 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa178003520 con 0x7fa1980b6160 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3807670199 0 0) 0x7fa178003520 con 0x7fa1980b6160 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1980b5340 msgr2=0x7fa198167210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1980b5340 0x7fa198167210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 >> v1:172.21.15.137:6789/0 conn(0x7fa198145830 legacy=0x7fa1980b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1980cbe00 con 0x7fa1980b6160 2024-04-20T21:21:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fa1800019f0 con 0x7fa1980b6160 2024-04-20T21:21:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 >> v1:172.21.15.71:6789/0 conn(0x7fa1980b6160 legacy=0x7fa1980b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1780039e0 0x7fa178003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1980b5340 0x7fa178004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa178004d40 0x7fa1780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa19815caf0 con 0x7fa178004d40 2024-04-20T21:21:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa17800bb50 con 0x7fa1780039e0 2024-04-20T21:21:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.988+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa17800bd20 con 0x7fa1980b5340 2024-04-20T21:21:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.989+0000 7fa19dc00640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa178004d40 0x7fa1780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.989+0000 7fa197e00640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1980b5340 0x7fa178004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.989+0000 7fa19dc00640 1 -- 172.21.15.71:0/3895795378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1980b5340 msgr2=0x7fa178004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.989+0000 7fa19d200640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1780039e0 0x7fa178003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.989+0000 7fa19dc00640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1980b5340 0x7fa178004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.989+0000 7fa19dc00640 1 -- 172.21.15.71:0/3895795378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1780039e0 msgr2=0x7fa178003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.989+0000 7fa19dc00640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1780039e0 0x7fa178003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.989+0000 7fa19dc00640 1 -- 172.21.15.71:0/3895795378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa178003520 con 0x7fa178004d40 2024-04-20T21:21:08.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.990+0000 7fa19dc00640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa178004d40 0x7fa1780051c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa19000ba60 tx=0x7fa178005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9641295ec706ca5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:08.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.990+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190036020 con 0x7fa178004d40 2024-04-20T21:21:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.990+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa190032630 con 0x7fa178004d40 2024-04-20T21:21:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.990+0000 7fa197400640 1 -- 172.21.15.71:0/3895795378 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19000b600 con 0x7fa178004d40 2024-04-20T21:21:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.991+0000 7fa19fc00640 1 -- 172.21.15.71:0/3895795378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa178004d40 msgr2=0x7fa1780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.991+0000 7fa19fc00640 1 --2- 172.21.15.71:0/3895795378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa178004d40 0x7fa1780051c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa19000ba60 tx=0x7fa178005830 comp rx=0 tx=0).stop 2024-04-20T21:21:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.991+0000 7fa19dc00640 1 -- 172.21.15.71:0/3895795378 reap_dead start 2024-04-20T21:21:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.991+0000 7fa19fc00640 1 -- 172.21.15.71:0/3895795378 shutdown_connections 2024-04-20T21:21:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.991+0000 7fa19fc00640 1 -- 172.21.15.71:0/3895795378 >> 172.21.15.71:0/3895795378 conn(0x7fa198070390 msgr2=0x7fa1980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.991+0000 7fa19fc00640 1 -- 172.21.15.71:0/3895795378 shutdown_connections 2024-04-20T21:21:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.991+0000 7fa19fc00640 1 -- 172.21.15.71:0/3895795378 wait complete. 2024-04-20T21:21:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.993+0000 7fa19fc00640 1 Processor -- start 2024-04-20T21:21:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.993+0000 7fa19fc00640 1 -- start start 2024-04-20T21:21:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.994+0000 7fa19fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa178004d40 0x7fa19806f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.994+0000 7fa19fc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1980cee90 0x7fa1980d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.994+0000 7fa19fc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19815fed0 0x7fa198160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.994+0000 7fa19fc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa1980cd8f0 con 0x7fa19815fed0 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.994+0000 7fa19fc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa1980cc3c0 con 0x7fa1980cee90 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.994+0000 7fa19fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa1980cda70 con 0x7fa178004d40 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.994+0000 7fa19dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19815fed0 0x7fa198160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.994+0000 7fa19dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19815fed0 0x7fa198160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34652/0 (socket says 172.21.15.71:34652) 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.994+0000 7fa19dc00640 1 -- 172.21.15.71:0/1407600484 learned_addr learned my addr 172.21.15.71:0/1407600484 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa19d200640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa178004d40 0x7fa19806f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa19dc00640 1 -- 172.21.15.71:0/1407600484 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa178004d40 msgr2=0x7fa19806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa19dc00640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa178004d40 0x7fa19806f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa197e00640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1980cee90 0x7fa1980d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa19dc00640 1 -- 172.21.15.71:0/1407600484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1980cee90 msgr2=0x7fa1980d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa19dc00640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1980cee90 0x7fa1980d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa19dc00640 1 -- 172.21.15.71:0/1407600484 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19806e290 con 0x7fa19815fed0 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa19dc00640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19815fed0 0x7fa198160350 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa19000bb80 tx=0x7fa190004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa194c00640 1 -- 172.21.15.71:0/1407600484 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190036040 con 0x7fa19815fed0 2024-04-20T21:21:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa194c00640 1 -- 172.21.15.71:0/1407600484 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa19003f070 con 0x7fa19815fed0 2024-04-20T21:21:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa194c00640 1 -- 172.21.15.71:0/1407600484 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19000b600 con 0x7fa19815fed0 2024-04-20T21:21:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.995+0000 7fa19fc00640 1 -- 172.21.15.71:0/1407600484 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19806e570 con 0x7fa19815fed0 2024-04-20T21:21:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.996+0000 7fa19fc00640 1 -- 172.21.15.71:0/1407600484 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa19806eb30 con 0x7fa19815fed0 2024-04-20T21:21:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.997+0000 7fa19fc00640 1 -- 172.21.15.71:0/1407600484 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa198069090 con 0x7fa19815fed0 2024-04-20T21:21:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.997+0000 7fa194c00640 1 -- 172.21.15.71:0/1407600484 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa190039020 con 0x7fa19815fed0 2024-04-20T21:21:08.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.998+0000 7fa194c00640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa17406c8f0 0x7fa17406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:08.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.998+0000 7fa194c00640 1 -- 172.21.15.71:0/1407600484 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fa1900adbc0 con 0x7fa19815fed0 2024-04-20T21:21:08.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.999+0000 7fa19d200640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa17406c8f0 0x7fa17406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:08.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:08.999+0000 7fa19d200640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa17406c8f0 0x7fa17406edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa188001590 tx=0x7fa188009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:09.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.003+0000 7fa194c00640 1 -- 172.21.15.71:0/1407600484 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa19004b020 con 0x7fa19815fed0 2024-04-20T21:21:09.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.276+0000 7fa19fc00640 1 -- 172.21.15.71:0/1407600484 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fa1980b4960 con 0x7fa19815fed0 2024-04-20T21:21:09.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.280+0000 7fa194c00640 1 -- 172.21.15.71:0/1407600484 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fa19002fe20 con 0x7fa19815fed0 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.282+0000 7fa19fc00640 1 -- 172.21.15.71:0/1407600484 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa17406c8f0 msgr2=0x7fa17406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.282+0000 7fa19fc00640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa17406c8f0 0x7fa17406edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa188001590 tx=0x7fa188009040 comp rx=0 tx=0).stop 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.282+0000 7fa19fc00640 1 -- 172.21.15.71:0/1407600484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19815fed0 msgr2=0x7fa198160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.282+0000 7fa19fc00640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19815fed0 0x7fa198160350 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa19000bb80 tx=0x7fa190004730 comp rx=0 tx=0).stop 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.283+0000 7fa19fc00640 1 -- 172.21.15.71:0/1407600484 shutdown_connections 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.283+0000 7fa19fc00640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa17406c8f0 0x7fa17406edb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.283+0000 7fa19fc00640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa19815fed0 0x7fa198160350 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.283+0000 7fa19fc00640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1980cee90 0x7fa1980d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.283+0000 7fa19fc00640 1 --2- 172.21.15.71:0/1407600484 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa178004d40 0x7fa19806f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.283+0000 7fa19fc00640 1 -- 172.21.15.71:0/1407600484 >> 172.21.15.71:0/1407600484 conn(0x7fa198070390 msgr2=0x7fa1980b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.283+0000 7fa19fc00640 1 -- 172.21.15.71:0/1407600484 shutdown_connections 2024-04-20T21:21:09.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.283+0000 7fa19fc00640 1 -- 172.21.15.71:0/1407600484 wait complete. 2024-04-20T21:21:09.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-20T21:21:09.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.500+0000 7f3a08e00640 1 Processor -- start 2024-04-20T21:21:09.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.500+0000 7f3a08e00640 1 -- start start 2024-04-20T21:21:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.501+0000 7f3a08e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3a040af800 0x7f3a0415abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.501+0000 7f3a08e00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a040ae9b0 con 0x7f3a04071b50 2024-04-20T21:21:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.501+0000 7f3a08e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a0406e840 con 0x7f3a040725b0 2024-04-20T21:21:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.501+0000 7f3a08e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3a040d0a70 con 0x7f3a040af800 2024-04-20T21:21:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.502+0000 7f3a01e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3a04071b50 0x7f3a040d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57490/0 (socket says 172.21.15.71:57490) 2024-04-20T21:21:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.502+0000 7f3a01e00640 1 -- 172.21.15.71:0/2859292188 learned_addr learned my addr 172.21.15.71:0/2859292188 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.502+0000 7f39f9400640 1 --2- 172.21.15.71:0/2859292188 >> v2:172.21.15.71:3300/0 conn(0x7f3a040af800 0x7f3a0415abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:09.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.502+0000 7f39f9400640 1 -- 172.21.15.71:0/2859292188 >> v1:172.21.15.137:6789/0 conn(0x7f3a040725b0 legacy=0x7f3a040729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:09.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.502+0000 7f39f9400640 1 -- 172.21.15.71:0/2859292188 >> v1:172.21.15.71:6789/0 conn(0x7f3a04071b50 legacy=0x7f3a040d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:09.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.502+0000 7f39f9400640 1 -- 172.21.15.71:0/2859292188 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0415b350 con 0x7f3a040af800 2024-04-20T21:21:09.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.503+0000 7f39f9400640 1 --2- 172.21.15.71:0/2859292188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a040af800 0x7f3a0415abb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0097a0 tx=0x7f39ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29c987c634edff4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:09.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.503+0000 7f3a01400640 1 -- 172.21.15.71:0/2859292188 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec035020 con 0x7f3a040af800 2024-04-20T21:21:09.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.504+0000 7f3a01400640 1 -- 172.21.15.71:0/2859292188 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec031830 con 0x7f3a040af800 2024-04-20T21:21:09.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.504+0000 7f3a01400640 1 -- 172.21.15.71:0/2859292188 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec031c00 con 0x7f3a040af800 2024-04-20T21:21:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.504+0000 7f3a08e00640 1 -- 172.21.15.71:0/2859292188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a040af800 msgr2=0x7f3a0415abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.504+0000 7f3a08e00640 1 --2- 172.21.15.71:0/2859292188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a040af800 0x7f3a0415abb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0097a0 tx=0x7f39ec02b8d0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.504+0000 7f3a08e00640 1 -- 172.21.15.71:0/2859292188 shutdown_connections 2024-04-20T21:21:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.504+0000 7f3a08e00640 1 --2- 172.21.15.71:0/2859292188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a040af800 0x7f3a0415abb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.504+0000 7f3a08e00640 1 -- 172.21.15.71:0/2859292188 >> 172.21.15.71:0/2859292188 conn(0x7f3a040b3350 msgr2=0x7f3a040b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.504+0000 7f3a08e00640 1 -- 172.21.15.71:0/2859292188 shutdown_connections 2024-04-20T21:21:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.505+0000 7f3a08e00640 1 -- 172.21.15.71:0/2859292188 wait complete. 2024-04-20T21:21:09.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.506+0000 7f3a08e00640 1 Processor -- start 2024-04-20T21:21:09.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.506+0000 7f3a08e00640 1 -- start start 2024-04-20T21:21:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.507+0000 7f3a08e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a04071b50 0x7f3a04151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.507+0000 7f3a08e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a040725b0 0x7f3a0409cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.507+0000 7f3a08e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a040af800 0x7f3a0406b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.507+0000 7f3a08e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0415bf60 con 0x7f3a040725b0 2024-04-20T21:21:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.507+0000 7f3a08e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0415b0f0 con 0x7f3a04071b50 2024-04-20T21:21:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.507+0000 7f3a08e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3a0415b910 con 0x7f3a040af800 2024-04-20T21:21:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.507+0000 7f39f9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a040725b0 0x7f3a0409cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.508+0000 7f39f9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a040725b0 0x7f3a0409cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34678/0 (socket says 172.21.15.71:34678) 2024-04-20T21:21:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.508+0000 7f39f9400640 1 -- 172.21.15.71:0/1447928532 learned_addr learned my addr 172.21.15.71:0/1447928532 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.508+0000 7f3a02800640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a040af800 0x7f3a0406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.508+0000 7f3a01e00640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a04071b50 0x7f3a04151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.508+0000 7f39f9400640 1 -- 172.21.15.71:0/1447928532 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a040af800 msgr2=0x7f3a0406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.508+0000 7f39f9400640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a040af800 0x7f3a0406b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.508+0000 7f39f9400640 1 -- 172.21.15.71:0/1447928532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a04071b50 msgr2=0x7f3a04151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.508+0000 7f39f9400640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a04071b50 0x7f3a04151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.508+0000 7f39f9400640 1 -- 172.21.15.71:0/1447928532 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0409e1c0 con 0x7f3a040725b0 2024-04-20T21:21:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.508+0000 7f39f9400640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a040725b0 0x7f3a0409cd20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f39ec000c00 tx=0x7f39ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.509+0000 7f39faa00640 1 -- 172.21.15.71:0/1447928532 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec040070 con 0x7f3a040725b0 2024-04-20T21:21:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.509+0000 7f39faa00640 1 -- 172.21.15.71:0/1447928532 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec039a00 con 0x7f3a040725b0 2024-04-20T21:21:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.509+0000 7f3a08e00640 1 -- 172.21.15.71:0/1447928532 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0409d640 con 0x7f3a040725b0 2024-04-20T21:21:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.509+0000 7f39faa00640 1 -- 172.21.15.71:0/1447928532 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec035040 con 0x7f3a040725b0 2024-04-20T21:21:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.509+0000 7f3a08e00640 1 -- 172.21.15.71:0/1447928532 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a0409dc00 con 0x7f3a040725b0 2024-04-20T21:21:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.510+0000 7f3a08e00640 1 -- 172.21.15.71:0/1447928532 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a04068980 con 0x7f3a040725b0 2024-04-20T21:21:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.511+0000 7f39faa00640 1 -- 172.21.15.71:0/1447928532 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39ec04b060 con 0x7f3a040725b0 2024-04-20T21:21:09.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.512+0000 7f39faa00640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f39e006c940 0x7f39e006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:09.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.512+0000 7f39faa00640 1 -- 172.21.15.71:0/1447928532 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f39ec0ad2b0 con 0x7f3a040725b0 2024-04-20T21:21:09.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.512+0000 7f3a01e00640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f39e006c940 0x7f39e006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:09.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.513+0000 7f3a01e00640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f39e006c940 0x7f39e006ee00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3a040d1080 tx=0x7f39f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:09.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.516+0000 7f39faa00640 1 -- 172.21.15.71:0/1447928532 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f39ec07b990 con 0x7f3a040725b0 2024-04-20T21:21:09.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.778+0000 7f3a08e00640 1 -- 172.21.15.71:0/1447928532 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f3a0406ea80 con 0x7f3a040725b0 2024-04-20T21:21:09.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.782+0000 7f39faa00640 1 -- 172.21.15.71:0/1447928532 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f39ec07b290 con 0x7f3a040725b0 2024-04-20T21:21:09.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.785+0000 7f3a08e00640 1 -- 172.21.15.71:0/1447928532 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f39e006c940 msgr2=0x7f39e006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:09.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.785+0000 7f3a08e00640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f39e006c940 0x7f39e006ee00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3a040d1080 tx=0x7f39f4009040 comp rx=0 tx=0).stop 2024-04-20T21:21:09.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.785+0000 7f3a08e00640 1 -- 172.21.15.71:0/1447928532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a040725b0 msgr2=0x7f3a0409cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:09.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.785+0000 7f3a08e00640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a040725b0 0x7f3a0409cd20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f39ec000c00 tx=0x7f39ec0046c0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.785+0000 7f3a08e00640 1 -- 172.21.15.71:0/1447928532 shutdown_connections 2024-04-20T21:21:09.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.786+0000 7f3a08e00640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f39e006c940 0x7f39e006ee00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.786+0000 7f3a08e00640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a040af800 0x7f3a0406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.786+0000 7f3a08e00640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a040725b0 0x7f3a0409cd20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.786+0000 7f3a08e00640 1 --2- 172.21.15.71:0/1447928532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a04071b50 0x7f3a04151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.786+0000 7f3a08e00640 1 -- 172.21.15.71:0/1447928532 >> 172.21.15.71:0/1447928532 conn(0x7f3a040b3350 msgr2=0x7f3a04156fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:09.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.786+0000 7f3a08e00640 1 -- 172.21.15.71:0/1447928532 shutdown_connections 2024-04-20T21:21:09.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.786+0000 7f3a08e00640 1 -- 172.21.15.71:0/1447928532 wait complete. 2024-04-20T21:21:09.802 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-20T21:21:09.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.997+0000 7fd535a00640 1 Processor -- start 2024-04-20T21:21:09.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.998+0000 7fd535a00640 1 -- start start 2024-04-20T21:21:09.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.999+0000 7fd535a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd530156c20 0x7fd53006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:09.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.999+0000 7fd535a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5300d0360 0x7fd5300d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:09.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.999+0000 7fd535a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd530141c60 con 0x7fd53015ca40 2024-04-20T21:21:09.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.999+0000 7fd535a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd5300adab0 con 0x7fd530156c20 2024-04-20T21:21:09.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.999+0000 7fd535a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd53015cf90 con 0x7fd5300d0360 2024-04-20T21:21:09.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.999+0000 7fd52ea00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd530156c20 0x7fd53006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:09.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.999+0000 7fd52ea00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd530156c20 0x7fd53006b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34680/0 (socket says 172.21.15.71:34680) 2024-04-20T21:21:09.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:09.999+0000 7fd52ea00640 1 -- 172.21.15.71:0/3887365275 learned_addr learned my addr 172.21.15.71:0/3887365275 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:09.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.000+0000 7fd52ea00640 1 -- 172.21.15.71:0/3887365275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5300d0360 msgr2=0x7fd5300d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:09.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.000+0000 7fd52ea00640 1 --2- 172.21.15.71:0/3887365275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5300d0360 0x7fd5300d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:09.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.000+0000 7fd52ea00640 1 -- 172.21.15.71:0/3887365275 >> v1:172.21.15.137:6789/0 conn(0x7fd53015ca40 legacy=0x7fd5300ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:09.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.000+0000 7fd52ea00640 1 -- 172.21.15.71:0/3887365275 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53015d270 con 0x7fd530156c20 2024-04-20T21:21:10.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.001+0000 7fd52ea00640 1 --2- 172.21.15.71:0/3887365275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd530156c20 0x7fd53006b900 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd520009870 tx=0x7fd52002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d9ac6f4a2af8e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:10.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.001+0000 7fd52d600640 1 -- 172.21.15.71:0/3887365275 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520035020 con 0x7fd530156c20 2024-04-20T21:21:10.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.001+0000 7fd52d600640 1 -- 172.21.15.71:0/3887365275 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd520031640 con 0x7fd530156c20 2024-04-20T21:21:10.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.001+0000 7fd52d600640 1 -- 172.21.15.71:0/3887365275 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52002d040 con 0x7fd530156c20 2024-04-20T21:21:10.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.002+0000 7fd535a00640 1 -- 172.21.15.71:0/3887365275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd530156c20 msgr2=0x7fd53006b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.002+0000 7fd535a00640 1 --2- 172.21.15.71:0/3887365275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd530156c20 0x7fd53006b900 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd520009870 tx=0x7fd52002b8f0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.002+0000 7fd535a00640 1 -- 172.21.15.71:0/3887365275 shutdown_connections 2024-04-20T21:21:10.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.002+0000 7fd535a00640 1 --2- 172.21.15.71:0/3887365275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd5300d0360 0x7fd5300d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.002+0000 7fd535a00640 1 --2- 172.21.15.71:0/3887365275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd530156c20 0x7fd53006b900 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.002+0000 7fd535a00640 1 -- 172.21.15.71:0/3887365275 >> 172.21.15.71:0/3887365275 conn(0x7fd5300b3350 msgr2=0x7fd5300b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:10.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.002+0000 7fd535a00640 1 -- 172.21.15.71:0/3887365275 shutdown_connections 2024-04-20T21:21:10.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.002+0000 7fd535a00640 1 -- 172.21.15.71:0/3887365275 wait complete. 2024-04-20T21:21:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.004+0000 7fd535a00640 1 Processor -- start 2024-04-20T21:21:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.004+0000 7fd535a00640 1 -- start start 2024-04-20T21:21:10.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.005+0000 7fd535a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5300d0360 0x7fd5300cf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.005+0000 7fd535a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd530156c20 0x7fd530151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.005+0000 7fd535a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd53015ca40 0x7fd530142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.005+0000 7fd535a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd53006be40 con 0x7fd5300d0360 2024-04-20T21:21:10.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.005+0000 7fd535a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd53015d830 con 0x7fd53015ca40 2024-04-20T21:21:10.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.005+0000 7fd535a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd53006bfc0 con 0x7fd530156c20 2024-04-20T21:21:10.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.005+0000 7fd52ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5300d0360 0x7fd5300cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:10.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.005+0000 7fd52ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5300d0360 0x7fd5300cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34688/0 (socket says 172.21.15.71:34688) 2024-04-20T21:21:10.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.005+0000 7fd52ea00640 1 -- 172.21.15.71:0/1383788709 learned_addr learned my addr 172.21.15.71:0/1383788709 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.006+0000 7fd52ea00640 1 -- 172.21.15.71:0/1383788709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd530156c20 msgr2=0x7fd530151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.006+0000 7fd52ea00640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd530156c20 0x7fd530151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.006+0000 7fd52ea00640 1 -- 172.21.15.71:0/1383788709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd53015ca40 msgr2=0x7fd530142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.006+0000 7fd52ea00640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd53015ca40 0x7fd530142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.006+0000 7fd52ea00640 1 -- 172.21.15.71:0/1383788709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5301f2e80 con 0x7fd5300d0360 2024-04-20T21:21:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.006+0000 7fd52ea00640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5300d0360 0x7fd5300cf530 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd52002b930 tx=0x7fd5200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.006+0000 7fd526a00640 1 -- 172.21.15.71:0/1383788709 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52003ac60 con 0x7fd5300d0360 2024-04-20T21:21:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.006+0000 7fd526a00640 1 -- 172.21.15.71:0/1383788709 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd52003ae00 con 0x7fd5300d0360 2024-04-20T21:21:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.006+0000 7fd535a00640 1 -- 172.21.15.71:0/1383788709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5301e6010 con 0x7fd5300d0360 2024-04-20T21:21:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.006+0000 7fd526a00640 1 -- 172.21.15.71:0/1383788709 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520044630 con 0x7fd5300d0360 2024-04-20T21:21:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.006+0000 7fd535a00640 1 -- 172.21.15.71:0/1383788709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd530151220 con 0x7fd5300d0360 2024-04-20T21:21:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.007+0000 7fd535a00640 1 -- 172.21.15.71:0/1383788709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd530068980 con 0x7fd5300d0360 2024-04-20T21:21:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.008+0000 7fd526a00640 1 -- 172.21.15.71:0/1383788709 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd520038020 con 0x7fd5300d0360 2024-04-20T21:21:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.009+0000 7fd526a00640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd50c06c8f0 0x7fd50c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.009+0000 7fd526a00640 1 -- 172.21.15.71:0/1383788709 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fd5200ad880 con 0x7fd5300d0360 2024-04-20T21:21:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.009+0000 7fd52e000640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd50c06c8f0 0x7fd50c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.010+0000 7fd52e000640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd50c06c8f0 0x7fd50c06edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd518006fd0 tx=0x7fd518006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:10.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.014+0000 7fd526a00640 1 -- 172.21.15.71:0/1383788709 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd5301f2e80 con 0x7fd5300d0360 2024-04-20T21:21:10.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.289+0000 7fd535a00640 1 -- 172.21.15.71:0/1383788709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fd5300cfd90 con 0x7fd5300d0360 2024-04-20T21:21:10.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.293+0000 7fd526a00640 1 -- 172.21.15.71:0/1383788709 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fd52003f070 con 0x7fd5300d0360 2024-04-20T21:21:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.295+0000 7fd535a00640 1 -- 172.21.15.71:0/1383788709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd50c06c8f0 msgr2=0x7fd50c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.295+0000 7fd535a00640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd50c06c8f0 0x7fd50c06edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd518006fd0 tx=0x7fd518006bc0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.295+0000 7fd535a00640 1 -- 172.21.15.71:0/1383788709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5300d0360 msgr2=0x7fd5300cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.295+0000 7fd535a00640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5300d0360 0x7fd5300cf530 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd52002b930 tx=0x7fd5200046c0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.295+0000 7fd535a00640 1 -- 172.21.15.71:0/1383788709 shutdown_connections 2024-04-20T21:21:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.295+0000 7fd535a00640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fd50c06c8f0 0x7fd50c06edb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.295+0000 7fd535a00640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd53015ca40 0x7fd530142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.295+0000 7fd535a00640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd530156c20 0x7fd530151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.295+0000 7fd535a00640 1 --2- 172.21.15.71:0/1383788709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5300d0360 0x7fd5300cf530 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.295+0000 7fd535a00640 1 -- 172.21.15.71:0/1383788709 >> 172.21.15.71:0/1383788709 conn(0x7fd5300b3350 msgr2=0x7fd5300aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.295+0000 7fd535a00640 1 -- 172.21.15.71:0/1383788709 shutdown_connections 2024-04-20T21:21:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.296+0000 7fd535a00640 1 -- 172.21.15.71:0/1383788709 wait complete. 2024-04-20T21:21:10.313 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:21:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.500+0000 7f7ccbe00640 1 Processor -- start 2024-04-20T21:21:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.500+0000 7f7ccbe00640 1 -- start start 2024-04-20T21:21:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.502+0000 7f7ccbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc4156c20 0x7f7cc406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.502+0000 7f7ccbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7cc415ca40 0x7f7cc40ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.502+0000 7f7ccbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7cc40ad8e0 0x7f7cc40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.502+0000 7f7ccbe00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc4141c60 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.502+0000 7f7ccbe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc415cf90 con 0x7f7cc415ca40 2024-04-20T21:21:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.502+0000 7f7ccbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc415d270 con 0x7f7cc4156c20 2024-04-20T21:21:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.502+0000 7f7cc9e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7cc40ad8e0 0x7f7cc40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.502+0000 7f7cc9e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7cc40ad8e0 0x7f7cc40d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34698/0 (socket says 172.21.15.71:34698) 2024-04-20T21:21:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.502+0000 7f7cc9e00640 1 -- 172.21.15.71:0/2207231142 learned_addr learned my addr 172.21.15.71:0/2207231142 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.502+0000 7f7cc9e00640 1 -- 172.21.15.71:0/2207231142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc4156c20 msgr2=0x7f7cc406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.502+0000 7f7cc9400640 1 --2- 172.21.15.71:0/2207231142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc4156c20 0x7f7cc406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.503+0000 7f7cc8a00640 1 --2- 172.21.15.71:0/2207231142 >> v2:172.21.15.137:3300/0 conn(0x7f7cc415ca40 0x7f7cc40ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.503+0000 7f7cc9e00640 1 --2- 172.21.15.71:0/2207231142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc4156c20 0x7f7cc406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.503+0000 7f7cc9e00640 1 -- 172.21.15.71:0/2207231142 >> v2:172.21.15.137:3300/0 conn(0x7f7cc415ca40 msgr2=0x7f7cc40ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.503+0000 7f7cc9e00640 1 --2- 172.21.15.71:0/2207231142 >> v2:172.21.15.137:3300/0 conn(0x7f7cc415ca40 0x7f7cc40ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.503+0000 7f7cc9e00640 1 -- 172.21.15.71:0/2207231142 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc415d550 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.503+0000 7f7cc9400640 1 --2- 172.21.15.71:0/2207231142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc4156c20 0x7f7cc406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.504+0000 7f7cc9e00640 1 --2- 172.21.15.71:0/2207231142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc40ad8e0 0x7f7cc40d0360 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7cc406fe70 tx=0x7f7cbc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59caf9b2d2b2386 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.504+0000 7f7cc3e00640 1 -- 172.21.15.71:0/2207231142 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc02ca70 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.504+0000 7f7cc3e00640 1 -- 172.21.15.71:0/2207231142 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cbc02cc10 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.504+0000 7f7cc3e00640 1 -- 172.21.15.71:0/2207231142 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0343f0 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.505+0000 7f7ccbe00640 1 -- 172.21.15.71:0/2207231142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc40ad8e0 msgr2=0x7f7cc40d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.505+0000 7f7ccbe00640 1 --2- 172.21.15.71:0/2207231142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc40ad8e0 0x7f7cc40d0360 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7cc406fe70 tx=0x7f7cbc02bed0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.505+0000 7f7ccbe00640 1 -- 172.21.15.71:0/2207231142 shutdown_connections 2024-04-20T21:21:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.505+0000 7f7ccbe00640 1 --2- 172.21.15.71:0/2207231142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc40ad8e0 0x7f7cc40d0360 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.505+0000 7f7ccbe00640 1 --2- 172.21.15.71:0/2207231142 >> v2:172.21.15.137:3300/0 conn(0x7f7cc415ca40 0x7f7cc40ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.505+0000 7f7ccbe00640 1 --2- 172.21.15.71:0/2207231142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc4156c20 0x7f7cc406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.505+0000 7f7ccbe00640 1 -- 172.21.15.71:0/2207231142 >> 172.21.15.71:0/2207231142 conn(0x7f7cc40b3350 msgr2=0x7f7cc40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.505+0000 7f7ccbe00640 1 -- 172.21.15.71:0/2207231142 shutdown_connections 2024-04-20T21:21:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.505+0000 7f7ccbe00640 1 -- 172.21.15.71:0/2207231142 wait complete. 2024-04-20T21:21:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.507+0000 7f7ccbe00640 1 Processor -- start 2024-04-20T21:21:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.507+0000 7f7ccbe00640 1 -- start start 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7ccbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc40ad8e0 0x7f7cc4151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7ccbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc4156c20 0x7f7cc40cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7ccbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc415ca40 0x7f7cc41f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7ccbe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc406bfc0 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7ccbe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc406be40 con 0x7f7cc4156c20 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7ccbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc40d08a0 con 0x7f7cc415ca40 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7cc9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc40ad8e0 0x7f7cc4151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7cc9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc40ad8e0 0x7f7cc4151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34704/0 (socket says 172.21.15.71:34704) 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7cc9400640 1 -- 172.21.15.71:0/3599588907 learned_addr learned my addr 172.21.15.71:0/3599588907 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7cc9400640 1 -- 172.21.15.71:0/3599588907 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc415ca40 msgr2=0x7f7cc41f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7cc9400640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc415ca40 0x7f7cc41f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7cc9400640 1 -- 172.21.15.71:0/3599588907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc4156c20 msgr2=0x7f7cc40cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7cc9400640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc4156c20 0x7f7cc40cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.508+0000 7f7cc9400640 1 -- 172.21.15.71:0/3599588907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc4153af0 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.509+0000 7f7cc9400640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc40ad8e0 0x7f7cc4151670 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800c7c0 tx=0x7f7cb800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.509+0000 7f7cc1600640 1 -- 172.21.15.71:0/3599588907 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8015070 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.509+0000 7f7cc1600640 1 -- 172.21.15.71:0/3599588907 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb8007a30 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.509+0000 7f7cc1600640 1 -- 172.21.15.71:0/3599588907 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8007e00 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.509+0000 7f7ccbe00640 1 -- 172.21.15.71:0/3599588907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc4153dd0 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.509+0000 7f7ccbe00640 1 -- 172.21.15.71:0/3599588907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc4154390 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.510+0000 7f7ccbe00640 1 -- 172.21.15.71:0/3599588907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc41547c0 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.511+0000 7f7cc1600640 1 -- 172.21.15.71:0/3599588907 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7cb8018070 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.513+0000 7f7cc1600640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ca406c8f0 0x7f7ca406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.513+0000 7f7cc1600640 1 -- 172.21.15.71:0/3599588907 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f7cb808ba10 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.513+0000 7f7cc8a00640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ca406c8f0 0x7f7ca406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.514+0000 7f7cc8a00640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ca406c8f0 0x7f7ca406edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7cc41f79d0 tx=0x7f7cb0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.518+0000 7f7cc1600640 1 -- 172.21.15.71:0/3599588907 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7cb8059f10 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.713+0000 7f7ccbe00640 1 -- 172.21.15.71:0/3599588907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cc4068980 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.716+0000 7f7cc1600640 1 -- 172.21.15.71:0/3599588907 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13140 (secure 0 0 0) 0x7f7cb8059810 con 0x7f7cc40ad8e0 2024-04-20T21:21:10.714 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:10.715 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":35,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:21:06.759691+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:21:10.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.718+0000 7f7ccbe00640 1 -- 172.21.15.71:0/3599588907 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ca406c8f0 msgr2=0x7f7ca406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.718+0000 7f7ccbe00640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ca406c8f0 0x7f7ca406edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7cc41f79d0 tx=0x7f7cb0008040 comp rx=0 tx=0).stop 2024-04-20T21:21:10.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.718+0000 7f7ccbe00640 1 -- 172.21.15.71:0/3599588907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc40ad8e0 msgr2=0x7f7cc4151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.718+0000 7f7ccbe00640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc40ad8e0 0x7f7cc4151670 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800c7c0 tx=0x7f7cb800cc80 comp rx=0 tx=0).stop 2024-04-20T21:21:10.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.718+0000 7f7ccbe00640 1 -- 172.21.15.71:0/3599588907 shutdown_connections 2024-04-20T21:21:10.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.718+0000 7f7ccbe00640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7ca406c8f0 0x7f7ca406edb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.718+0000 7f7ccbe00640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc415ca40 0x7f7cc41f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.718+0000 7f7ccbe00640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc4156c20 0x7f7cc40cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.718+0000 7f7ccbe00640 1 --2- 172.21.15.71:0/3599588907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc40ad8e0 0x7f7cc4151670 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.718+0000 7f7ccbe00640 1 -- 172.21.15.71:0/3599588907 >> 172.21.15.71:0/3599588907 conn(0x7f7cc40b3350 msgr2=0x7f7cc41555f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:10.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.718+0000 7f7ccbe00640 1 -- 172.21.15.71:0/3599588907 shutdown_connections 2024-04-20T21:21:10.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.719+0000 7f7ccbe00640 1 -- 172.21.15.71:0/3599588907 wait complete. 2024-04-20T21:21:10.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:19:17.829506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T21:21:10.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:21:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.929+0000 7f406f600640 1 Processor -- start 2024-04-20T21:21:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.929+0000 7f406f600640 1 -- start start 2024-04-20T21:21:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.930+0000 7f406f600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f406815b3b0 0x7f406806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.930+0000 7f406f600640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f406806dcb0 0x7f4068071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.931+0000 7f406f600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40680ade40 con 0x7f4068072090 2024-04-20T21:21:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.931+0000 7f406f600640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f40680ae0e0 con 0x7f406806dcb0 2024-04-20T21:21:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.931+0000 7f406f600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f406815b790 con 0x7f406815b3b0 2024-04-20T21:21:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.931+0000 7f4067e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f406806dcb0 0x7f4068071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.931+0000 7f4067e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f406806dcb0 0x7f4068071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34714/0 (socket says 172.21.15.71:34714) 2024-04-20T21:21:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.931+0000 7f4067e00640 1 -- 172.21.15.71:0/2640871733 learned_addr learned my addr 172.21.15.71:0/2640871733 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.931+0000 7f406cc00640 1 --2- 172.21.15.71:0/2640871733 >> v2:172.21.15.137:3300/0 conn(0x7f406815b3b0 0x7f406806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.931+0000 7f4067e00640 1 -- 172.21.15.71:0/2640871733 >> v2:172.21.15.137:3300/0 conn(0x7f406815b3b0 msgr2=0x7f406806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.932+0000 7f4067e00640 1 --2- 172.21.15.71:0/2640871733 >> v2:172.21.15.137:3300/0 conn(0x7f406815b3b0 0x7f406806eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.932+0000 7f4067e00640 1 -- 172.21.15.71:0/2640871733 >> v1:172.21.15.71:6789/0 conn(0x7f4068072090 legacy=0x7f40680d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.932+0000 7f4067e00640 1 -- 172.21.15.71:0/2640871733 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40680ae380 con 0x7f406806dcb0 2024-04-20T21:21:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.933+0000 7f4067e00640 1 --2- 172.21.15.71:0/2640871733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806dcb0 0x7f4068071b50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f406806cfa0 tx=0x7f405402dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99b414b994e547e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.933+0000 7f4067400640 1 -- 172.21.15.71:0/2640871733 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405403b070 con 0x7f406806dcb0 2024-04-20T21:21:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.933+0000 7f4067400640 1 -- 172.21.15.71:0/2640871733 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405402e960 con 0x7f406806dcb0 2024-04-20T21:21:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.933+0000 7f4067400640 1 -- 172.21.15.71:0/2640871733 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405402ed30 con 0x7f406806dcb0 2024-04-20T21:21:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.934+0000 7f406f600640 1 -- 172.21.15.71:0/2640871733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806dcb0 msgr2=0x7f4068071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.934+0000 7f406f600640 1 --2- 172.21.15.71:0/2640871733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806dcb0 0x7f4068071b50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f406806cfa0 tx=0x7f405402dbb0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.934+0000 7f406f600640 1 -- 172.21.15.71:0/2640871733 shutdown_connections 2024-04-20T21:21:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.934+0000 7f406f600640 1 --2- 172.21.15.71:0/2640871733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806dcb0 0x7f4068071b50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.934+0000 7f406f600640 1 --2- 172.21.15.71:0/2640871733 >> v2:172.21.15.137:3300/0 conn(0x7f406815b3b0 0x7f406806eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.934+0000 7f406f600640 1 -- 172.21.15.71:0/2640871733 >> 172.21.15.71:0/2640871733 conn(0x7f40680b3350 msgr2=0x7f40680b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.934+0000 7f406f600640 1 -- 172.21.15.71:0/2640871733 shutdown_connections 2024-04-20T21:21:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.934+0000 7f406f600640 1 -- 172.21.15.71:0/2640871733 wait complete. 2024-04-20T21:21:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.936+0000 7f406f600640 1 Processor -- start 2024-04-20T21:21:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.936+0000 7f406f600640 1 -- start start 2024-04-20T21:21:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406f600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806dcb0 0x7f4068151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406f600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f406815b3b0 0x7f4068153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406f600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f406815d780 0x7f40681f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406f600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40680aec20 con 0x7f406806dcb0 2024-04-20T21:21:10.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406f600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f40680ae940 con 0x7f406815b3b0 2024-04-20T21:21:10.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406f600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f406806efe0 con 0x7f406815d780 2024-04-20T21:21:10.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806dcb0 0x7f4068151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:10.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806dcb0 0x7f4068151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34724/0 (socket says 172.21.15.71:34724) 2024-04-20T21:21:10.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406cc00640 1 -- 172.21.15.71:0/3483125926 learned_addr learned my addr 172.21.15.71:0/3483125926 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:10.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406cc00640 1 -- 172.21.15.71:0/3483125926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f406815d780 msgr2=0x7f40681f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406cc00640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f406815d780 0x7f40681f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406cc00640 1 -- 172.21.15.71:0/3483125926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f406815b3b0 msgr2=0x7f4068153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:10.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406cc00640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f406815b3b0 0x7f4068153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:10.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.937+0000 7f406cc00640 1 -- 172.21.15.71:0/3483125926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4068151bd0 con 0x7f406806dcb0 2024-04-20T21:21:10.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.938+0000 7f406cc00640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806dcb0 0x7f4068151150 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f405c00d620 tx=0x7f405c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:10.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.938+0000 7f4064c00640 1 -- 172.21.15.71:0/3483125926 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c00b620 con 0x7f406806dcb0 2024-04-20T21:21:10.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.938+0000 7f4064c00640 1 -- 172.21.15.71:0/3483125926 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405c019070 con 0x7f406806dcb0 2024-04-20T21:21:10.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.938+0000 7f406f600640 1 -- 172.21.15.71:0/3483125926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40681518f0 con 0x7f406806dcb0 2024-04-20T21:21:10.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.938+0000 7f4064c00640 1 -- 172.21.15.71:0/3483125926 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c00ba00 con 0x7f406806dcb0 2024-04-20T21:21:10.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.938+0000 7f406f600640 1 -- 172.21.15.71:0/3483125926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40681535c0 con 0x7f406806dcb0 2024-04-20T21:21:10.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.939+0000 7f406f600640 1 -- 172.21.15.71:0/3483125926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4068068980 con 0x7f406806dcb0 2024-04-20T21:21:10.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.940+0000 7f4064c00640 1 -- 172.21.15.71:0/3483125926 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f405c00bba0 con 0x7f406806dcb0 2024-04-20T21:21:10.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.941+0000 7f4064c00640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f404806c8f0 0x7f404806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:10.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.941+0000 7f4064c00640 1 -- 172.21.15.71:0/3483125926 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f405c08be20 con 0x7f406806dcb0 2024-04-20T21:21:10.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.941+0000 7f4067e00640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f404806c8f0 0x7f404806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:10.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.942+0000 7f4067e00640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f404806c8f0 0x7f404806edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4054038000 tx=0x7f4054030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:10.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:10.945+0000 7f4064c00640 1 -- 172.21.15.71:0/3483125926 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f405c05a370 con 0x7f406806dcb0 2024-04-20T21:21:11.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.143+0000 7f406f600640 1 -- 172.21.15.71:0/3483125926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f406806c5d0 con 0x7f406806dcb0 2024-04-20T21:21:11.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.144+0000 7f4064c00640 1 -- 172.21.15.71:0/3483125926 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7f405c060070 con 0x7f406806dcb0 2024-04-20T21:21:11.143 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.146+0000 7f406f600640 1 -- 172.21.15.71:0/3483125926 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f404806c8f0 msgr2=0x7f404806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.147+0000 7f406f600640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f404806c8f0 0x7f404806edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4054038000 tx=0x7f4054030000 comp rx=0 tx=0).stop 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.147+0000 7f406f600640 1 -- 172.21.15.71:0/3483125926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806dcb0 msgr2=0x7f4068151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.147+0000 7f406f600640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806dcb0 0x7f4068151150 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f405c00d620 tx=0x7f405c00dae0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.147+0000 7f406f600640 1 -- 172.21.15.71:0/3483125926 shutdown_connections 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.147+0000 7f406f600640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f404806c8f0 0x7f404806edb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.147+0000 7f406f600640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f406815d780 0x7f40681f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.147+0000 7f406f600640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f406815b3b0 0x7f4068153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.147+0000 7f406f600640 1 --2- 172.21.15.71:0/3483125926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806dcb0 0x7f4068151150 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.147+0000 7f406f600640 1 -- 172.21.15.71:0/3483125926 >> 172.21.15.71:0/3483125926 conn(0x7f40680b3350 msgr2=0x7f4068072580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.147+0000 7f406f600640 1 -- 172.21.15.71:0/3483125926 shutdown_connections 2024-04-20T21:21:11.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.147+0000 7f406f600640 1 -- 172.21.15.71:0/3483125926 wait complete. 2024-04-20T21:21:11.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-20T21:21:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.367+0000 7f2ec0e00640 1 Processor -- start 2024-04-20T21:21:11.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.367+0000 7f2ec0e00640 1 -- start start 2024-04-20T21:21:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.369+0000 7f2ec0e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ebc0b2f70 0x7f2ebc0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.369+0000 7f2ec0e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ebc0adf60 0x7f2ebc15f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.369+0000 7f2ec0e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ebc15faf0 0x7f2ebc06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.369+0000 7f2ec0e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2ebc071a80 con 0x7f2ebc0b2f70 2024-04-20T21:21:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.369+0000 7f2ec0e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2ebc0ae3f0 con 0x7f2ebc0adf60 2024-04-20T21:21:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.369+0000 7f2ec0e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2ebc071cf0 con 0x7f2ebc15faf0 2024-04-20T21:21:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.369+0000 7f2ebb400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ebc0b2f70 0x7f2ebc0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.369+0000 7f2ebb400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ebc0b2f70 0x7f2ebc0b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34740/0 (socket says 172.21.15.71:34740) 2024-04-20T21:21:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.370+0000 7f2ebb400640 1 -- 172.21.15.71:0/3923104477 learned_addr learned my addr 172.21.15.71:0/3923104477 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.370+0000 7f2ebaa00640 1 --2- 172.21.15.71:0/3923104477 >> v2:172.21.15.137:3300/0 conn(0x7f2ebc0adf60 0x7f2ebc15f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.370+0000 7f2ebbe00640 1 --2- 172.21.15.71:0/3923104477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ebc15faf0 0x7f2ebc06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.370+0000 7f2ebb400640 1 -- 172.21.15.71:0/3923104477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ebc15faf0 msgr2=0x7f2ebc06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.370+0000 7f2ebb400640 1 --2- 172.21.15.71:0/3923104477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ebc15faf0 0x7f2ebc06b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.370+0000 7f2ebb400640 1 -- 172.21.15.71:0/3923104477 >> v2:172.21.15.137:3300/0 conn(0x7f2ebc0adf60 msgr2=0x7f2ebc15f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:11.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.370+0000 7f2ebb400640 1 --2- 172.21.15.71:0/3923104477 >> v2:172.21.15.137:3300/0 conn(0x7f2ebc0adf60 0x7f2ebc15f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.370+0000 7f2ebb400640 1 -- 172.21.15.71:0/3923104477 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc071fd0 con 0x7f2ebc0b2f70 2024-04-20T21:21:11.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.370+0000 7f2ebaa00640 1 --2- 172.21.15.71:0/3923104477 >> v2:172.21.15.137:3300/0 conn(0x7f2ebc0adf60 0x7f2ebc15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:21:11.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.372+0000 7f2ebb400640 1 --2- 172.21.15.71:0/3923104477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ebc0b2f70 0x7f2ebc0b4320 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0503d0 tx=0x7f2eac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767090b05695e641 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.372+0000 7f2eba000640 1 -- 172.21.15.71:0/3923104477 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac035020 con 0x7f2ebc0b2f70 2024-04-20T21:21:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.372+0000 7f2eba000640 1 -- 172.21.15.71:0/3923104477 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac031870 con 0x7f2ebc0b2f70 2024-04-20T21:21:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.372+0000 7f2eba000640 1 -- 172.21.15.71:0/3923104477 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac031c40 con 0x7f2ebc0b2f70 2024-04-20T21:21:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.373+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3923104477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ebc0b2f70 msgr2=0x7f2ebc0b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.373+0000 7f2ec0e00640 1 --2- 172.21.15.71:0/3923104477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ebc0b2f70 0x7f2ebc0b4320 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0503d0 tx=0x7f2eac02b910 comp rx=0 tx=0).stop 2024-04-20T21:21:11.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.373+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3923104477 shutdown_connections 2024-04-20T21:21:11.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.373+0000 7f2ec0e00640 1 --2- 172.21.15.71:0/3923104477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ebc15faf0 0x7f2ebc06b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.373+0000 7f2ec0e00640 1 --2- 172.21.15.71:0/3923104477 >> v2:172.21.15.137:3300/0 conn(0x7f2ebc0adf60 0x7f2ebc15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.373+0000 7f2ec0e00640 1 --2- 172.21.15.71:0/3923104477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ebc0b2f70 0x7f2ebc0b4320 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.373+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3923104477 >> 172.21.15.71:0/3923104477 conn(0x7f2ebc0d0040 msgr2=0x7f2ebc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:11.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.373+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3923104477 shutdown_connections 2024-04-20T21:21:11.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.373+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3923104477 wait complete. 2024-04-20T21:21:11.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.375+0000 7f2ec0e00640 1 Processor -- start 2024-04-20T21:21:11.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.375+0000 7f2ec0e00640 1 -- start start 2024-04-20T21:21:11.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.376+0000 7f2ec0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ebc0adf60 0x7f2ebc14cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.376+0000 7f2ec0e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ebc0b2f70 0x7f2ebc09bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.376+0000 7f2ec0e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ebc15faf0 0x7f2ebc09c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.376+0000 7f2ec0e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc06be40 con 0x7f2ebc15faf0 2024-04-20T21:21:11.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.376+0000 7f2ec0e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc0736c0 con 0x7f2ebc0adf60 2024-04-20T21:21:11.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.376+0000 7f2ec0e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2ebc06bfc0 con 0x7f2ebc0b2f70 2024-04-20T21:21:11.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.377+0000 7f2ebbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ebc15faf0 0x7f2ebc09c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.377+0000 7f2ebbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ebc15faf0 0x7f2ebc09c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34756/0 (socket says 172.21.15.71:34756) 2024-04-20T21:21:11.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.377+0000 7f2ebbe00640 1 -- 172.21.15.71:0/3945253193 learned_addr learned my addr 172.21.15.71:0/3945253193 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:11.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.377+0000 7f2ebaa00640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ebc0b2f70 0x7f2ebc09bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.377+0000 7f2ebbe00640 1 -- 172.21.15.71:0/3945253193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ebc0b2f70 msgr2=0x7f2ebc09bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:11.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.377+0000 7f2ebbe00640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ebc0b2f70 0x7f2ebc09bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.377+0000 7f2ebbe00640 1 -- 172.21.15.71:0/3945253193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ebc0adf60 msgr2=0x7f2ebc14cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:11.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.377+0000 7f2ebbe00640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ebc0adf60 0x7f2ebc14cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.377+0000 7f2ebbe00640 1 -- 172.21.15.71:0/3945253193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc14d160 con 0x7f2ebc15faf0 2024-04-20T21:21:11.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.377+0000 7f2ebbe00640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ebc15faf0 0x7f2ebc09c490 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4007e60 tx=0x7f2eb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:11.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.378+0000 7f2eb3400640 1 -- 172.21.15.71:0/3945253193 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4014420 con 0x7f2ebc15faf0 2024-04-20T21:21:11.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.378+0000 7f2eb3400640 1 -- 172.21.15.71:0/3945253193 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb4019070 con 0x7f2ebc15faf0 2024-04-20T21:21:11.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.378+0000 7f2eb3400640 1 -- 172.21.15.71:0/3945253193 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4014820 con 0x7f2ebc15faf0 2024-04-20T21:21:11.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.378+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3945253193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ebc157290 con 0x7f2ebc15faf0 2024-04-20T21:21:11.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.378+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3945253193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ebc1564d0 con 0x7f2ebc15faf0 2024-04-20T21:21:11.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.379+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3945253193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ebc075b60 con 0x7f2ebc15faf0 2024-04-20T21:21:11.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.380+0000 7f2eb3400640 1 -- 172.21.15.71:0/3945253193 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2eb40149c0 con 0x7f2ebc15faf0 2024-04-20T21:21:11.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.381+0000 7f2eb3400640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e9c06c8f0 0x7f2e9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.381+0000 7f2eb3400640 1 -- 172.21.15.71:0/3945253193 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f2eb408c290 con 0x7f2ebc15faf0 2024-04-20T21:21:11.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.381+0000 7f2ebb400640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e9c06c8f0 0x7f2e9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.382+0000 7f2ebb400640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e9c06c8f0 0x7f2e9c06edb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2eac036000 tx=0x7f2eac030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:11.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.386+0000 7f2eb3400640 1 -- 172.21.15.71:0/3945253193 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2eb405a7e0 con 0x7f2ebc15faf0 2024-04-20T21:21:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.590+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3945253193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2ebc06d220 con 0x7f2ebc15faf0 2024-04-20T21:21:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.591+0000 7f2eb3400640 1 -- 172.21.15.71:0/3945253193 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f2eb405a0e0 con 0x7f2ebc15faf0 2024-04-20T21:21:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:11.590 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2024-04-20T21:21:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-20T21:21:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2024-04-20T21:21:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2024-04-20T21:21:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:11.590 INFO:teuthology.orchestra.run.smithi071.stdout:] 2024-04-20T21:21:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.593+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3945253193 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e9c06c8f0 msgr2=0x7f2e9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.593+0000 7f2ec0e00640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e9c06c8f0 0x7f2e9c06edb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2eac036000 tx=0x7f2eac030000 comp rx=0 tx=0).stop 2024-04-20T21:21:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.593+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3945253193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ebc15faf0 msgr2=0x7f2ebc09c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.593+0000 7f2ec0e00640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ebc15faf0 0x7f2ebc09c490 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4007e60 tx=0x7f2eb400e4b0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.593+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3945253193 shutdown_connections 2024-04-20T21:21:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.593+0000 7f2ec0e00640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f2e9c06c8f0 0x7f2e9c06edb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.593+0000 7f2ec0e00640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ebc15faf0 0x7f2ebc09c490 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.593+0000 7f2ec0e00640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ebc0b2f70 0x7f2ebc09bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.594+0000 7f2ec0e00640 1 --2- 172.21.15.71:0/3945253193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ebc0adf60 0x7f2ebc14cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.594+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3945253193 >> 172.21.15.71:0/3945253193 conn(0x7f2ebc0d0040 msgr2=0x7f2ebc06dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.594+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3945253193 shutdown_connections 2024-04-20T21:21:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.594+0000 7f2ec0e00640 1 -- 172.21.15.71:0/3945253193 wait complete. 2024-04-20T21:21:11.611 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-20T21:21:11.611 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-20T21:21:11.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.812+0000 7f1a42200640 1 Processor -- start 2024-04-20T21:21:11.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.812+0000 7f1a42200640 1 -- start start 2024-04-20T21:21:11.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.813+0000 7f1a42200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a3c15bf80 0x7f1a3c06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.813+0000 7f1a42200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1a3c15c360 0x7f1a3c06c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.813+0000 7f1a42200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1a3c0d0360 0x7f1a3c0d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.813+0000 7f1a42200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1a3c162f70 con 0x7f1a3c0d0360 2024-04-20T21:21:11.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.813+0000 7f1a42200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1a3c162360 con 0x7f1a3c15c360 2024-04-20T21:21:11.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.813+0000 7f1a42200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3c162640 con 0x7f1a3c15bf80 2024-04-20T21:21:11.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.814+0000 7f1a3be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1a3c0d0360 0x7f1a3c0d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.814+0000 7f1a3be00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1a3c0d0360 0x7f1a3c0d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34768/0 (socket says 172.21.15.71:34768) 2024-04-20T21:21:11.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.814+0000 7f1a3be00640 1 -- 172.21.15.71:0/3801096056 learned_addr learned my addr 172.21.15.71:0/3801096056 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:11.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.814+0000 7f1a3b400640 1 --2- 172.21.15.71:0/3801096056 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a3c15bf80 0x7f1a3c06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.814+0000 7f1a33e00640 1 --2- 172.21.15.71:0/3801096056 >> v2:172.21.15.137:3300/0 conn(0x7f1a3c15c360 0x7f1a3c06c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.814+0000 7f1a3be00640 1 -- 172.21.15.71:0/3801096056 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a3c15bf80 msgr2=0x7f1a3c06dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:11.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.814+0000 7f1a3be00640 1 --2- 172.21.15.71:0/3801096056 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a3c15bf80 0x7f1a3c06dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.814+0000 7f1a3be00640 1 -- 172.21.15.71:0/3801096056 >> v2:172.21.15.137:3300/0 conn(0x7f1a3c15c360 msgr2=0x7f1a3c06c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:11.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.814+0000 7f1a3be00640 1 --2- 172.21.15.71:0/3801096056 >> v2:172.21.15.137:3300/0 conn(0x7f1a3c15c360 0x7f1a3c06c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.814+0000 7f1a3be00640 1 -- 172.21.15.71:0/3801096056 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c162920 con 0x7f1a3c0d0360 2024-04-20T21:21:11.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.814+0000 7f1a33e00640 1 --2- 172.21.15.71:0/3801096056 >> v2:172.21.15.137:3300/0 conn(0x7f1a3c15c360 0x7f1a3c06c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:11.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.815+0000 7f1a3be00640 1 --2- 172.21.15.71:0/3801096056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3c0d0360 0x7f1a3c0d07f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0b41c0 tx=0x7f1a3402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f367687a465eaeb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:11.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a3aa00640 1 -- 172.21.15.71:0/3801096056 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3402ca70 con 0x7f1a3c0d0360 2024-04-20T21:21:11.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a3aa00640 1 -- 172.21.15.71:0/3801096056 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3402cc10 con 0x7f1a3c0d0360 2024-04-20T21:21:11.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a3aa00640 1 -- 172.21.15.71:0/3801096056 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a340343f0 con 0x7f1a3c0d0360 2024-04-20T21:21:11.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a42200640 1 -- 172.21.15.71:0/3801096056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3c0d0360 msgr2=0x7f1a3c0d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:11.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a42200640 1 --2- 172.21.15.71:0/3801096056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3c0d0360 0x7f1a3c0d07f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0b41c0 tx=0x7f1a3402bed0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a42200640 1 -- 172.21.15.71:0/3801096056 shutdown_connections 2024-04-20T21:21:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a42200640 1 --2- 172.21.15.71:0/3801096056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3c0d0360 0x7f1a3c0d07f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a42200640 1 --2- 172.21.15.71:0/3801096056 >> v2:172.21.15.137:3300/0 conn(0x7f1a3c15c360 0x7f1a3c06c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a42200640 1 --2- 172.21.15.71:0/3801096056 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a3c15bf80 0x7f1a3c06dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a42200640 1 -- 172.21.15.71:0/3801096056 >> 172.21.15.71:0/3801096056 conn(0x7f1a3c0b3350 msgr2=0x7f1a3c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a42200640 1 -- 172.21.15.71:0/3801096056 shutdown_connections 2024-04-20T21:21:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.816+0000 7f1a42200640 1 -- 172.21.15.71:0/3801096056 wait complete. 2024-04-20T21:21:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.818+0000 7f1a42200640 1 Processor -- start 2024-04-20T21:21:11.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.818+0000 7f1a42200640 1 -- start start 2024-04-20T21:21:11.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.819+0000 7f1a42200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a3c0d0360 0x7f1a3c099710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.819+0000 7f1a42200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a3c15bf80 0x7f1a3c09c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.819+0000 7f1a42200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3c15c360 0x7f1a3c0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.819+0000 7f1a42200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c06bc40 con 0x7f1a3c15c360 2024-04-20T21:21:11.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.819+0000 7f1a42200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c06bac0 con 0x7f1a3c0d0360 2024-04-20T21:21:11.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.819+0000 7f1a42200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3c06c5c0 con 0x7f1a3c15bf80 2024-04-20T21:21:11.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.820+0000 7f1a3be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3c15c360 0x7f1a3c0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.820+0000 7f1a3be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3c15c360 0x7f1a3c0ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34780/0 (socket says 172.21.15.71:34780) 2024-04-20T21:21:11.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.820+0000 7f1a3be00640 1 -- 172.21.15.71:0/3814986491 learned_addr learned my addr 172.21.15.71:0/3814986491 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:11.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.820+0000 7f1a33e00640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a3c15bf80 0x7f1a3c09c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.820+0000 7f1a3be00640 1 -- 172.21.15.71:0/3814986491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a3c15bf80 msgr2=0x7f1a3c09c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:11.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.820+0000 7f1a3b400640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a3c0d0360 0x7f1a3c099710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.820+0000 7f1a3be00640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a3c15bf80 0x7f1a3c09c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.820+0000 7f1a3be00640 1 -- 172.21.15.71:0/3814986491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a3c0d0360 msgr2=0x7f1a3c099710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.820+0000 7f1a3be00640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a3c0d0360 0x7f1a3c099710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.820+0000 7f1a3be00640 1 -- 172.21.15.71:0/3814986491 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c09cf80 con 0x7f1a3c15c360 2024-04-20T21:21:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.820+0000 7f1a3be00640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3c15c360 0x7f1a3c0ae0a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1a3402c4e0 tx=0x7f1a34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.821+0000 7f1a33400640 1 -- 172.21.15.71:0/3814986491 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34043020 con 0x7f1a3c15c360 2024-04-20T21:21:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.821+0000 7f1a33400640 1 -- 172.21.15.71:0/3814986491 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3403e450 con 0x7f1a3c15c360 2024-04-20T21:21:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.821+0000 7f1a42200640 1 -- 172.21.15.71:0/3814986491 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3c09d260 con 0x7f1a3c15c360 2024-04-20T21:21:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.821+0000 7f1a33400640 1 -- 172.21.15.71:0/3814986491 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34009510 con 0x7f1a3c15c360 2024-04-20T21:21:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.821+0000 7f1a42200640 1 -- 172.21.15.71:0/3814986491 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3c09d820 con 0x7f1a3c15c360 2024-04-20T21:21:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.822+0000 7f1a42200640 1 -- 172.21.15.71:0/3814986491 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3c068980 con 0x7f1a3c15c360 2024-04-20T21:21:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.823+0000 7f1a33400640 1 -- 172.21.15.71:0/3814986491 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a34046020 con 0x7f1a3c15c360 2024-04-20T21:21:11.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.824+0000 7f1a33400640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1a1806c920 0x7f1a1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:11.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.824+0000 7f1a33400640 1 -- 172.21.15.71:0/3814986491 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f1a340ae140 con 0x7f1a3c15c360 2024-04-20T21:21:11.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.824+0000 7f1a3b400640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1a1806c920 0x7f1a1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:11.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.824+0000 7f1a3b400640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1a1806c920 0x7f1a1806ede0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c006fd0 tx=0x7f1a2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:11.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:11.828+0000 7f1a33400640 1 -- 172.21.15.71:0/3814986491 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1a3404d030 con 0x7f1a3c15c360 2024-04-20T21:21:12.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.030+0000 7f1a42200640 1 -- 172.21.15.71:0/3814986491 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1a3c0736f0 con 0x7f1a3c15c360 2024-04-20T21:21:12.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.802+0000 7f1a33400640 1 -- 172.21.15.71:0/3814986491 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f1a3407c690 con 0x7f1a3c15c360 2024-04-20T21:21:12.801 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2024-04-20T21:21:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.805+0000 7f1a42200640 1 -- 172.21.15.71:0/3814986491 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1a1806c920 msgr2=0x7f1a1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.805+0000 7f1a42200640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1a1806c920 0x7f1a1806ede0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c006fd0 tx=0x7f1a2c008040 comp rx=0 tx=0).stop 2024-04-20T21:21:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.806+0000 7f1a42200640 1 -- 172.21.15.71:0/3814986491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3c15c360 msgr2=0x7f1a3c0ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.806+0000 7f1a42200640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3c15c360 0x7f1a3c0ae0a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1a3402c4e0 tx=0x7f1a34004a40 comp rx=0 tx=0).stop 2024-04-20T21:21:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.806+0000 7f1a42200640 1 -- 172.21.15.71:0/3814986491 shutdown_connections 2024-04-20T21:21:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.806+0000 7f1a42200640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f1a1806c920 0x7f1a1806ede0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.806+0000 7f1a42200640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3c15c360 0x7f1a3c0ae0a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.806+0000 7f1a42200640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1a3c15bf80 0x7f1a3c09c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.806+0000 7f1a42200640 1 --2- 172.21.15.71:0/3814986491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a3c0d0360 0x7f1a3c099710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.806+0000 7f1a42200640 1 -- 172.21.15.71:0/3814986491 >> 172.21.15.71:0/3814986491 conn(0x7f1a3c0b3350 msgr2=0x7f1a3c15fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.806+0000 7f1a42200640 1 -- 172.21.15.71:0/3814986491 shutdown_connections 2024-04-20T21:21:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:12.806+0000 7f1a42200640 1 -- 172.21.15.71:0/3814986491 wait complete. 2024-04-20T21:21:12.834 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-20T21:21:13.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.034+0000 7f7d2ac00640 1 Processor -- start 2024-04-20T21:21:13.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.034+0000 7f7d2ac00640 1 -- start start 2024-04-20T21:21:13.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.035+0000 7f7d2ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d240d0a70 0x7f7d240ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:13.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.035+0000 7f7d2ac00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7d2406f090 0x7f7d240ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:13.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.035+0000 7f7d2ac00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d2406df70 con 0x7f7d24162c00 2024-04-20T21:21:13.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.035+0000 7f7d2ac00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7d24162fe0 con 0x7f7d2406f090 2024-04-20T21:21:13.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.035+0000 7f7d2ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2406ec00 con 0x7f7d240d0a70 2024-04-20T21:21:13.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.036+0000 7f7d28c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7d2406f090 0x7f7d240ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:13.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.036+0000 7f7d28c00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7d2406f090 0x7f7d240ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34598/0 (socket says 172.21.15.71:34598) 2024-04-20T21:21:13.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.036+0000 7f7d28c00640 1 -- 172.21.15.71:0/3300983259 learned_addr learned my addr 172.21.15.71:0/3300983259 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:13.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.036+0000 7f7d1b400640 1 --2- 172.21.15.71:0/3300983259 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d240d0a70 0x7f7d240ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:13.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.036+0000 7f7d28c00640 1 -- 172.21.15.71:0/3300983259 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d240d0a70 msgr2=0x7f7d240ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:13.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.036+0000 7f7d28c00640 1 --2- 172.21.15.71:0/3300983259 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d240d0a70 0x7f7d240ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:13.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.036+0000 7f7d28c00640 1 -- 172.21.15.71:0/3300983259 >> v1:172.21.15.71:6789/0 conn(0x7f7d24162c00 legacy=0x7f7d240d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:13.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.036+0000 7f7d28c00640 1 -- 172.21.15.71:0/3300983259 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2406e310 con 0x7f7d2406f090 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.037+0000 7f7d28c00640 1 --2- 172.21.15.71:0/3300983259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d2406f090 0x7f7d240ad590 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009e50 tx=0x7f7d1c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524b62fc5d73f28 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.038+0000 7f7d23400640 1 -- 172.21.15.71:0/3300983259 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c02ca70 con 0x7f7d2406f090 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.038+0000 7f7d23400640 1 -- 172.21.15.71:0/3300983259 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1c02cc10 con 0x7f7d2406f090 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.038+0000 7f7d23400640 1 -- 172.21.15.71:0/3300983259 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0343f0 con 0x7f7d2406f090 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.038+0000 7f7d2ac00640 1 -- 172.21.15.71:0/3300983259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d2406f090 msgr2=0x7f7d240ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.038+0000 7f7d2ac00640 1 --2- 172.21.15.71:0/3300983259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d2406f090 0x7f7d240ad590 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009e50 tx=0x7f7d1c02bed0 comp rx=0 tx=0).stop 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.038+0000 7f7d2ac00640 1 -- 172.21.15.71:0/3300983259 shutdown_connections 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.038+0000 7f7d2ac00640 1 --2- 172.21.15.71:0/3300983259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d2406f090 0x7f7d240ad590 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.038+0000 7f7d2ac00640 1 --2- 172.21.15.71:0/3300983259 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d240d0a70 0x7f7d240ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.038+0000 7f7d2ac00640 1 -- 172.21.15.71:0/3300983259 >> 172.21.15.71:0/3300983259 conn(0x7f7d240b3350 msgr2=0x7f7d240b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.038+0000 7f7d2ac00640 1 -- 172.21.15.71:0/3300983259 shutdown_connections 2024-04-20T21:21:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.038+0000 7f7d2ac00640 1 -- 172.21.15.71:0/3300983259 wait complete. 2024-04-20T21:21:13.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.040+0000 7f7d2ac00640 1 Processor -- start 2024-04-20T21:21:13.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.040+0000 7f7d2ac00640 1 -- start start 2024-04-20T21:21:13.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.041+0000 7f7d2ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d2406f090 0x7f7d24164af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:13.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.041+0000 7f7d2ac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d240d0a70 0x7f7d2415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:13.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.041+0000 7f7d2ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d24162c00 0x7f7d2415d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:13.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.041+0000 7f7d2ac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2406dbb0 con 0x7f7d240d0a70 2024-04-20T21:21:13.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.041+0000 7f7d2ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2406e890 con 0x7f7d2406f090 2024-04-20T21:21:13.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.041+0000 7f7d2ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2406dd30 con 0x7f7d24162c00 2024-04-20T21:21:13.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.041+0000 7f7d1b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d240d0a70 0x7f7d2415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:13.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d1b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d240d0a70 0x7f7d2415cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34606/0 (socket says 172.21.15.71:34606) 2024-04-20T21:21:13.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d1b400640 1 -- 172.21.15.71:0/878245240 learned_addr learned my addr 172.21.15.71:0/878245240 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d28c00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d24162c00 0x7f7d2415d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d23e00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d2406f090 0x7f7d24164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d1b400640 1 -- 172.21.15.71:0/878245240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d24162c00 msgr2=0x7f7d2415d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d1b400640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d24162c00 0x7f7d2415d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d1b400640 1 -- 172.21.15.71:0/878245240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d2406f090 msgr2=0x7f7d24164af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d1b400640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d2406f090 0x7f7d24164af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d1b400640 1 -- 172.21.15.71:0/878245240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d24158740 con 0x7f7d240d0a70 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d28c00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d24162c00 0x7f7d2415d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d23e00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d2406f090 0x7f7d24164af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.042+0000 7f7d1b400640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d240d0a70 0x7f7d2415cfc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00d830 tx=0x7f7d0c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.043+0000 7f7d20c00640 1 -- 172.21.15.71:0/878245240 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c00b6c0 con 0x7f7d240d0a70 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.043+0000 7f7d20c00640 1 -- 172.21.15.71:0/878245240 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c019070 con 0x7f7d240d0a70 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.043+0000 7f7d20c00640 1 -- 172.21.15.71:0/878245240 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c00ba80 con 0x7f7d240d0a70 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.043+0000 7f7d2ac00640 1 -- 172.21.15.71:0/878245240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d24158a20 con 0x7f7d240d0a70 2024-04-20T21:21:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.043+0000 7f7d2ac00640 1 -- 172.21.15.71:0/878245240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d24158fe0 con 0x7f7d240d0a70 2024-04-20T21:21:13.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.044+0000 7f7d2ac00640 1 -- 172.21.15.71:0/878245240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d24068980 con 0x7f7d240d0a70 2024-04-20T21:21:13.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.045+0000 7f7d20c00640 1 -- 172.21.15.71:0/878245240 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d0c01e460 con 0x7f7d240d0a70 2024-04-20T21:21:13.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.046+0000 7f7d20c00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d0006c8f0 0x7f7d0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:13.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.046+0000 7f7d20c00640 1 -- 172.21.15.71:0/878245240 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7f7d0c08c2b0 con 0x7f7d240d0a70 2024-04-20T21:21:13.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.046+0000 7f7d23e00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d0006c8f0 0x7f7d0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:13.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.047+0000 7f7d23e00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d0006c8f0 0x7f7d0006edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7d140015e0 tx=0x7f7d14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:13.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.052+0000 7f7d20c00640 1 -- 172.21.15.71:0/878245240 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7d0c05a6d0 con 0x7f7d240d0a70 2024-04-20T21:21:13.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.250+0000 7f7d2ac00640 1 -- 172.21.15.71:0/878245240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7d2415cc50 con 0x7f7d240d0a70 2024-04-20T21:21:13.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.819+0000 7f7d20c00640 1 -- 172.21.15.71:0/878245240 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7f7d0c059fd0 con 0x7f7d240d0a70 2024-04-20T21:21:13.819 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2024-04-20T21:21:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.823+0000 7f7d2ac00640 1 -- 172.21.15.71:0/878245240 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d0006c8f0 msgr2=0x7f7d0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.823+0000 7f7d2ac00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d0006c8f0 0x7f7d0006edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7d140015e0 tx=0x7f7d14009040 comp rx=0 tx=0).stop 2024-04-20T21:21:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.823+0000 7f7d2ac00640 1 -- 172.21.15.71:0/878245240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d240d0a70 msgr2=0x7f7d2415cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.823+0000 7f7d2ac00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d240d0a70 0x7f7d2415cfc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00d830 tx=0x7f7d0c00dcf0 comp rx=0 tx=0).stop 2024-04-20T21:21:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.824+0000 7f7d2ac00640 1 -- 172.21.15.71:0/878245240 shutdown_connections 2024-04-20T21:21:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.824+0000 7f7d2ac00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f7d0006c8f0 0x7f7d0006edb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.824+0000 7f7d2ac00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d24162c00 0x7f7d2415d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.824+0000 7f7d2ac00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d240d0a70 0x7f7d2415cfc0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.824+0000 7f7d2ac00640 1 --2- 172.21.15.71:0/878245240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d2406f090 0x7f7d24164af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.824+0000 7f7d2ac00640 1 -- 172.21.15.71:0/878245240 >> 172.21.15.71:0/878245240 conn(0x7f7d240b3350 msgr2=0x7f7d24160100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:13.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.827+0000 7f7d2ac00640 1 -- 172.21.15.71:0/878245240 shutdown_connections 2024-04-20T21:21:13.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:13.827+0000 7f7d2ac00640 1 -- 172.21.15.71:0/878245240 wait complete. 2024-04-20T21:21:13.862 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-20T21:21:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.038+0000 7f55e9000640 1 Processor -- start 2024-04-20T21:21:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.038+0000 7f55e9000640 1 -- start start 2024-04-20T21:21:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.040+0000 7f55e9000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f55e40d0360 0x7f55e40d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.040+0000 7f55e9000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e4141c60 con 0x7f55e4156c20 2024-04-20T21:21:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.040+0000 7f55e9000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e40adab0 con 0x7f55e415ca40 2024-04-20T21:21:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.040+0000 7f55e9000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f55e40d0d10 con 0x7f55e40d0360 2024-04-20T21:21:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.040+0000 7f55e1e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f55e4156c20 0x7f55e406b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34408/0 (socket says 172.21.15.71:34408) 2024-04-20T21:21:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.040+0000 7f55e1e00640 1 -- 172.21.15.71:0/4088212956 learned_addr learned my addr 172.21.15.71:0/4088212956 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:14.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020220824 0 0) 0x7f55e4141c60 con 0x7f55e4156c20 2024-04-20T21:21:14.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55c8003520 con 0x7f55e4156c20 2024-04-20T21:21:14.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e2800640 1 --2- 172.21.15.71:0/4088212956 >> v2:172.21.15.137:3300/0 conn(0x7f55e40d0360 0x7f55e40d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:14.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3677985815 0 0) 0x7f55c8003520 con 0x7f55e4156c20 2024-04-20T21:21:14.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 >> v2:172.21.15.137:3300/0 conn(0x7f55e40d0360 msgr2=0x7f55e40d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:14.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 --2- 172.21.15.71:0/4088212956 >> v2:172.21.15.137:3300/0 conn(0x7f55e40d0360 0x7f55e40d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:14.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 >> v1:172.21.15.137:6789/0 conn(0x7f55e415ca40 legacy=0x7f55e40ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:14.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e415cf90 con 0x7f55e4156c20 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f55d4001670 con 0x7f55e4156c20 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 >> v1:172.21.15.71:6789/0 conn(0x7f55e4156c20 legacy=0x7f55e406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 --2- 172.21.15.71:0/4088212956 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55c8003a00 0x7f55c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 --2- 172.21.15.71:0/4088212956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 0x7f55c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 --2- 172.21.15.71:0/4088212956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c8005210 0x7f55c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40d0d10 con 0x7f55c8004800 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55c800c160 con 0x7f55c8005210 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.041+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55c800c360 con 0x7f55c8003a00 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.042+0000 7f55dbe00640 1 --2- 172.21.15.71:0/4088212956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 0x7f55c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.042+0000 7f55e1e00640 1 --2- 172.21.15.71:0/4088212956 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55c8003a00 0x7f55c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.042+0000 7f55e2800640 1 --2- 172.21.15.71:0/4088212956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c8005210 0x7f55c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.042+0000 7f55dbe00640 1 -- 172.21.15.71:0/4088212956 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55c8003a00 msgr2=0x7f55c8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:14.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.042+0000 7f55dbe00640 1 --2- 172.21.15.71:0/4088212956 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55c8003a00 0x7f55c8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:14.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.042+0000 7f55dbe00640 1 -- 172.21.15.71:0/4088212956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c8005210 msgr2=0x7f55c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:14.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.042+0000 7f55dbe00640 1 --2- 172.21.15.71:0/4088212956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c8005210 0x7f55c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:14.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.042+0000 7f55e2800640 1 -- 172.21.15.71:0/4088212956 reap_dead start 2024-04-20T21:21:14.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.042+0000 7f55dbe00640 1 -- 172.21.15.71:0/4088212956 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c8003520 con 0x7f55c8004800 2024-04-20T21:21:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.043+0000 7f55dbe00640 1 --2- 172.21.15.71:0/4088212956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 0x7f55c8004c80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f55cc001750 tx=0x7f55c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959fb18ff80868a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.044+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc001370 con 0x7f55c8004800 2024-04-20T21:21:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.044+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55cc0052d0 con 0x7f55c8004800 2024-04-20T21:21:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.044+0000 7f55e1400640 1 -- 172.21.15.71:0/4088212956 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc003830 con 0x7f55c8004800 2024-04-20T21:21:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.044+0000 7f55e9000640 1 -- 172.21.15.71:0/4088212956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 msgr2=0x7f55c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.044+0000 7f55e9000640 1 --2- 172.21.15.71:0/4088212956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 0x7f55c8004c80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f55cc001750 tx=0x7f55c8005830 comp rx=0 tx=0).stop 2024-04-20T21:21:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.044+0000 7f55e9000640 1 -- 172.21.15.71:0/4088212956 shutdown_connections 2024-04-20T21:21:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.044+0000 7f55e9000640 1 --2- 172.21.15.71:0/4088212956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 0x7f55c8004c80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.044+0000 7f55e9000640 1 -- 172.21.15.71:0/4088212956 >> 172.21.15.71:0/4088212956 conn(0x7f55e40b3350 msgr2=0x7f55e40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.044+0000 7f55e9000640 1 -- 172.21.15.71:0/4088212956 shutdown_connections 2024-04-20T21:21:14.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.044+0000 7f55e9000640 1 -- 172.21.15.71:0/4088212956 wait complete. 2024-04-20T21:21:14.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.046+0000 7f55e9000640 1 Processor -- start 2024-04-20T21:21:14.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.046+0000 7f55e9000640 1 -- start start 2024-04-20T21:21:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.047+0000 7f55e9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 0x7f55e4150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.047+0000 7f55e9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55e415b480 0x7f55e4151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.047+0000 7f55e9000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55e415b8d0 0x7f55e4153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.047+0000 7f55e9000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55e415d830 con 0x7f55c8004800 2024-04-20T21:21:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.047+0000 7f55e9000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55e415d550 con 0x7f55e415b480 2024-04-20T21:21:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.047+0000 7f55e9000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55e40d07d0 con 0x7f55e415b8d0 2024-04-20T21:21:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.047+0000 7f55e1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 0x7f55e4150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.047+0000 7f55e1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 0x7f55e4150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34616/0 (socket says 172.21.15.71:34616) 2024-04-20T21:21:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.047+0000 7f55e1e00640 1 -- 172.21.15.71:0/4287413147 learned_addr learned my addr 172.21.15.71:0/4287413147 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.048+0000 7f55e1e00640 1 -- 172.21.15.71:0/4287413147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55e415b8d0 msgr2=0x7f55e4153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.048+0000 7f55e1e00640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55e415b8d0 0x7f55e4153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.048+0000 7f55e1e00640 1 -- 172.21.15.71:0/4287413147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55e415b480 msgr2=0x7f55e4151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.048+0000 7f55e1e00640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55e415b480 0x7f55e4151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.048+0000 7f55e1e00640 1 -- 172.21.15.71:0/4287413147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e4150e80 con 0x7f55c8004800 2024-04-20T21:21:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.048+0000 7f55e1e00640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 0x7f55e4150940 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f55d40072c0 tx=0x7f55d4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:14.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.048+0000 7f55da000640 1 -- 172.21.15.71:0/4287413147 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d400f8e0 con 0x7f55c8004800 2024-04-20T21:21:14.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.048+0000 7f55da000640 1 -- 172.21.15.71:0/4287413147 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d4018070 con 0x7f55c8004800 2024-04-20T21:21:14.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.048+0000 7f55da000640 1 -- 172.21.15.71:0/4287413147 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d400fcc0 con 0x7f55c8004800 2024-04-20T21:21:14.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.048+0000 7f55e9000640 1 -- 172.21.15.71:0/4287413147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e41525a0 con 0x7f55c8004800 2024-04-20T21:21:14.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.049+0000 7f55e9000640 1 -- 172.21.15.71:0/4287413147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41522c0 con 0x7f55c8004800 2024-04-20T21:21:14.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.050+0000 7f55e9000640 1 -- 172.21.15.71:0/4287413147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e4068980 con 0x7f55c8004800 2024-04-20T21:21:14.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.051+0000 7f55da000640 1 -- 172.21.15.71:0/4287413147 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f55d401d460 con 0x7f55c8004800 2024-04-20T21:21:14.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.052+0000 7f55da000640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55c006c8f0 0x7f55c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:14.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.052+0000 7f55da000640 1 -- 172.21.15.71:0/4287413147 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7f55d408bf10 con 0x7f55c8004800 2024-04-20T21:21:14.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.052+0000 7f55dbe00640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55c006c8f0 0x7f55c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:14.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.053+0000 7f55dbe00640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55c006c8f0 0x7f55c006edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f55cc033000 tx=0x7f55cc02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:14.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.057+0000 7f55da000640 1 -- 172.21.15.71:0/4287413147 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f55e4150e80 con 0x7f55c8004800 2024-04-20T21:21:14.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.293+0000 7f55e9000640 1 -- 172.21.15.71:0/4287413147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f55e415df60 con 0x7f55c8004800 2024-04-20T21:21:14.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.823+0000 7f55da000640 1 -- 172.21.15.71:0/4287413147 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f55d400fe60 con 0x7f55c8004800 2024-04-20T21:21:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 5 and data pool 6 2024-04-20T21:21:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.827+0000 7f55e9000640 1 -- 172.21.15.71:0/4287413147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55c006c8f0 msgr2=0x7f55c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.827+0000 7f55e9000640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55c006c8f0 0x7f55c006edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f55cc033000 tx=0x7f55cc02f000 comp rx=0 tx=0).stop 2024-04-20T21:21:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.827+0000 7f55e9000640 1 -- 172.21.15.71:0/4287413147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 msgr2=0x7f55e4150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.827+0000 7f55e9000640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 0x7f55e4150940 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f55d40072c0 tx=0x7f55d4007780 comp rx=0 tx=0).stop 2024-04-20T21:21:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.827+0000 7f55e9000640 1 -- 172.21.15.71:0/4287413147 shutdown_connections 2024-04-20T21:21:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.827+0000 7f55e9000640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f55c006c8f0 0x7f55c006edb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.827+0000 7f55e9000640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55e415b8d0 0x7f55e4153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.827+0000 7f55e9000640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55e415b480 0x7f55e4151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.827+0000 7f55e9000640 1 --2- 172.21.15.71:0/4287413147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55c8004800 0x7f55e4150940 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.827+0000 7f55e9000640 1 -- 172.21.15.71:0/4287413147 >> 172.21.15.71:0/4287413147 conn(0x7f55e40b3350 msgr2=0x7f55e40b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.828+0000 7f55e9000640 1 -- 172.21.15.71:0/4287413147 shutdown_connections 2024-04-20T21:21:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:14.828+0000 7f55e9000640 1 -- 172.21.15.71:0/4287413147 wait complete. 2024-04-20T21:21:14.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:21:15.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.034+0000 7f3b9fe00640 1 Processor -- start 2024-04-20T21:21:15.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.034+0000 7f3b9fe00640 1 -- start start 2024-04-20T21:21:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.036+0000 7f3b9fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba0099900 0x7f3ba00d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.036+0000 7f3b9fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3ba00ad160 0x7f3ba00ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.036+0000 7f3b9fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ba00afb40 con 0x7f3ba006db90 2024-04-20T21:21:15.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.036+0000 7f3b9fe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3ba006baa0 con 0x7f3ba00ad160 2024-04-20T21:21:15.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.036+0000 7f3b9fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba006bd80 con 0x7f3ba0099900 2024-04-20T21:21:15.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.037+0000 7f3b96000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba0099900 0x7f3ba00d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.037+0000 7f3b9ea00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3ba006db90 0x7f3ba006df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.71:41962/0 (socket says 172.21.15.71:41962) 2024-04-20T21:21:15.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.037+0000 7f3b9ea00640 1 -- 172.21.15.71:0/1460300471 learned_addr learned my addr 172.21.15.71:0/1460300471 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:15.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.037+0000 7f3b9f400640 1 --2- 172.21.15.71:0/1460300471 >> v2:172.21.15.137:3300/0 conn(0x7f3ba00ad160 0x7f3ba00ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.037+0000 7f3b96000640 1 -- 172.21.15.71:0/1460300471 >> v2:172.21.15.137:3300/0 conn(0x7f3ba00ad160 msgr2=0x7f3ba00ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:15.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.037+0000 7f3b96000640 1 --2- 172.21.15.71:0/1460300471 >> v2:172.21.15.137:3300/0 conn(0x7f3ba00ad160 0x7f3ba00ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.037+0000 7f3b96000640 1 -- 172.21.15.71:0/1460300471 >> v1:172.21.15.137:6789/0 conn(0x7f3ba006db90 legacy=0x7f3ba006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.038+0000 7f3b96000640 1 -- 172.21.15.71:0/1460300471 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba006c060 con 0x7f3ba0099900 2024-04-20T21:21:15.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.039+0000 7f3b96000640 1 --2- 172.21.15.71:0/1460300471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba0099900 0x7f3ba00d0760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b880097a0 tx=0x7f3b8802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8588b0678bca48ef server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:15.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.040+0000 7f3b9e000640 1 -- 172.21.15.71:0/1460300471 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88035020 con 0x7f3ba0099900 2024-04-20T21:21:15.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.040+0000 7f3b9e000640 1 -- 172.21.15.71:0/1460300471 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b88031810 con 0x7f3ba0099900 2024-04-20T21:21:15.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.040+0000 7f3b9e000640 1 -- 172.21.15.71:0/1460300471 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88031be0 con 0x7f3ba0099900 2024-04-20T21:21:15.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.041+0000 7f3b9fe00640 1 -- 172.21.15.71:0/1460300471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba0099900 msgr2=0x7f3ba00d0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.041+0000 7f3b9fe00640 1 --2- 172.21.15.71:0/1460300471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba0099900 0x7f3ba00d0760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b880097a0 tx=0x7f3b8802b8b0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.041+0000 7f3b9fe00640 1 -- 172.21.15.71:0/1460300471 shutdown_connections 2024-04-20T21:21:15.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.041+0000 7f3b9fe00640 1 --2- 172.21.15.71:0/1460300471 >> v2:172.21.15.137:3300/0 conn(0x7f3ba00ad160 0x7f3ba00ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.041+0000 7f3b9fe00640 1 --2- 172.21.15.71:0/1460300471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba0099900 0x7f3ba00d0760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.041+0000 7f3b9fe00640 1 -- 172.21.15.71:0/1460300471 >> 172.21.15.71:0/1460300471 conn(0x7f3ba00b5270 msgr2=0x7f3ba00b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:15.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.041+0000 7f3b9fe00640 1 -- 172.21.15.71:0/1460300471 shutdown_connections 2024-04-20T21:21:15.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.041+0000 7f3b9fe00640 1 -- 172.21.15.71:0/1460300471 wait complete. 2024-04-20T21:21:15.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.043+0000 7f3b9fe00640 1 Processor -- start 2024-04-20T21:21:15.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.043+0000 7f3b9fe00640 1 -- start start 2024-04-20T21:21:15.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.044+0000 7f3b9fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ba006db90 0x7f3ba00ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.044+0000 7f3b9fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ba0099900 0x7f3ba00cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.044+0000 7f3b9fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba00ad160 0x7f3ba01ec240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.044+0000 7f3b9fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba0162af0 con 0x7f3ba006db90 2024-04-20T21:21:15.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.044+0000 7f3b9fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba006c620 con 0x7f3ba0099900 2024-04-20T21:21:15.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.044+0000 7f3b9fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba0162c70 con 0x7f3ba00ad160 2024-04-20T21:21:15.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.044+0000 7f3b9ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ba006db90 0x7f3ba00ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.044+0000 7f3b9ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ba006db90 0x7f3ba00ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34622/0 (socket says 172.21.15.71:34622) 2024-04-20T21:21:15.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.044+0000 7f3b9ea00640 1 -- 172.21.15.71:0/3440862632 learned_addr learned my addr 172.21.15.71:0/3440862632 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:15.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b96000640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ba0099900 0x7f3ba00cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b9f400640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba00ad160 0x7f3ba01ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b9ea00640 1 -- 172.21.15.71:0/3440862632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba00ad160 msgr2=0x7f3ba01ec240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b9ea00640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba00ad160 0x7f3ba01ec240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b9ea00640 1 -- 172.21.15.71:0/3440862632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ba0099900 msgr2=0x7f3ba00cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b9ea00640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ba0099900 0x7f3ba00cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b9ea00640 1 -- 172.21.15.71:0/3440862632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba00cf520 con 0x7f3ba006db90 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b9ea00640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ba006db90 0x7f3ba00ceaa0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c3c0 tx=0x7f3b9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b97400640 1 -- 172.21.15.71:0/3440862632 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90017070 con 0x7f3ba006db90 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b97400640 1 -- 172.21.15.71:0/3440862632 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b90005ce0 con 0x7f3ba006db90 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b97400640 1 -- 172.21.15.71:0/3440862632 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b900072f0 con 0x7f3ba006db90 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.045+0000 7f3b9fe00640 1 -- 172.21.15.71:0/3440862632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba015af20 con 0x7f3ba006db90 2024-04-20T21:21:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.046+0000 7f3b9fe00640 1 -- 172.21.15.71:0/3440862632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba015efa0 con 0x7f3ba006db90 2024-04-20T21:21:15.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.047+0000 7f3b9fe00640 1 -- 172.21.15.71:0/3440862632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba0075b30 con 0x7f3ba006db90 2024-04-20T21:21:15.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.048+0000 7f3b97400640 1 -- 172.21.15.71:0/3440862632 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b9001a070 con 0x7f3ba006db90 2024-04-20T21:21:15.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.049+0000 7f3b97400640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3b7c06c8f0 0x7f3b7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.049+0000 7f3b97400640 1 -- 172.21.15.71:0/3440862632 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3b9008b140 con 0x7f3ba006db90 2024-04-20T21:21:15.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.049+0000 7f3b96000640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3b7c06c8f0 0x7f3b7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.050+0000 7f3b96000640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3b7c06c8f0 0x7f3b7c06edb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3b88036000 tx=0x7f3b8803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:15.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.054+0000 7f3b97400640 1 -- 172.21.15.71:0/3440862632 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3b90059340 con 0x7f3ba006db90 2024-04-20T21:21:15.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.254+0000 7f3b9fe00640 1 -- 172.21.15.71:0/3440862632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ba006d1d0 con 0x7f3ba006db90 2024-04-20T21:21:15.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.257+0000 7f3b97400640 1 -- 172.21.15.71:0/3440862632 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16931 (secure 0 0 0) 0x7f3b90058c40 con 0x7f3ba006db90 2024-04-20T21:21:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:15.256 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":38,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:21:14.294906+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:21:12.044011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-20T21:21:13.266538+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:21:15.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 -- 172.21.15.71:0/3440862632 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3b7c06c8f0 msgr2=0x7f3b7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3b7c06c8f0 0x7f3b7c06edb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3b88036000 tx=0x7f3b8803c040 comp rx=0 tx=0).stop 2024-04-20T21:21:15.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 -- 172.21.15.71:0/3440862632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ba006db90 msgr2=0x7f3ba00ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ba006db90 0x7f3ba00ceaa0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c3c0 tx=0x7f3b9000c880 comp rx=0 tx=0).stop 2024-04-20T21:21:15.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 -- 172.21.15.71:0/3440862632 shutdown_connections 2024-04-20T21:21:15.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f3b7c06c8f0 0x7f3b7c06edb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba00ad160 0x7f3ba01ec240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ba0099900 0x7f3ba00cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 --2- 172.21.15.71:0/3440862632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ba006db90 0x7f3ba00ceaa0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 -- 172.21.15.71:0/3440862632 >> 172.21.15.71:0/3440862632 conn(0x7f3ba00b5270 msgr2=0x7f3ba00b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:15.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 -- 172.21.15.71:0/3440862632 shutdown_connections 2024-04-20T21:21:15.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.260+0000 7f3b9fe00640 1 -- 172.21.15.71:0/3440862632 wait complete. 2024-04-20T21:21:15.278 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:21:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.473+0000 7f3210a00640 1 Processor -- start 2024-04-20T21:21:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.473+0000 7f3210a00640 1 -- start start 2024-04-20T21:21:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.474+0000 7f3210a00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f320c15b3b0 0x7f320c06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.474+0000 7f3210a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f320c06dcb0 0x7f320c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.474+0000 7f3210a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320c0ade40 con 0x7f320c072090 2024-04-20T21:21:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.474+0000 7f3210a00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f320c0ae0e0 con 0x7f320c15b3b0 2024-04-20T21:21:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.474+0000 7f3210a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f320c15b790 con 0x7f320c06dcb0 2024-04-20T21:21:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.475+0000 7f3209e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f320c15b3b0 0x7f320c06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.475+0000 7f3209e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f320c15b3b0 0x7f320c06eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34628/0 (socket says 172.21.15.71:34628) 2024-04-20T21:21:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.475+0000 7f3209e00640 1 -- 172.21.15.71:0/3733554531 learned_addr learned my addr 172.21.15.71:0/3733554531 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.475+0000 7f3209e00640 1 -- 172.21.15.71:0/3733554531 >> v2:172.21.15.137:3300/0 conn(0x7f320c06dcb0 msgr2=0x7f320c071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.475+0000 7f3209e00640 1 --2- 172.21.15.71:0/3733554531 >> v2:172.21.15.137:3300/0 conn(0x7f320c06dcb0 0x7f320c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.475+0000 7f3209e00640 1 -- 172.21.15.71:0/3733554531 >> v1:172.21.15.137:6789/0 conn(0x7f320c072090 legacy=0x7f320c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.475+0000 7f3209e00640 1 -- 172.21.15.71:0/3733554531 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c0ae380 con 0x7f320c15b3b0 2024-04-20T21:21:15.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.476+0000 7f3209e00640 1 --2- 172.21.15.71:0/3733554531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c15b3b0 0x7f320c06eaa0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f320c0ad8d0 tx=0x7f31fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccbcbae1c269eea server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:15.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.476+0000 7f3209400640 1 -- 172.21.15.71:0/3733554531 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc035020 con 0x7f320c15b3b0 2024-04-20T21:21:15.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.477+0000 7f3209400640 1 -- 172.21.15.71:0/3733554531 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31fc031870 con 0x7f320c15b3b0 2024-04-20T21:21:15.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.477+0000 7f3209400640 1 -- 172.21.15.71:0/3733554531 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc031c40 con 0x7f320c15b3b0 2024-04-20T21:21:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.477+0000 7f3210a00640 1 -- 172.21.15.71:0/3733554531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c15b3b0 msgr2=0x7f320c06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.477+0000 7f3210a00640 1 --2- 172.21.15.71:0/3733554531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c15b3b0 0x7f320c06eaa0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f320c0ad8d0 tx=0x7f31fc02b910 comp rx=0 tx=0).stop 2024-04-20T21:21:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.477+0000 7f3210a00640 1 -- 172.21.15.71:0/3733554531 shutdown_connections 2024-04-20T21:21:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.477+0000 7f3210a00640 1 --2- 172.21.15.71:0/3733554531 >> v2:172.21.15.137:3300/0 conn(0x7f320c06dcb0 0x7f320c071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.477+0000 7f3210a00640 1 --2- 172.21.15.71:0/3733554531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c15b3b0 0x7f320c06eaa0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.477+0000 7f3210a00640 1 -- 172.21.15.71:0/3733554531 >> 172.21.15.71:0/3733554531 conn(0x7f320c0b3350 msgr2=0x7f320c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.477+0000 7f3210a00640 1 -- 172.21.15.71:0/3733554531 shutdown_connections 2024-04-20T21:21:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.477+0000 7f3210a00640 1 -- 172.21.15.71:0/3733554531 wait complete. 2024-04-20T21:21:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.479+0000 7f3210a00640 1 Processor -- start 2024-04-20T21:21:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.479+0000 7f3210a00640 1 -- start start 2024-04-20T21:21:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.480+0000 7f3210a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c06dcb0 0x7f320c1e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.480+0000 7f3210a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f320c15b3b0 0x7f320c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.480+0000 7f3210a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f320c1e5780 0x7f320c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.480+0000 7f3210a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f320c0aec20 con 0x7f320c06dcb0 2024-04-20T21:21:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.480+0000 7f3210a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f320c0ae940 con 0x7f320c15b3b0 2024-04-20T21:21:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.480+0000 7f3210a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f320c06efe0 con 0x7f320c1e5780 2024-04-20T21:21:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.480+0000 7f3209e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c06dcb0 0x7f320c1e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.481+0000 7f3209e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c06dcb0 0x7f320c1e6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34638/0 (socket says 172.21.15.71:34638) 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.481+0000 7f3209e00640 1 -- 172.21.15.71:0/747576645 learned_addr learned my addr 172.21.15.71:0/747576645 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.481+0000 7f3203e00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f320c15b3b0 0x7f320c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.481+0000 7f3209e00640 1 -- 172.21.15.71:0/747576645 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f320c1e5780 msgr2=0x7f320c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.481+0000 7f3209e00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f320c1e5780 0x7f320c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.481+0000 7f3209e00640 1 -- 172.21.15.71:0/747576645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f320c15b3b0 msgr2=0x7f320c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.481+0000 7f3209e00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f320c15b3b0 0x7f320c15d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.481+0000 7f3209e00640 1 -- 172.21.15.71:0/747576645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c15de60 con 0x7f320c06dcb0 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.481+0000 7f3203e00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f320c15b3b0 0x7f320c15d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.481+0000 7f3209e00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c06dcb0 0x7f320c1e6d00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f31fc02b950 tx=0x7f31fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.482+0000 7f3202000640 1 -- 172.21.15.71:0/747576645 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc03ad60 con 0x7f320c06dcb0 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.482+0000 7f3202000640 1 -- 172.21.15.71:0/747576645 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31fc0443f0 con 0x7f320c06dcb0 2024-04-20T21:21:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.482+0000 7f3210a00640 1 -- 172.21.15.71:0/747576645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320c1e5c80 con 0x7f320c06dcb0 2024-04-20T21:21:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.482+0000 7f3202000640 1 -- 172.21.15.71:0/747576645 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0447e0 con 0x7f320c06dcb0 2024-04-20T21:21:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.482+0000 7f3210a00640 1 -- 172.21.15.71:0/747576645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320c1e6240 con 0x7f320c06dcb0 2024-04-20T21:21:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.483+0000 7f3210a00640 1 -- 172.21.15.71:0/747576645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f320c068980 con 0x7f320c06dcb0 2024-04-20T21:21:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.484+0000 7f3202000640 1 -- 172.21.15.71:0/747576645 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31fc038020 con 0x7f320c06dcb0 2024-04-20T21:21:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.485+0000 7f3202000640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f31e806c8f0 0x7f31e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.485+0000 7f3202000640 1 -- 172.21.15.71:0/747576645 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f31fc0adfa0 con 0x7f320c06dcb0 2024-04-20T21:21:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.485+0000 7f3203e00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f31e806c8f0 0x7f31e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.486+0000 7f3203e00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f31e806c8f0 0x7f31e806edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006fd0 tx=0x7f31f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.489+0000 7f3202000640 1 -- 172.21.15.71:0/747576645 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f31fc03f070 con 0x7f320c06dcb0 2024-04-20T21:21:15.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.675+0000 7f3210a00640 1 -- 172.21.15.71:0/747576645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f320c0b1ef0 con 0x7f320c06dcb0 2024-04-20T21:21:15.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.677+0000 7f3202000640 1 -- 172.21.15.71:0/747576645 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16931 (secure 0 0 0) 0x7f31fc07c1a0 con 0x7f320c06dcb0 2024-04-20T21:21:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:15.676 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":38,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:21:14.294906+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:21:12.044011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-20T21:21:13.266538+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.679+0000 7f3210a00640 1 -- 172.21.15.71:0/747576645 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f31e806c8f0 msgr2=0x7f31e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.679+0000 7f3210a00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f31e806c8f0 0x7f31e806edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006fd0 tx=0x7f31f4008040 comp rx=0 tx=0).stop 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.679+0000 7f3210a00640 1 -- 172.21.15.71:0/747576645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c06dcb0 msgr2=0x7f320c1e6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.679+0000 7f3210a00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c06dcb0 0x7f320c1e6d00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f31fc02b950 tx=0x7f31fc0046c0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.680+0000 7f3210a00640 1 -- 172.21.15.71:0/747576645 shutdown_connections 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.680+0000 7f3210a00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f31e806c8f0 0x7f31e806edb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.680+0000 7f3210a00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f320c1e5780 0x7f320c06b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.680+0000 7f3210a00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f320c15b3b0 0x7f320c15d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.680+0000 7f3210a00640 1 --2- 172.21.15.71:0/747576645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c06dcb0 0x7f320c1e6d00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.680+0000 7f3210a00640 1 -- 172.21.15.71:0/747576645 >> 172.21.15.71:0/747576645 conn(0x7f320c0b3350 msgr2=0x7f320c0b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.680+0000 7f3210a00640 1 -- 172.21.15.71:0/747576645 shutdown_connections 2024-04-20T21:21:15.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.680+0000 7f3210a00640 1 -- 172.21.15.71:0/747576645 wait complete. 2024-04-20T21:21:15.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-20T21:21:15.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.891+0000 7f3546e00640 1 Processor -- start 2024-04-20T21:21:15.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.891+0000 7f3546e00640 1 -- start start 2024-04-20T21:21:15.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.893+0000 7f3546e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f354015e8a0 0x7f354006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.893+0000 7f3546e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35400d0a70 0x7f35400ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.893+0000 7f3546e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f354006f060 con 0x7f354006dbb0 2024-04-20T21:21:15.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.893+0000 7f3546e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f354006e7c0 con 0x7f354015e8a0 2024-04-20T21:21:15.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.893+0000 7f3546e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f354006eaa0 con 0x7f35400d0a70 2024-04-20T21:21:15.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.893+0000 7f353fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f354015e8a0 0x7f354006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.893+0000 7f353fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f354015e8a0 0x7f354006e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34650/0 (socket says 172.21.15.71:34650) 2024-04-20T21:21:15.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.893+0000 7f353fe00640 1 -- 172.21.15.71:0/2773669553 learned_addr learned my addr 172.21.15.71:0/2773669553 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:15.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.894+0000 7f353fe00640 1 -- 172.21.15.71:0/2773669553 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35400d0a70 msgr2=0x7f35400ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:15.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.894+0000 7f353fe00640 1 --2- 172.21.15.71:0/2773669553 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35400d0a70 0x7f35400ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.894+0000 7f353fe00640 1 -- 172.21.15.71:0/2773669553 >> v1:172.21.15.137:6789/0 conn(0x7f354006dbb0 legacy=0x7f35400d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:15.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.894+0000 7f353fe00640 1 -- 172.21.15.71:0/2773669553 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354006ed80 con 0x7f354015e8a0 2024-04-20T21:21:15.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.895+0000 7f353fe00640 1 --2- 172.21.15.71:0/2773669553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f354015e8a0 0x7f354006e1e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3530009e50 tx=0x7f353002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92327ab01761e861 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:15.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.895+0000 7f353ea00640 1 -- 172.21.15.71:0/2773669553 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353002ca70 con 0x7f354015e8a0 2024-04-20T21:21:15.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.895+0000 7f353ea00640 1 -- 172.21.15.71:0/2773669553 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353002cc10 con 0x7f354015e8a0 2024-04-20T21:21:15.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.895+0000 7f353ea00640 1 -- 172.21.15.71:0/2773669553 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35300343f0 con 0x7f354015e8a0 2024-04-20T21:21:15.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.896+0000 7f3546e00640 1 -- 172.21.15.71:0/2773669553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f354015e8a0 msgr2=0x7f354006e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.896+0000 7f3546e00640 1 --2- 172.21.15.71:0/2773669553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f354015e8a0 0x7f354006e1e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3530009e50 tx=0x7f353002bed0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.896+0000 7f3546e00640 1 -- 172.21.15.71:0/2773669553 shutdown_connections 2024-04-20T21:21:15.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.896+0000 7f3546e00640 1 --2- 172.21.15.71:0/2773669553 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35400d0a70 0x7f35400ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.896+0000 7f3546e00640 1 --2- 172.21.15.71:0/2773669553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f354015e8a0 0x7f354006e1e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.896+0000 7f3546e00640 1 -- 172.21.15.71:0/2773669553 >> 172.21.15.71:0/2773669553 conn(0x7f35400b3350 msgr2=0x7f35400b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:15.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.896+0000 7f3546e00640 1 -- 172.21.15.71:0/2773669553 shutdown_connections 2024-04-20T21:21:15.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.896+0000 7f3546e00640 1 -- 172.21.15.71:0/2773669553 wait complete. 2024-04-20T21:21:15.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.898+0000 7f3546e00640 1 Processor -- start 2024-04-20T21:21:15.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.898+0000 7f3546e00640 1 -- start start 2024-04-20T21:21:15.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.899+0000 7f3546e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f354006dbb0 0x7f354014b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.899+0000 7f3546e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35400d0a70 0x7f3540153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.899+0000 7f3546e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f354015e8a0 0x7f3540151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.899+0000 7f3546e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f354006fef0 con 0x7f354015e8a0 2024-04-20T21:21:15.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.899+0000 7f3546e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f354006fd70 con 0x7f35400d0a70 2024-04-20T21:21:15.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.899+0000 7f3546e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f35400adbc0 con 0x7f354006dbb0 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.899+0000 7f3544e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f354015e8a0 0x7f3540151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.899+0000 7f3544e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f354015e8a0 0x7f3540151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34664/0 (socket says 172.21.15.71:34664) 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.899+0000 7f3544e00640 1 -- 172.21.15.71:0/1982211068 learned_addr learned my addr 172.21.15.71:0/1982211068 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f353fe00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f354006dbb0 0x7f354014b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f3544e00640 1 -- 172.21.15.71:0/1982211068 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f354006dbb0 msgr2=0x7f354014b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f3544e00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f354006dbb0 0x7f354014b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f3544e00640 1 -- 172.21.15.71:0/1982211068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35400d0a70 msgr2=0x7f3540153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f3544e00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35400d0a70 0x7f3540153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f3544e00640 1 -- 172.21.15.71:0/1982211068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35401f4bb0 con 0x7f354015e8a0 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f353fe00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f354006dbb0 0x7f354014b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f3544e00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f354015e8a0 0x7f3540151810 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f353800b410 tx=0x7f353800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f3537e00640 1 -- 172.21.15.71:0/1982211068 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538015020 con 0x7f354015e8a0 2024-04-20T21:21:15.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f3537e00640 1 -- 172.21.15.71:0/1982211068 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3538011850 con 0x7f354015e8a0 2024-04-20T21:21:15.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f3537e00640 1 -- 172.21.15.71:0/1982211068 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538011c40 con 0x7f354015e8a0 2024-04-20T21:21:15.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f3546e00640 1 -- 172.21.15.71:0/1982211068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35401521d0 con 0x7f354015e8a0 2024-04-20T21:21:15.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.900+0000 7f3546e00640 1 -- 172.21.15.71:0/1982211068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3540152790 con 0x7f354015e8a0 2024-04-20T21:21:15.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.901+0000 7f3546e00640 1 -- 172.21.15.71:0/1982211068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3540068980 con 0x7f354015e8a0 2024-04-20T21:21:15.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.902+0000 7f3537e00640 1 -- 172.21.15.71:0/1982211068 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3538018020 con 0x7f354015e8a0 2024-04-20T21:21:15.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.903+0000 7f3537e00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f351c06c8f0 0x7f351c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:15.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.903+0000 7f3537e00640 1 -- 172.21.15.71:0/1982211068 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f353808bb40 con 0x7f354015e8a0 2024-04-20T21:21:15.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.903+0000 7f353fe00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f351c06c8f0 0x7f351c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:15.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.904+0000 7f353fe00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f351c06c8f0 0x7f351c06edb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3530035000 tx=0x7f3530030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:15.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:15.908+0000 7f3537e00640 1 -- 172.21.15.71:0/1982211068 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f353801f020 con 0x7f354015e8a0 2024-04-20T21:21:16.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.145+0000 7f3546e00640 1 -- 172.21.15.71:0/1982211068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f354006e500 con 0x7f354015e8a0 2024-04-20T21:21:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.856+0000 7f3537e00640 1 -- 172.21.15.71:0/1982211068 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f35380172c0 con 0x7f354015e8a0 2024-04-20T21:21:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.859+0000 7f3546e00640 1 -- 172.21.15.71:0/1982211068 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f351c06c8f0 msgr2=0x7f351c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.859+0000 7f3546e00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f351c06c8f0 0x7f351c06edb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3530035000 tx=0x7f3530030000 comp rx=0 tx=0).stop 2024-04-20T21:21:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.859+0000 7f3546e00640 1 -- 172.21.15.71:0/1982211068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f354015e8a0 msgr2=0x7f3540151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.859+0000 7f3546e00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f354015e8a0 0x7f3540151810 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f353800b410 tx=0x7f353800b8d0 comp rx=0 tx=0).stop 2024-04-20T21:21:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.860+0000 7f3546e00640 1 -- 172.21.15.71:0/1982211068 shutdown_connections 2024-04-20T21:21:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.860+0000 7f3546e00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f351c06c8f0 0x7f351c06edb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.860+0000 7f3546e00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f354015e8a0 0x7f3540151810 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.860+0000 7f3546e00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35400d0a70 0x7f3540153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.860+0000 7f3546e00640 1 --2- 172.21.15.71:0/1982211068 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f354006dbb0 0x7f354014b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.860+0000 7f3546e00640 1 -- 172.21.15.71:0/1982211068 >> 172.21.15.71:0/1982211068 conn(0x7f35400b3350 msgr2=0x7f354015f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.860+0000 7f3546e00640 1 -- 172.21.15.71:0/1982211068 shutdown_connections 2024-04-20T21:21:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:16.860+0000 7f3546e00640 1 -- 172.21.15.71:0/1982211068 wait complete. 2024-04-20T21:21:16.880 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-20T21:21:16.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-20T21:21:17.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.080+0000 7f156d000640 1 Processor -- start 2024-04-20T21:21:17.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.080+0000 7f156d000640 1 -- start start 2024-04-20T21:21:17.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.081+0000 7f156d000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1568161a50 0x7f15680b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:17.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.082+0000 7f156d000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f156806c010 0x7f15680ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:17.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.082+0000 7f156d000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15680d0980 con 0x7f15680d3b20 2024-04-20T21:21:17.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.082+0000 7f156d000640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f15680d0c60 con 0x7f156806c010 2024-04-20T21:21:17.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.082+0000 7f156d000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1568162ae0 con 0x7f1568161a50 2024-04-20T21:21:17.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.082+0000 7f1567e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f156806c010 0x7f15680ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:17.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.082+0000 7f1567e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f156806c010 0x7f15680ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34668/0 (socket says 172.21.15.71:34668) 2024-04-20T21:21:17.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.082+0000 7f1567e00640 1 -- 172.21.15.71:0/4145294625 learned_addr learned my addr 172.21.15.71:0/4145294625 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:17.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.082+0000 7f1567400640 1 --2- 172.21.15.71:0/4145294625 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1568161a50 0x7f15680b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:17.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.082+0000 7f1567e00640 1 -- 172.21.15.71:0/4145294625 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1568161a50 msgr2=0x7f15680b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:17.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.082+0000 7f1567e00640 1 --2- 172.21.15.71:0/4145294625 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1568161a50 0x7f15680b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:17.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.082+0000 7f1567e00640 1 -- 172.21.15.71:0/4145294625 >> v1:172.21.15.137:6789/0 conn(0x7f15680d3b20 legacy=0x7f156806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:17.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.083+0000 7f1567e00640 1 -- 172.21.15.71:0/4145294625 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1568162490 con 0x7f156806c010 2024-04-20T21:21:17.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.084+0000 7f1567e00640 1 --2- 172.21.15.71:0/4145294625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f156806c010 0x7f15680ceaa0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1560009870 tx=0x7f156002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6dd821f95c9bd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:17.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.084+0000 7f1566000640 1 -- 172.21.15.71:0/4145294625 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560035020 con 0x7f156806c010 2024-04-20T21:21:17.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.084+0000 7f1566000640 1 -- 172.21.15.71:0/4145294625 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1560031640 con 0x7f156806c010 2024-04-20T21:21:17.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.084+0000 7f1566000640 1 -- 172.21.15.71:0/4145294625 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156002d040 con 0x7f156806c010 2024-04-20T21:21:17.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.085+0000 7f156d000640 1 -- 172.21.15.71:0/4145294625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f156806c010 msgr2=0x7f15680ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:17.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.085+0000 7f156d000640 1 --2- 172.21.15.71:0/4145294625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f156806c010 0x7f15680ceaa0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1560009870 tx=0x7f156002b8f0 comp rx=0 tx=0).stop 2024-04-20T21:21:17.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.085+0000 7f156d000640 1 -- 172.21.15.71:0/4145294625 shutdown_connections 2024-04-20T21:21:17.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.085+0000 7f156d000640 1 --2- 172.21.15.71:0/4145294625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f156806c010 0x7f15680ceaa0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:17.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.085+0000 7f156d000640 1 --2- 172.21.15.71:0/4145294625 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1568161a50 0x7f15680b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:17.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.085+0000 7f156d000640 1 -- 172.21.15.71:0/4145294625 >> 172.21.15.71:0/4145294625 conn(0x7f15680d0ed0 msgr2=0x7f15680d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:17.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.085+0000 7f156d000640 1 -- 172.21.15.71:0/4145294625 shutdown_connections 2024-04-20T21:21:17.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.085+0000 7f156d000640 1 -- 172.21.15.71:0/4145294625 wait complete. 2024-04-20T21:21:17.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.087+0000 7f156d000640 1 Processor -- start 2024-04-20T21:21:17.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.087+0000 7f156d000640 1 -- start start 2024-04-20T21:21:17.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f156d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f156806c010 0x7f15681e98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:17.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f156d000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1568161a50 0x7f15680cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:17.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f156d000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15680cdaa0 0x7f15680b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:17.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f156d000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f15680d0600 con 0x7f15680cdaa0 2024-04-20T21:21:17.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f156d000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f15680d0480 con 0x7f156806c010 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f156d000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1568161e30 con 0x7f1568161a50 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f1567e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15680cdaa0 0x7f15680b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f1567e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15680cdaa0 0x7f15680b2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34682/0 (socket says 172.21.15.71:34682) 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f1567e00640 1 -- 172.21.15.71:0/3064947039 learned_addr learned my addr 172.21.15.71:0/3064947039 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f1567400640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f156806c010 0x7f15681e98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f1566a00640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1568161a50 0x7f15680cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f1567e00640 1 -- 172.21.15.71:0/3064947039 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1568161a50 msgr2=0x7f15680cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f1567e00640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1568161a50 0x7f15680cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f1567e00640 1 -- 172.21.15.71:0/3064947039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f156806c010 msgr2=0x7f15681e98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.088+0000 7f1567e00640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f156806c010 0x7f15681e98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.089+0000 7f1567e00640 1 -- 172.21.15.71:0/3064947039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15681f48f0 con 0x7f15680cdaa0 2024-04-20T21:21:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.089+0000 7f1567e00640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15680cdaa0 0x7f15680b2330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f156002b930 tx=0x7f15600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.089+0000 7f155f400640 1 -- 172.21.15.71:0/3064947039 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560040070 con 0x7f15680cdaa0 2024-04-20T21:21:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.089+0000 7f155f400640 1 -- 172.21.15.71:0/3064947039 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1560039cd0 con 0x7f15680cdaa0 2024-04-20T21:21:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.089+0000 7f156d000640 1 -- 172.21.15.71:0/3064947039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15680cc630 con 0x7f15680cdaa0 2024-04-20T21:21:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.089+0000 7f155f400640 1 -- 172.21.15.71:0/3064947039 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560035040 con 0x7f15680cdaa0 2024-04-20T21:21:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.089+0000 7f156d000640 1 -- 172.21.15.71:0/3064947039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15680ccbf0 con 0x7f15680cdaa0 2024-04-20T21:21:17.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.091+0000 7f156d000640 1 -- 172.21.15.71:0/3064947039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15680b3010 con 0x7f15680cdaa0 2024-04-20T21:21:17.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.091+0000 7f155f400640 1 -- 172.21.15.71:0/3064947039 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f156004b060 con 0x7f15680cdaa0 2024-04-20T21:21:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.092+0000 7f155f400640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f154406c8f0 0x7f154406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.092+0000 7f155f400640 1 -- 172.21.15.71:0/3064947039 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f15600ad8b0 con 0x7f15680cdaa0 2024-04-20T21:21:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.093+0000 7f1567400640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f154406c8f0 0x7f154406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.093+0000 7f1567400640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f154406c8f0 0x7f154406edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f15681e9fc0 tx=0x7f1558007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.097+0000 7f155f400640 1 -- 172.21.15.71:0/3064947039 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f15680b3010 con 0x7f15680cdaa0 2024-04-20T21:21:17.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.341+0000 7f156d000640 1 -- 172.21.15.71:0/3064947039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1568075b30 con 0x7f15680cdaa0 2024-04-20T21:21:17.767 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-20T21:21:17.768+0000 7f4e33c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T21:21:17.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.868+0000 7f155f400640 1 -- 172.21.15.71:0/3064947039 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f15681f48f0 con 0x7f15680cdaa0 2024-04-20T21:21:17.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 -- 172.21.15.71:0/3064947039 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f154406c8f0 msgr2=0x7f154406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:17.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f154406c8f0 0x7f154406edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f15681e9fc0 tx=0x7f1558007900 comp rx=0 tx=0).stop 2024-04-20T21:21:17.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 -- 172.21.15.71:0/3064947039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15680cdaa0 msgr2=0x7f15680b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:17.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15680cdaa0 0x7f15680b2330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f156002b930 tx=0x7f15600046c0 comp rx=0 tx=0).stop 2024-04-20T21:21:17.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 -- 172.21.15.71:0/3064947039 shutdown_connections 2024-04-20T21:21:17.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f154406c8f0 0x7f154406edb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:17.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15680cdaa0 0x7f15680b2330 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:17.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1568161a50 0x7f15680cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:17.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 --2- 172.21.15.71:0/3064947039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f156806c010 0x7f15681e98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:17.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 -- 172.21.15.71:0/3064947039 >> 172.21.15.71:0/3064947039 conn(0x7f15680d0ed0 msgr2=0x7f15680b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:17.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 -- 172.21.15.71:0/3064947039 shutdown_connections 2024-04-20T21:21:17.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:17.872+0000 7f156d000640 1 -- 172.21.15.71:0/3064947039 wait complete. 2024-04-20T21:21:17.892 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-20T21:21:17.892 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:21:18.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.088+0000 7fc3cac00640 1 Processor -- start 2024-04-20T21:21:18.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.088+0000 7fc3cac00640 1 -- start start 2024-04-20T21:21:18.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3cac00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc3c4159e10 0x7fc3c4071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3cac00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3c415a1f0 0x7fc3c4071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3cac00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c415cc90 con 0x7fc3c406da90 2024-04-20T21:21:18.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3cac00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc3c4072900 con 0x7fc3c415a1f0 2024-04-20T21:21:18.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3cac00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc3c415ca40 con 0x7fc3c4159e10 2024-04-20T21:21:18.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3c8e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3c415a1f0 0x7fc3c4071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3c8e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3c415a1f0 0x7fc3c4071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34686/0 (socket says 172.21.15.71:34686) 2024-04-20T21:21:18.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3c8e00640 1 -- 172.21.15.71:0/2645508830 learned_addr learned my addr 172.21.15.71:0/2645508830 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:18.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3c8e00640 1 -- 172.21.15.71:0/2645508830 >> v2:172.21.15.137:3300/0 conn(0x7fc3c4159e10 msgr2=0x7fc3c4071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:18.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3c8e00640 1 --2- 172.21.15.71:0/2645508830 >> v2:172.21.15.137:3300/0 conn(0x7fc3c4159e10 0x7fc3c4071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3c8e00640 1 -- 172.21.15.71:0/2645508830 >> v1:172.21.15.137:6789/0 conn(0x7fc3c406da90 legacy=0x7fc3c4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:18.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.090+0000 7fc3c8e00640 1 -- 172.21.15.71:0/2645508830 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c415cf70 con 0x7fc3c415a1f0 2024-04-20T21:21:18.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.092+0000 7fc3c8e00640 1 --2- 172.21.15.71:0/2645508830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3c415a1f0 0x7fc3c4071fc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4073f30 tx=0x7fc3b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eef556669e491b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:18.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.092+0000 7fc3c3e00640 1 -- 172.21.15.71:0/2645508830 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0035020 con 0x7fc3c415a1f0 2024-04-20T21:21:18.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.092+0000 7fc3c3e00640 1 -- 172.21.15.71:0/2645508830 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b0031870 con 0x7fc3c415a1f0 2024-04-20T21:21:18.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.092+0000 7fc3c3e00640 1 -- 172.21.15.71:0/2645508830 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0031c40 con 0x7fc3c415a1f0 2024-04-20T21:21:18.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.093+0000 7fc3cac00640 1 -- 172.21.15.71:0/2645508830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3c415a1f0 msgr2=0x7fc3c4071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.093+0000 7fc3cac00640 1 --2- 172.21.15.71:0/2645508830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3c415a1f0 0x7fc3c4071fc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4073f30 tx=0x7fc3b002b910 comp rx=0 tx=0).stop 2024-04-20T21:21:18.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.093+0000 7fc3cac00640 1 -- 172.21.15.71:0/2645508830 shutdown_connections 2024-04-20T21:21:18.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.093+0000 7fc3cac00640 1 --2- 172.21.15.71:0/2645508830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3c415a1f0 0x7fc3c4071fc0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.093+0000 7fc3cac00640 1 --2- 172.21.15.71:0/2645508830 >> v2:172.21.15.137:3300/0 conn(0x7fc3c4159e10 0x7fc3c4071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.093+0000 7fc3cac00640 1 -- 172.21.15.71:0/2645508830 >> 172.21.15.71:0/2645508830 conn(0x7fc3c40d0040 msgr2=0x7fc3c40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:18.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.093+0000 7fc3cac00640 1 -- 172.21.15.71:0/2645508830 shutdown_connections 2024-04-20T21:21:18.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.093+0000 7fc3cac00640 1 -- 172.21.15.71:0/2645508830 wait complete. 2024-04-20T21:21:18.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.095+0000 7fc3cac00640 1 Processor -- start 2024-04-20T21:21:18.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.095+0000 7fc3cac00640 1 -- start start 2024-04-20T21:21:18.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.096+0000 7fc3cac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3c406da90 0x7fc3c415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.096+0000 7fc3cac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c4159e10 0x7fc3c4151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.096+0000 7fc3cac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3c415a1f0 0x7fc3c4151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.096+0000 7fc3cac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c415d810 con 0x7fc3c415a1f0 2024-04-20T21:21:18.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.096+0000 7fc3cac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c415d530 con 0x7fc3c4159e10 2024-04-20T21:21:18.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.096+0000 7fc3cac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c406b900 con 0x7fc3c406da90 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.096+0000 7fc3ca200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3c415a1f0 0x7fc3c4151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.096+0000 7fc3ca200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3c415a1f0 0x7fc3c4151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34690/0 (socket says 172.21.15.71:34690) 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.096+0000 7fc3ca200640 1 -- 172.21.15.71:0/3281087765 learned_addr learned my addr 172.21.15.71:0/3281087765 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3c8e00640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c4159e10 0x7fc3c4151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3c9800640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3c406da90 0x7fc3c415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3ca200640 1 -- 172.21.15.71:0/3281087765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3c406da90 msgr2=0x7fc3c415db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3ca200640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3c406da90 0x7fc3c415db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3ca200640 1 -- 172.21.15.71:0/3281087765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c4159e10 msgr2=0x7fc3c4151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3ca200640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c4159e10 0x7fc3c4151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3ca200640 1 -- 172.21.15.71:0/3281087765 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c4157550 con 0x7fc3c415a1f0 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3c8e00640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c4159e10 0x7fc3c4151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:18.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3ca200640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3c415a1f0 0x7fc3c4151eb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c780 tx=0x7fc3bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:18.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3c1600640 1 -- 172.21.15.71:0/3281087765 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc017070 con 0x7fc3c415a1f0 2024-04-20T21:21:18.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3c1600640 1 -- 172.21.15.71:0/3281087765 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3bc003da0 con 0x7fc3c415a1f0 2024-04-20T21:21:18.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3c1600640 1 -- 172.21.15.71:0/3281087765 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0052b0 con 0x7fc3c415a1f0 2024-04-20T21:21:18.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3cac00640 1 -- 172.21.15.71:0/3281087765 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c4151c60 con 0x7fc3c415a1f0 2024-04-20T21:21:18.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.097+0000 7fc3cac00640 1 -- 172.21.15.71:0/3281087765 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c40c9940 con 0x7fc3c415a1f0 2024-04-20T21:21:18.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.099+0000 7fc3cac00640 1 -- 172.21.15.71:0/3281087765 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c4157720 con 0x7fc3c415a1f0 2024-04-20T21:21:18.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.100+0000 7fc3c1600640 1 -- 172.21.15.71:0/3281087765 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3bc01a070 con 0x7fc3c415a1f0 2024-04-20T21:21:18.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.100+0000 7fc3c1600640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc3a406c8f0 0x7fc3a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.101+0000 7fc3c1600640 1 -- 172.21.15.71:0/3281087765 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc3bc08b2e0 con 0x7fc3c415a1f0 2024-04-20T21:21:18.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.101+0000 7fc3c9800640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc3a406c8f0 0x7fc3a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.102+0000 7fc3c9800640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc3a406c8f0 0x7fc3a406edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800a810 tx=0x7fc3b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:18.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.105+0000 7fc3c1600640 1 -- 172.21.15.71:0/3281087765 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc3bc0595f0 con 0x7fc3c415a1f0 2024-04-20T21:21:18.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.339+0000 7fc3cac00640 1 -- 172.21.15.71:0/3281087765 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3c4071e00 con 0x7fc3c415a1f0 2024-04-20T21:21:18.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.340+0000 7fc3c1600640 1 -- 172.21.15.71:0/3281087765 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5202 (secure 0 0 0) 0x7fc3bc058ef0 con 0x7fc3c415a1f0 2024-04-20T21:21:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:18.339 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1486343753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1486343753},{"type":"v1","addr":"172.21.15.137:6834","nonce":1486343753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/861651173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":861651173},{"type":"v1","addr":"172.21.15.71:6835","nonce":861651173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5493,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1972589403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1972589403},{"type":"v1","addr":"172.21.15.71:6837","nonce":1972589403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:21:14.294863+0000","modified":"2024-04-20T21:21:17.341978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5505":{"gid":5505,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6835/3032319028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3032319028},{"type":"v1","addr":"172.21.15.137:6835","nonce":3032319028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5505,"qdb_cluster":[5505]},"id":2}]} 2024-04-20T21:21:18.340 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 17 2024-04-20T21:21:18.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.343+0000 7fc3cac00640 1 -- 172.21.15.71:0/3281087765 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc3a406c8f0 msgr2=0x7fc3a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.344+0000 7fc3cac00640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc3a406c8f0 0x7fc3a406edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800a810 tx=0x7fc3b8008040 comp rx=0 tx=0).stop 2024-04-20T21:21:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.344+0000 7fc3cac00640 1 -- 172.21.15.71:0/3281087765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3c415a1f0 msgr2=0x7fc3c4151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.344+0000 7fc3cac00640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3c415a1f0 0x7fc3c4151eb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c780 tx=0x7fc3bc00cc40 comp rx=0 tx=0).stop 2024-04-20T21:21:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.344+0000 7fc3cac00640 1 -- 172.21.15.71:0/3281087765 shutdown_connections 2024-04-20T21:21:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.344+0000 7fc3cac00640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc3a406c8f0 0x7fc3a406edb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.344+0000 7fc3cac00640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3c415a1f0 0x7fc3c4151eb0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.344+0000 7fc3cac00640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c4159e10 0x7fc3c4151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.344+0000 7fc3cac00640 1 --2- 172.21.15.71:0/3281087765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3c406da90 0x7fc3c415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.344+0000 7fc3cac00640 1 -- 172.21.15.71:0/3281087765 >> 172.21.15.71:0/3281087765 conn(0x7fc3c40d0040 msgr2=0x7fc3c41553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.344+0000 7fc3cac00640 1 -- 172.21.15.71:0/3281087765 shutdown_connections 2024-04-20T21:21:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.344+0000 7fc3cac00640 1 -- 172.21.15.71:0/3281087765 wait complete. 2024-04-20T21:21:18.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:21:18.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.547+0000 7f70ee400640 1 Processor -- start 2024-04-20T21:21:18.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.548+0000 7f70ee400640 1 -- start start 2024-04-20T21:21:18.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.549+0000 7f70ee400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f70e8159e10 0x7f70e8071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.549+0000 7f70ee400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f70e815a1f0 0x7f70e8071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.549+0000 7f70ee400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e806da90 0x7f70e8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.549+0000 7f70ee400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f70e8072900 con 0x7f70e815a1f0 2024-04-20T21:21:18.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.549+0000 7f70ee400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f70e815ca40 con 0x7f70e8159e10 2024-04-20T21:21:18.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.549+0000 7f70ee400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f70e815cc90 con 0x7f70e806da90 2024-04-20T21:21:18.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.550+0000 7f70e7e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f70e815a1f0 0x7f70e8071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.550+0000 7f70e7e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f70e815a1f0 0x7f70e8071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34706/0 (socket says 172.21.15.71:34706) 2024-04-20T21:21:18.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.550+0000 7f70e7e00640 1 -- 172.21.15.71:0/1786825454 learned_addr learned my addr 172.21.15.71:0/1786825454 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:18.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.550+0000 7f70ed000640 1 --2- 172.21.15.71:0/1786825454 >> v2:172.21.15.137:3300/0 conn(0x7f70e8159e10 0x7f70e8071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.550+0000 7f70e7e00640 1 -- 172.21.15.71:0/1786825454 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e806da90 msgr2=0x7f70e8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:18.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.550+0000 7f70e7e00640 1 --2- 172.21.15.71:0/1786825454 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e806da90 0x7f70e8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.550+0000 7f70e7e00640 1 -- 172.21.15.71:0/1786825454 >> v2:172.21.15.137:3300/0 conn(0x7f70e8159e10 msgr2=0x7f70e8071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:18.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.550+0000 7f70e7e00640 1 --2- 172.21.15.71:0/1786825454 >> v2:172.21.15.137:3300/0 conn(0x7f70e8159e10 0x7f70e8071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.550+0000 7f70e7e00640 1 -- 172.21.15.71:0/1786825454 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e815cf70 con 0x7f70e815a1f0 2024-04-20T21:21:18.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.550+0000 7f70ed000640 1 --2- 172.21.15.71:0/1786825454 >> v2:172.21.15.137:3300/0 conn(0x7f70e8159e10 0x7f70e8071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:18.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.551+0000 7f70e7e00640 1 --2- 172.21.15.71:0/1786825454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e815a1f0 0x7f70e8071fc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f70e8073f30 tx=0x7f70d402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fc0d09e98b50ed server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:18.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.551+0000 7f70e7400640 1 -- 172.21.15.71:0/1786825454 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4035020 con 0x7f70e815a1f0 2024-04-20T21:21:18.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.552+0000 7f70e7400640 1 -- 172.21.15.71:0/1786825454 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d402d040 con 0x7f70e815a1f0 2024-04-20T21:21:18.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.552+0000 7f70e7400640 1 -- 172.21.15.71:0/1786825454 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4031a80 con 0x7f70e815a1f0 2024-04-20T21:21:18.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.552+0000 7f70ee400640 1 -- 172.21.15.71:0/1786825454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e815a1f0 msgr2=0x7f70e8071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.552+0000 7f70ee400640 1 --2- 172.21.15.71:0/1786825454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e815a1f0 0x7f70e8071fc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f70e8073f30 tx=0x7f70d402b900 comp rx=0 tx=0).stop 2024-04-20T21:21:18.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.552+0000 7f70ee400640 1 -- 172.21.15.71:0/1786825454 shutdown_connections 2024-04-20T21:21:18.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.552+0000 7f70ee400640 1 --2- 172.21.15.71:0/1786825454 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e806da90 0x7f70e8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.552+0000 7f70ee400640 1 --2- 172.21.15.71:0/1786825454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e815a1f0 0x7f70e8071fc0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.552+0000 7f70ee400640 1 --2- 172.21.15.71:0/1786825454 >> v2:172.21.15.137:3300/0 conn(0x7f70e8159e10 0x7f70e8071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.552+0000 7f70ee400640 1 -- 172.21.15.71:0/1786825454 >> 172.21.15.71:0/1786825454 conn(0x7f70e80d0040 msgr2=0x7f70e80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:18.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.552+0000 7f70ee400640 1 -- 172.21.15.71:0/1786825454 shutdown_connections 2024-04-20T21:21:18.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.552+0000 7f70ee400640 1 -- 172.21.15.71:0/1786825454 wait complete. 2024-04-20T21:21:18.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.554+0000 7f70ee400640 1 Processor -- start 2024-04-20T21:21:18.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.554+0000 7f70ee400640 1 -- start start 2024-04-20T21:21:18.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.555+0000 7f70ee400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e806da90 0x7f70e81f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.555+0000 7f70ee400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70e8159e10 0x7f70e81f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.555+0000 7f70ee400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e815a1f0 0x7f70e81545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.555+0000 7f70ee400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f70e815d810 con 0x7f70e815a1f0 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.555+0000 7f70ee400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70e815d530 con 0x7f70e8159e10 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.555+0000 7f70ee400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f70e806b900 con 0x7f70e806da90 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.555+0000 7f70eda00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e815a1f0 0x7f70e81545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.555+0000 7f70eda00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e815a1f0 0x7f70e81545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34708/0 (socket says 172.21.15.71:34708) 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.555+0000 7f70eda00640 1 -- 172.21.15.71:0/3302083998 learned_addr learned my addr 172.21.15.71:0/3302083998 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.556+0000 7f70ed000640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e806da90 0x7f70e81f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.556+0000 7f70eda00640 1 -- 172.21.15.71:0/3302083998 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e806da90 msgr2=0x7f70e81f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.556+0000 7f70eda00640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e806da90 0x7f70e81f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.556+0000 7f70e7e00640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70e8159e10 0x7f70e81f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.556+0000 7f70eda00640 1 -- 172.21.15.71:0/3302083998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70e8159e10 msgr2=0x7f70e81f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.556+0000 7f70eda00640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70e8159e10 0x7f70e81f1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.556+0000 7f70eda00640 1 -- 172.21.15.71:0/3302083998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e80cd1b0 con 0x7f70e815a1f0 2024-04-20T21:21:18.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.556+0000 7f70ed000640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e806da90 0x7f70e81f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:18.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.556+0000 7f70eda00640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e815a1f0 0x7f70e81545c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f70e000b970 tx=0x7f70e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:18.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.556+0000 7f70e4c00640 1 -- 172.21.15.71:0/3302083998 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0019070 con 0x7f70e815a1f0 2024-04-20T21:21:18.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.557+0000 7f70e4c00640 1 -- 172.21.15.71:0/3302083998 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e000cb60 con 0x7f70e815a1f0 2024-04-20T21:21:18.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.557+0000 7f70e4c00640 1 -- 172.21.15.71:0/3302083998 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0014440 con 0x7f70e815a1f0 2024-04-20T21:21:18.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.557+0000 7f70ee400640 1 -- 172.21.15.71:0/3302083998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e815db10 con 0x7f70e815a1f0 2024-04-20T21:21:18.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.557+0000 7f70ee400640 1 -- 172.21.15.71:0/3302083998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e815e0d0 con 0x7f70e815a1f0 2024-04-20T21:21:18.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.558+0000 7f70ee400640 1 -- 172.21.15.71:0/3302083998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e8075b60 con 0x7f70e815a1f0 2024-04-20T21:21:18.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.559+0000 7f70e4c00640 1 -- 172.21.15.71:0/3302083998 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f70e001c070 con 0x7f70e815a1f0 2024-04-20T21:21:18.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.560+0000 7f70e4c00640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70c806c8f0 0x7f70c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.560+0000 7f70e4c00640 1 -- 172.21.15.71:0/3302083998 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f70e008ba10 con 0x7f70e815a1f0 2024-04-20T21:21:18.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.560+0000 7f70ed000640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70c806c8f0 0x7f70c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.561+0000 7f70ed000640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70c806c8f0 0x7f70c806edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70dc006fd0 tx=0x7f70dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:18.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.565+0000 7f70e4c00640 1 -- 172.21.15.71:0/3302083998 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f70e80cd1b0 con 0x7f70e815a1f0 2024-04-20T21:21:18.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.758+0000 7f70ee400640 1 -- 172.21.15.71:0/3302083998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70e81558a0 con 0x7f70e815a1f0 2024-04-20T21:21:18.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.761+0000 7f70e4c00640 1 -- 172.21.15.71:0/3302083998 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16918 (secure 0 0 0) 0x7f70e0059cb0 con 0x7f70e815a1f0 2024-04-20T21:21:18.760 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:18.760 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":39,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","created":"2024-04-20T21:19:04.591183+0000","modified":"2024-04-20T21:21:15.842340+0000","last_up_change":"2024-04-20T21:19:17.210632+0000","last_in_change":"2024-04-20T21:19:07.841666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:19:17.829506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-20T21:21:12.044011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-20T21:21:13.266538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a47e3be4-c3de-4701-add3-a0e02bf6f343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6801","nonce":540495591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6803","nonce":540495591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6807","nonce":540495591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":540495591},{"type":"v1","addr":"172.21.15.71:6805","nonce":540495591}]},"public_addr":"172.21.15.71:6801/540495591","cluster_addr":"172.21.15.71:6803/540495591","heartbeat_back_addr":"172.21.15.71:6807/540495591","heartbeat_front_addr":"172.21.15.71:6805/540495591","state":["exists","up"]},{"osd":1,"uuid":"fa82906b-04fc-437c-a3cc-cf2c2b492b41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6816","nonce":1038059240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6819","nonce":1038059240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6823","nonce":1038059240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1038059240},{"type":"v1","addr":"172.21.15.71:6821","nonce":1038059240}]},"public_addr":"172.21.15.71:6816/1038059240","cluster_addr":"172.21.15.71:6819/1038059240","heartbeat_back_addr":"172.21.15.71:6823/1038059240","heartbeat_front_addr":"172.21.15.71:6821/1038059240","state":["exists","up"]},{"osd":2,"uuid":"e0e07bfe-ce03-4b5b-9699-99745ba92f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6809","nonce":2463711085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6811","nonce":2463711085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6815","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6817","nonce":2463711085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2463711085},{"type":"v1","addr":"172.21.15.71:6813","nonce":2463711085}]},"public_addr":"172.21.15.71:6809/2463711085","cluster_addr":"172.21.15.71:6811/2463711085","heartbeat_back_addr":"172.21.15.71:6817/2463711085","heartbeat_front_addr":"172.21.15.71:6813/2463711085","state":["exists","up"]},{"osd":3,"uuid":"cb81eb8b-d46b-44e1-9b17-f235e458ac38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6825","nonce":2731317252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6827","nonce":2731317252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6831","nonce":2731317252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2731317252},{"type":"v1","addr":"172.21.15.71:6829","nonce":2731317252}]},"public_addr":"172.21.15.71:6825/2731317252","cluster_addr":"172.21.15.71:6827/2731317252","heartbeat_back_addr":"172.21.15.71:6831/2731317252","heartbeat_front_addr":"172.21.15.71:6829/2731317252","state":["exists","up"]},{"osd":4,"uuid":"b97d7a8d-8636-46f4-b83b-a5af50c60430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6815","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6818","nonce":3627885436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6823","nonce":3627885436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6829","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6831","nonce":3627885436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":3627885436},{"type":"v1","addr":"172.21.15.137:6827","nonce":3627885436}]},"public_addr":"172.21.15.137:6818/3627885436","cluster_addr":"172.21.15.137:6823/3627885436","heartbeat_back_addr":"172.21.15.137:6831/3627885436","heartbeat_front_addr":"172.21.15.137:6827/3627885436","state":["exists","up"]},{"osd":5,"uuid":"eac24a35-2c63-4936-8127-b428e91485d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6816","nonce":2530248769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6822","nonce":2530248769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6830","nonce":2530248769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2530248769},{"type":"v1","addr":"172.21.15.137:6826","nonce":2530248769}]},"public_addr":"172.21.15.137:6816/2530248769","cluster_addr":"172.21.15.137:6822/2530248769","heartbeat_back_addr":"172.21.15.137:6830/2530248769","heartbeat_front_addr":"172.21.15.137:6826/2530248769","state":["exists","up"]},{"osd":6,"uuid":"f5ed051c-e34c-4d88-90a7-612c88d5b6cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6801","nonce":604238808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6803","nonce":604238808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6807","nonce":604238808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":604238808},{"type":"v1","addr":"172.21.15.137:6805","nonce":604238808}]},"public_addr":"172.21.15.137:6801/604238808","cluster_addr":"172.21.15.137:6803/604238808","heartbeat_back_addr":"172.21.15.137:6807/604238808","heartbeat_front_addr":"172.21.15.137:6805/604238808","state":["exists","up"]},{"osd":7,"uuid":"96df7b9e-3d3e-43e3-bfb2-df648e4fbc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6809","nonce":576639340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6811","nonce":576639340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6821","nonce":576639340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":576639340},{"type":"v1","addr":"172.21.15.137:6813","nonce":576639340}]},"public_addr":"172.21.15.137:6809/576639340","cluster_addr":"172.21.15.137:6811/576639340","heartbeat_back_addr":"172.21.15.137:6821/576639340","heartbeat_front_addr":"172.21.15.137:6813/576639340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.216018+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.520025+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.538235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.026027+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.254368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.302963+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.188926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:19:13.055654+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:21:18.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.763+0000 7f70ee400640 1 -- 172.21.15.71:0/3302083998 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70c806c8f0 msgr2=0x7f70c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.763+0000 7f70ee400640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70c806c8f0 0x7f70c806edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70dc006fd0 tx=0x7f70dc008040 comp rx=0 tx=0).stop 2024-04-20T21:21:18.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.763+0000 7f70ee400640 1 -- 172.21.15.71:0/3302083998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e815a1f0 msgr2=0x7f70e81545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.763+0000 7f70ee400640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e815a1f0 0x7f70e81545c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f70e000b970 tx=0x7f70e000be30 comp rx=0 tx=0).stop 2024-04-20T21:21:18.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.763+0000 7f70ee400640 1 -- 172.21.15.71:0/3302083998 shutdown_connections 2024-04-20T21:21:18.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.763+0000 7f70ee400640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f70c806c8f0 0x7f70c806edb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.763+0000 7f70ee400640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70e815a1f0 0x7f70e81545c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.763+0000 7f70ee400640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70e8159e10 0x7f70e81f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.763+0000 7f70ee400640 1 --2- 172.21.15.71:0/3302083998 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e806da90 0x7f70e81f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.763+0000 7f70ee400640 1 -- 172.21.15.71:0/3302083998 >> 172.21.15.71:0/3302083998 conn(0x7f70e80d0040 msgr2=0x7f70e80afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:18.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.764+0000 7f70ee400640 1 -- 172.21.15.71:0/3302083998 shutdown_connections 2024-04-20T21:21:18.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.764+0000 7f70ee400640 1 -- 172.21.15.71:0/3302083998 wait complete. 2024-04-20T21:21:18.780 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-20T21:21:18.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T21:21:18.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.967+0000 7fdb05200640 1 Processor -- start 2024-04-20T21:21:18.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.968+0000 7fdb05200640 1 -- start start 2024-04-20T21:21:18.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.969+0000 7fdb05200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdb0015e8a0 0x7fdb0006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.969+0000 7fdb05200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb0006dbb0 0x7fdb000d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.969+0000 7fdb05200640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdb000d08a0 0x7fdb0006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.969+0000 7fdb05200640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fdb0006f060 con 0x7fdb000d08a0 2024-04-20T21:21:18.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.969+0000 7fdb05200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdb0006e7c0 con 0x7fdb0015e8a0 2024-04-20T21:21:18.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.969+0000 7fdb05200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0006eaa0 con 0x7fdb0006dbb0 2024-04-20T21:21:18.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.969+0000 7fdafe800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdb000d08a0 0x7fdb0006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.969+0000 7fdafe800640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdb000d08a0 0x7fdb0006b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34716/0 (socket says 172.21.15.71:34716) 2024-04-20T21:21:18.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.969+0000 7fdafe800640 1 -- 172.21.15.71:0/150821597 learned_addr learned my addr 172.21.15.71:0/150821597 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:18.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.970+0000 7fdafd400640 1 --2- 172.21.15.71:0/150821597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb0006dbb0 0x7fdb000d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.970+0000 7fdafe800640 1 -- 172.21.15.71:0/150821597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb0006dbb0 msgr2=0x7fdb000d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:18.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.970+0000 7fdafe800640 1 --2- 172.21.15.71:0/150821597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb0006dbb0 0x7fdb000d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.970+0000 7fdafe800640 1 -- 172.21.15.71:0/150821597 >> v2:172.21.15.137:3300/0 conn(0x7fdb0015e8a0 msgr2=0x7fdb0006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:18.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.970+0000 7fdafe800640 1 --2- 172.21.15.71:0/150821597 >> v2:172.21.15.137:3300/0 conn(0x7fdb0015e8a0 0x7fdb0006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.970+0000 7fdafe800640 1 -- 172.21.15.71:0/150821597 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0006ed80 con 0x7fdb000d08a0 2024-04-20T21:21:18.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.970+0000 7fdafd400640 1 --2- 172.21.15.71:0/150821597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb0006dbb0 0x7fdb000d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:18.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.971+0000 7fdafe800640 1 --2- 172.21.15.71:0/150821597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb000d08a0 0x7fdb0006b900 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdb0006d380 tx=0x7fdaf802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c092a682b9504e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:18.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.971+0000 7fdafca00640 1 -- 172.21.15.71:0/150821597 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8035020 con 0x7fdb000d08a0 2024-04-20T21:21:18.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.971+0000 7fdafca00640 1 -- 172.21.15.71:0/150821597 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf8031870 con 0x7fdb000d08a0 2024-04-20T21:21:18.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.971+0000 7fdafca00640 1 -- 172.21.15.71:0/150821597 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8031c40 con 0x7fdb000d08a0 2024-04-20T21:21:18.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.972+0000 7fdb05200640 1 -- 172.21.15.71:0/150821597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb000d08a0 msgr2=0x7fdb0006b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.972+0000 7fdb05200640 1 --2- 172.21.15.71:0/150821597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb000d08a0 0x7fdb0006b900 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdb0006d380 tx=0x7fdaf802b910 comp rx=0 tx=0).stop 2024-04-20T21:21:18.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.972+0000 7fdb05200640 1 -- 172.21.15.71:0/150821597 shutdown_connections 2024-04-20T21:21:18.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.972+0000 7fdb05200640 1 --2- 172.21.15.71:0/150821597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb000d08a0 0x7fdb0006b900 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.972+0000 7fdb05200640 1 --2- 172.21.15.71:0/150821597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb0006dbb0 0x7fdb000d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.972+0000 7fdb05200640 1 --2- 172.21.15.71:0/150821597 >> v2:172.21.15.137:3300/0 conn(0x7fdb0015e8a0 0x7fdb0006e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.972+0000 7fdb05200640 1 -- 172.21.15.71:0/150821597 >> 172.21.15.71:0/150821597 conn(0x7fdb000b3350 msgr2=0x7fdb000b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:18.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.972+0000 7fdb05200640 1 -- 172.21.15.71:0/150821597 shutdown_connections 2024-04-20T21:21:18.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.972+0000 7fdb05200640 1 -- 172.21.15.71:0/150821597 wait complete. 2024-04-20T21:21:18.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.974+0000 7fdb05200640 1 Processor -- start 2024-04-20T21:21:18.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.974+0000 7fdb05200640 1 -- start start 2024-04-20T21:21:18.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdb05200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb0006dbb0 0x7fdb001573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdb05200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb000d08a0 0x7fdb00160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdb05200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb0015e8a0 0x7fdb00161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdb05200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0006fef0 con 0x7fdb000d08a0 2024-04-20T21:21:18.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdb05200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0006fd70 con 0x7fdb0006dbb0 2024-04-20T21:21:18.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdb05200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0006be40 con 0x7fdb0015e8a0 2024-04-20T21:21:18.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdafd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb000d08a0 0x7fdb00160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdafd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb000d08a0 0x7fdb00160e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34720/0 (socket says 172.21.15.71:34720) 2024-04-20T21:21:18.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdafd400640 1 -- 172.21.15.71:0/1801956194 learned_addr learned my addr 172.21.15.71:0/1801956194 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:18.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdafde00640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb0006dbb0 0x7fdb001573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdafd400640 1 -- 172.21.15.71:0/1801956194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb0015e8a0 msgr2=0x7fdb00161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdafd400640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb0015e8a0 0x7fdb00161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdafd400640 1 -- 172.21.15.71:0/1801956194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb0006dbb0 msgr2=0x7fdb001573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdafd400640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb0006dbb0 0x7fdb001573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.975+0000 7fdafd400640 1 -- 172.21.15.71:0/1801956194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb00157cd0 con 0x7fdb000d08a0 2024-04-20T21:21:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.976+0000 7fdafd400640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb000d08a0 0x7fdb00160e30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fdae800c820 tx=0x7fdae800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.976+0000 7fdaf6000640 1 -- 172.21.15.71:0/1801956194 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8015070 con 0x7fdb000d08a0 2024-04-20T21:21:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.976+0000 7fdaf6000640 1 -- 172.21.15.71:0/1801956194 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae8007a30 con 0x7fdb000d08a0 2024-04-20T21:21:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.976+0000 7fdb05200640 1 -- 172.21.15.71:0/1801956194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb00157fb0 con 0x7fdb000d08a0 2024-04-20T21:21:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.976+0000 7fdaf6000640 1 -- 172.21.15.71:0/1801956194 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8007e00 con 0x7fdb000d08a0 2024-04-20T21:21:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.976+0000 7fdb05200640 1 -- 172.21.15.71:0/1801956194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb00158570 con 0x7fdb000d08a0 2024-04-20T21:21:18.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.977+0000 7fdb05200640 1 -- 172.21.15.71:0/1801956194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb00068980 con 0x7fdb000d08a0 2024-04-20T21:21:18.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.978+0000 7fdaf6000640 1 -- 172.21.15.71:0/1801956194 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdae8018070 con 0x7fdb000d08a0 2024-04-20T21:21:18.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.979+0000 7fdaf6000640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdadc06c920 0x7fdadc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.979+0000 7fdaf6000640 1 -- 172.21.15.71:0/1801956194 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fdae808bd50 con 0x7fdb000d08a0 2024-04-20T21:21:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.979+0000 7fdafde00640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdadc06c920 0x7fdadc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.980+0000 7fdafde00640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdadc06c920 0x7fdadc06ede0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0007dc0 tx=0x7fdaf00072f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:18.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:18.983+0000 7fdaf6000640 1 -- 172.21.15.71:0/1801956194 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fdae8059ec0 con 0x7fdb000d08a0 2024-04-20T21:21:19.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.178+0000 7fdb05200640 1 -- 172.21.15.71:0/1801956194 --> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb0015dca0 con 0x7fdadc06c920 2024-04-20T21:21:19.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.186+0000 7fdaf6000640 1 -- 172.21.15.71:0/1801956194 <== mgr.4110 v2:172.21.15.71:6832/1511456036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240073 (secure 0 0 0) 0x7fdb0015dca0 con 0x7fdadc06c920 2024-04-20T21:21:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:19.190 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-20T21:21:19.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.192+0000 7fdb05200640 1 -- 172.21.15.71:0/1801956194 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdadc06c920 msgr2=0x7fdadc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:19.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.192+0000 7fdb05200640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdadc06c920 0x7fdadc06ede0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0007dc0 tx=0x7fdaf00072f0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.192+0000 7fdb05200640 1 -- 172.21.15.71:0/1801956194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb000d08a0 msgr2=0x7fdb00160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:19.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.192+0000 7fdb05200640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb000d08a0 0x7fdb00160e30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fdae800c820 tx=0x7fdae800cc20 comp rx=0 tx=0).stop 2024-04-20T21:21:19.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.193+0000 7fdb05200640 1 -- 172.21.15.71:0/1801956194 shutdown_connections 2024-04-20T21:21:19.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.193+0000 7fdb05200640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fdadc06c920 0x7fdadc06ede0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.193+0000 7fdb05200640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb0015e8a0 0x7fdb00161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.193+0000 7fdb05200640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb000d08a0 0x7fdb00160e30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.193+0000 7fdb05200640 1 --2- 172.21.15.71:0/1801956194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb0006dbb0 0x7fdb001573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.193+0000 7fdb05200640 1 -- 172.21.15.71:0/1801956194 >> 172.21.15.71:0/1801956194 conn(0x7fdb000b3350 msgr2=0x7fdb000728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:19.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.193+0000 7fdb05200640 1 -- 172.21.15.71:0/1801956194 shutdown_connections 2024-04-20T21:21:19.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.193+0000 7fdb05200640 1 -- 172.21.15.71:0/1801956194 wait complete. 2024-04-20T21:21:19.210 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-04-20T21:21:17.832952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220516,"kb_used_data":4296,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754204,"statfs":{"total":773094113280,"available":772868304896,"internally_reserved":0,"allocated":4399104,"data_stored":2545472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.029235"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.813347+0000","last_change":"2024-04-20T21:21:12.813347+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.813347+0000","last_undegraded":"2024-04-20T21:21:12.813347+0000","last_fullsized":"2024-04-20T21:21:12.813347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.815442+0000","last_change":"2024-04-20T21:21:12.815442+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.815442+0000","last_undegraded":"2024-04-20T21:21:12.815442+0000","last_fullsized":"2024-04-20T21:21:12.815442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820755+0000","last_change":"2024-04-20T21:21:12.820755+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820755+0000","last_undegraded":"2024-04-20T21:21:12.820755+0000","last_fullsized":"2024-04-20T21:21:12.820755+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.823266+0000","last_change":"2024-04-20T21:21:12.823266+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.823266+0000","last_undegraded":"2024-04-20T21:21:12.823266+0000","last_fullsized":"2024-04-20T21:21:12.823266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.819842+0000","last_change":"2024-04-20T21:21:12.819842+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.819842+0000","last_undegraded":"2024-04-20T21:21:12.819842+0000","last_fullsized":"2024-04-20T21:21:12.819842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.812871+0000","last_change":"2024-04-20T21:21:12.812871+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.812871+0000","last_undegraded":"2024-04-20T21:21:12.812871+0000","last_fullsized":"2024-04-20T21:21:12.812871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820709+0000","last_change":"2024-04-20T21:21:12.820709+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820709+0000","last_undegraded":"2024-04-20T21:21:12.820709+0000","last_fullsized":"2024-04-20T21:21:12.820709+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.821466+0000","last_change":"2024-04-20T21:21:12.821466+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.821466+0000","last_undegraded":"2024-04-20T21:21:12.821466+0000","last_fullsized":"2024-04-20T21:21:12.821466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.828113+0000","last_change":"2024-04-20T21:21:12.828113+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.828113+0000","last_undegraded":"2024-04-20T21:21:12.828113+0000","last_fullsized":"2024-04-20T21:21:12.828113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820662+0000","last_change":"2024-04-20T21:21:12.820662+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820662+0000","last_undegraded":"2024-04-20T21:21:12.820662+0000","last_fullsized":"2024-04-20T21:21:12.820662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820041+0000","last_change":"2024-04-20T21:21:12.820041+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820041+0000","last_undegraded":"2024-04-20T21:21:12.820041+0000","last_fullsized":"2024-04-20T21:21:12.820041+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.827549+0000","last_change":"2024-04-20T21:21:12.827549+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.827549+0000","last_undegraded":"2024-04-20T21:21:12.827549+0000","last_fullsized":"2024-04-20T21:21:12.827549+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.827014+0000","last_change":"2024-04-20T21:21:12.827014+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.827014+0000","last_undegraded":"2024-04-20T21:21:12.827014+0000","last_fullsized":"2024-04-20T21:21:12.827014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820507+0000","last_change":"2024-04-20T21:21:12.820507+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820507+0000","last_undegraded":"2024-04-20T21:21:12.820507+0000","last_fullsized":"2024-04-20T21:21:12.820507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.812865+0000","last_change":"2024-04-20T21:21:12.812865+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.812865+0000","last_undegraded":"2024-04-20T21:21:12.812865+0000","last_fullsized":"2024-04-20T21:21:12.812865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811476+0000","last_change":"2024-04-20T21:21:12.811476+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811476+0000","last_undegraded":"2024-04-20T21:21:12.811476+0000","last_fullsized":"2024-04-20T21:21:12.811476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.821293+0000","last_change":"2024-04-20T21:21:12.821293+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.821293+0000","last_undegraded":"2024-04-20T21:21:12.821293+0000","last_fullsized":"2024-04-20T21:21:12.821293+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.822319+0000","last_change":"2024-04-20T21:21:12.822319+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.822319+0000","last_undegraded":"2024-04-20T21:21:12.822319+0000","last_fullsized":"2024-04-20T21:21:12.822319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811710+0000","last_change":"2024-04-20T21:21:12.811710+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811710+0000","last_undegraded":"2024-04-20T21:21:12.811710+0000","last_fullsized":"2024-04-20T21:21:12.811710+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820684+0000","last_change":"2024-04-20T21:21:12.820684+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820684+0000","last_undegraded":"2024-04-20T21:21:12.820684+0000","last_fullsized":"2024-04-20T21:21:12.820684+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811501+0000","last_change":"2024-04-20T21:21:12.811501+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811501+0000","last_undegraded":"2024-04-20T21:21:12.811501+0000","last_fullsized":"2024-04-20T21:21:12.811501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811537+0000","last_change":"2024-04-20T21:21:12.811537+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811537+0000","last_undegraded":"2024-04-20T21:21:12.811537+0000","last_fullsized":"2024-04-20T21:21:12.811537+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811484+0000","last_change":"2024-04-20T21:21:12.811484+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811484+0000","last_undegraded":"2024-04-20T21:21:12.811484+0000","last_fullsized":"2024-04-20T21:21:12.811484+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811501+0000","last_change":"2024-04-20T21:21:12.811501+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811501+0000","last_undegraded":"2024-04-20T21:21:12.811501+0000","last_fullsized":"2024-04-20T21:21:12.811501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820124+0000","last_change":"2024-04-20T21:21:12.820124+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820124+0000","last_undegraded":"2024-04-20T21:21:12.820124+0000","last_fullsized":"2024-04-20T21:21:12.820124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811538+0000","last_change":"2024-04-20T21:21:12.811538+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811538+0000","last_undegraded":"2024-04-20T21:21:12.811538+0000","last_fullsized":"2024-04-20T21:21:12.811538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.814810+0000","last_change":"2024-04-20T21:21:12.814810+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.814810+0000","last_undegraded":"2024-04-20T21:21:12.814810+0000","last_fullsized":"2024-04-20T21:21:12.814810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.815022+0000","last_change":"2024-04-20T21:21:12.815022+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.815022+0000","last_undegraded":"2024-04-20T21:21:12.815022+0000","last_fullsized":"2024-04-20T21:21:12.815022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.814635+0000","last_change":"2024-04-20T21:21:12.814635+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.814635+0000","last_undegraded":"2024-04-20T21:21:12.814635+0000","last_fullsized":"2024-04-20T21:21:12.814635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.823371+0000","last_change":"2024-04-20T21:21:12.823371+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.823371+0000","last_undegraded":"2024-04-20T21:21:12.823371+0000","last_fullsized":"2024-04-20T21:21:12.823371+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.826441+0000","last_change":"2024-04-20T21:21:12.826441+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.826441+0000","last_undegraded":"2024-04-20T21:21:12.826441+0000","last_fullsized":"2024-04-20T21:21:12.826441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811717+0000","last_change":"2024-04-20T21:21:12.811717+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811717+0000","last_undegraded":"2024-04-20T21:21:12.811717+0000","last_fullsized":"2024-04-20T21:21:12.811717+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-20T21:21:12.815633+0000","last_change":"2024-04-20T21:19:19.292405+0000","last_active":"2024-04-20T21:21:12.815633+0000","last_peered":"2024-04-20T21:21:12.815633+0000","last_clean":"2024-04-20T21:21:12.815633+0000","last_became_active":"2024-04-20T21:19:19.290107+0000","last_became_peered":"2024-04-20T21:19:19.290107+0000","last_unstale":"2024-04-20T21:21:12.815633+0000","last_undegraded":"2024-04-20T21:21:12.815633+0000","last_fullsized":"2024-04-20T21:21:12.815633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_clean_scrub_stamp":"2024-04-20T21:19:18.230829+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:48:44.146278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":760960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":995328,"data_stored":760960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T21:21:19.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T21:21:19.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.453+0000 7f628fe00640 1 Processor -- start 2024-04-20T21:21:19.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.453+0000 7f628fe00640 1 -- start start 2024-04-20T21:21:19.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.454+0000 7f628fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629015b400 0x7f6290072d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.454+0000 7f628fe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f629015eec0 0x7f629015f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.454+0000 7f628fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f629015f840 0x7f629015b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.454+0000 7f628fe00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f629006d280 con 0x7f629015eec0 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.454+0000 7f628fe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f629006ccc0 con 0x7f629015f840 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.454+0000 7f628fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f629006cfa0 con 0x7f629015b400 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.455+0000 7f628e000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f629015eec0 0x7f629015f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.455+0000 7f628e000640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f629015eec0 0x7f629015f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34734/0 (socket says 172.21.15.71:34734) 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.455+0000 7f628e000640 1 -- 172.21.15.71:0/2467898266 learned_addr learned my addr 172.21.15.71:0/2467898266 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.455+0000 7f628ea00640 1 --2- 172.21.15.71:0/2467898266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629015b400 0x7f6290072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.455+0000 7f628f400640 1 --2- 172.21.15.71:0/2467898266 >> v2:172.21.15.137:3300/0 conn(0x7f629015f840 0x7f629015b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.455+0000 7f628e000640 1 -- 172.21.15.71:0/2467898266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629015b400 msgr2=0x7f6290072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.455+0000 7f628e000640 1 --2- 172.21.15.71:0/2467898266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629015b400 0x7f6290072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.455+0000 7f628e000640 1 -- 172.21.15.71:0/2467898266 >> v2:172.21.15.137:3300/0 conn(0x7f629015f840 msgr2=0x7f629015b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.455+0000 7f628e000640 1 --2- 172.21.15.71:0/2467898266 >> v2:172.21.15.137:3300/0 conn(0x7f629015f840 0x7f629015b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.455+0000 7f628e000640 1 -- 172.21.15.71:0/2467898266 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629006e440 con 0x7f629015eec0 2024-04-20T21:21:19.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.455+0000 7f628ea00640 1 --2- 172.21.15.71:0/2467898266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629015b400 0x7f6290072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.457+0000 7f628e000640 1 --2- 172.21.15.71:0/2467898266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015eec0 0x7f629015f300 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6290074a40 tx=0x7f627802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e459d193f8591b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.457+0000 7f628d600640 1 -- 172.21.15.71:0/2467898266 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278035020 con 0x7f629015eec0 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.457+0000 7f628d600640 1 -- 172.21.15.71:0/2467898266 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627802d040 con 0x7f629015eec0 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.457+0000 7f628d600640 1 -- 172.21.15.71:0/2467898266 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278031a80 con 0x7f629015eec0 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.458+0000 7f628fe00640 1 -- 172.21.15.71:0/2467898266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015eec0 msgr2=0x7f629015f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.458+0000 7f628fe00640 1 --2- 172.21.15.71:0/2467898266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015eec0 0x7f629015f300 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6290074a40 tx=0x7f627802b900 comp rx=0 tx=0).stop 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.458+0000 7f628fe00640 1 -- 172.21.15.71:0/2467898266 shutdown_connections 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.458+0000 7f628fe00640 1 --2- 172.21.15.71:0/2467898266 >> v2:172.21.15.137:3300/0 conn(0x7f629015f840 0x7f629015b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.458+0000 7f628fe00640 1 --2- 172.21.15.71:0/2467898266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015eec0 0x7f629015f300 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.458+0000 7f628fe00640 1 --2- 172.21.15.71:0/2467898266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629015b400 0x7f6290072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.458+0000 7f628fe00640 1 -- 172.21.15.71:0/2467898266 >> 172.21.15.71:0/2467898266 conn(0x7f62900d0040 msgr2=0x7f62900d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.458+0000 7f628fe00640 1 -- 172.21.15.71:0/2467898266 shutdown_connections 2024-04-20T21:21:19.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.458+0000 7f628fe00640 1 -- 172.21.15.71:0/2467898266 wait complete. 2024-04-20T21:21:19.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.460+0000 7f628fe00640 1 Processor -- start 2024-04-20T21:21:19.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.460+0000 7f628fe00640 1 -- start start 2024-04-20T21:21:19.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.461+0000 7f628fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629015b400 0x7f62900cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.461+0000 7f628fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f629015eec0 0x7f629015c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.461+0000 7f628fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015f840 0x7f6290159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.461+0000 7f628fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6290073240 con 0x7f629015f840 2024-04-20T21:21:19.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.461+0000 7f628fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f629015fc90 con 0x7f629015eec0 2024-04-20T21:21:19.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.461+0000 7f628fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f629015bd20 con 0x7f629015b400 2024-04-20T21:21:19.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.461+0000 7f628f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015f840 0x7f6290159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.461+0000 7f628f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015f840 0x7f6290159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34750/0 (socket says 172.21.15.71:34750) 2024-04-20T21:21:19.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.461+0000 7f628f400640 1 -- 172.21.15.71:0/1861496702 learned_addr learned my addr 172.21.15.71:0/1861496702 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:19.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.462+0000 7f628e000640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f629015eec0 0x7f629015c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.462+0000 7f628f400640 1 -- 172.21.15.71:0/1861496702 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629015b400 msgr2=0x7f62900cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.462+0000 7f628f400640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629015b400 0x7f62900cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.462+0000 7f628f400640 1 -- 172.21.15.71:0/1861496702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f629015eec0 msgr2=0x7f629015c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.462+0000 7f628f400640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f629015eec0 0x7f629015c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.462+0000 7f628f400640 1 -- 172.21.15.71:0/1861496702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62901543d0 con 0x7f629015f840 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.462+0000 7f628f400640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015f840 0x7f6290159950 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6288007e60 tx=0x7f628800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.462+0000 7f6287400640 1 -- 172.21.15.71:0/1861496702 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288014420 con 0x7f629015f840 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.462+0000 7f6287400640 1 -- 172.21.15.71:0/1861496702 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6288019070 con 0x7f629015f840 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.462+0000 7f628fe00640 1 -- 172.21.15.71:0/1861496702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62901546b0 con 0x7f629015f840 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.462+0000 7f6287400640 1 -- 172.21.15.71:0/1861496702 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288014820 con 0x7f629015f840 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.463+0000 7f628fe00640 1 -- 172.21.15.71:0/1861496702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62900b1310 con 0x7f629015f840 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.464+0000 7f628fe00640 1 -- 172.21.15.71:0/1861496702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6290075b60 con 0x7f629015f840 2024-04-20T21:21:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.464+0000 7f6287400640 1 -- 172.21.15.71:0/1861496702 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62880149c0 con 0x7f629015f840 2024-04-20T21:21:19.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.465+0000 7f6287400640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f626c06c8f0 0x7f626c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.465+0000 7f6287400640 1 -- 172.21.15.71:0/1861496702 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f628808c550 con 0x7f629015f840 2024-04-20T21:21:19.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.466+0000 7f628ea00640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f626c06c8f0 0x7f626c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.466+0000 7f628ea00640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f626c06c8f0 0x7f626c06edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f628000a8b0 tx=0x7f6280008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:19.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.470+0000 7f6287400640 1 -- 172.21.15.71:0/1861496702 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f628805a7e0 con 0x7f629015f840 2024-04-20T21:21:19.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.665+0000 7f628fe00640 1 -- 172.21.15.71:0/1861496702 --> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6290154880 con 0x7f626c06c8f0 2024-04-20T21:21:19.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.671+0000 7f6287400640 1 -- 172.21.15.71:0/1861496702 <== mgr.4110 v2:172.21.15.71:6832/1511456036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240073 (secure 0 0 0) 0x7f6290154880 con 0x7f626c06c8f0 2024-04-20T21:21:19.672 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:19.675 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.677+0000 7f628fe00640 1 -- 172.21.15.71:0/1861496702 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f626c06c8f0 msgr2=0x7f626c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.677+0000 7f628fe00640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f626c06c8f0 0x7f626c06edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f628000a8b0 tx=0x7f6280008040 comp rx=0 tx=0).stop 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.677+0000 7f628fe00640 1 -- 172.21.15.71:0/1861496702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015f840 msgr2=0x7f6290159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.677+0000 7f628fe00640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015f840 0x7f6290159950 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6288007e60 tx=0x7f628800e4b0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.678+0000 7f628fe00640 1 -- 172.21.15.71:0/1861496702 shutdown_connections 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.678+0000 7f628fe00640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f626c06c8f0 0x7f626c06edb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.678+0000 7f628fe00640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015f840 0x7f6290159950 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.678+0000 7f628fe00640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f629015eec0 0x7f629015c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.678+0000 7f628fe00640 1 --2- 172.21.15.71:0/1861496702 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629015b400 0x7f62900cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.678+0000 7f628fe00640 1 -- 172.21.15.71:0/1861496702 >> 172.21.15.71:0/1861496702 conn(0x7f62900d0040 msgr2=0x7f62901589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.678+0000 7f628fe00640 1 -- 172.21.15.71:0/1861496702 shutdown_connections 2024-04-20T21:21:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.678+0000 7f628fe00640 1 -- 172.21.15.71:0/1861496702 wait complete. 2024-04-20T21:21:19.694 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-04-20T21:21:17.832952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220516,"kb_used_data":4296,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754204,"statfs":{"total":773094113280,"available":772868304896,"internally_reserved":0,"allocated":4399104,"data_stored":2545472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.029235"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.813347+0000","last_change":"2024-04-20T21:21:12.813347+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.813347+0000","last_undegraded":"2024-04-20T21:21:12.813347+0000","last_fullsized":"2024-04-20T21:21:12.813347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.815442+0000","last_change":"2024-04-20T21:21:12.815442+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.815442+0000","last_undegraded":"2024-04-20T21:21:12.815442+0000","last_fullsized":"2024-04-20T21:21:12.815442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820755+0000","last_change":"2024-04-20T21:21:12.820755+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820755+0000","last_undegraded":"2024-04-20T21:21:12.820755+0000","last_fullsized":"2024-04-20T21:21:12.820755+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.823266+0000","last_change":"2024-04-20T21:21:12.823266+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.823266+0000","last_undegraded":"2024-04-20T21:21:12.823266+0000","last_fullsized":"2024-04-20T21:21:12.823266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.819842+0000","last_change":"2024-04-20T21:21:12.819842+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.819842+0000","last_undegraded":"2024-04-20T21:21:12.819842+0000","last_fullsized":"2024-04-20T21:21:12.819842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.812871+0000","last_change":"2024-04-20T21:21:12.812871+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.812871+0000","last_undegraded":"2024-04-20T21:21:12.812871+0000","last_fullsized":"2024-04-20T21:21:12.812871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820709+0000","last_change":"2024-04-20T21:21:12.820709+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820709+0000","last_undegraded":"2024-04-20T21:21:12.820709+0000","last_fullsized":"2024-04-20T21:21:12.820709+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.821466+0000","last_change":"2024-04-20T21:21:12.821466+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.821466+0000","last_undegraded":"2024-04-20T21:21:12.821466+0000","last_fullsized":"2024-04-20T21:21:12.821466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.828113+0000","last_change":"2024-04-20T21:21:12.828113+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.828113+0000","last_undegraded":"2024-04-20T21:21:12.828113+0000","last_fullsized":"2024-04-20T21:21:12.828113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820662+0000","last_change":"2024-04-20T21:21:12.820662+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820662+0000","last_undegraded":"2024-04-20T21:21:12.820662+0000","last_fullsized":"2024-04-20T21:21:12.820662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820041+0000","last_change":"2024-04-20T21:21:12.820041+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820041+0000","last_undegraded":"2024-04-20T21:21:12.820041+0000","last_fullsized":"2024-04-20T21:21:12.820041+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.827549+0000","last_change":"2024-04-20T21:21:12.827549+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.827549+0000","last_undegraded":"2024-04-20T21:21:12.827549+0000","last_fullsized":"2024-04-20T21:21:12.827549+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.827014+0000","last_change":"2024-04-20T21:21:12.827014+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.827014+0000","last_undegraded":"2024-04-20T21:21:12.827014+0000","last_fullsized":"2024-04-20T21:21:12.827014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820507+0000","last_change":"2024-04-20T21:21:12.820507+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820507+0000","last_undegraded":"2024-04-20T21:21:12.820507+0000","last_fullsized":"2024-04-20T21:21:12.820507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.812865+0000","last_change":"2024-04-20T21:21:12.812865+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.812865+0000","last_undegraded":"2024-04-20T21:21:12.812865+0000","last_fullsized":"2024-04-20T21:21:12.812865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811476+0000","last_change":"2024-04-20T21:21:12.811476+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811476+0000","last_undegraded":"2024-04-20T21:21:12.811476+0000","last_fullsized":"2024-04-20T21:21:12.811476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.821293+0000","last_change":"2024-04-20T21:21:12.821293+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.821293+0000","last_undegraded":"2024-04-20T21:21:12.821293+0000","last_fullsized":"2024-04-20T21:21:12.821293+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.822319+0000","last_change":"2024-04-20T21:21:12.822319+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.822319+0000","last_undegraded":"2024-04-20T21:21:12.822319+0000","last_fullsized":"2024-04-20T21:21:12.822319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811710+0000","last_change":"2024-04-20T21:21:12.811710+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811710+0000","last_undegraded":"2024-04-20T21:21:12.811710+0000","last_fullsized":"2024-04-20T21:21:12.811710+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820684+0000","last_change":"2024-04-20T21:21:12.820684+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820684+0000","last_undegraded":"2024-04-20T21:21:12.820684+0000","last_fullsized":"2024-04-20T21:21:12.820684+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811501+0000","last_change":"2024-04-20T21:21:12.811501+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811501+0000","last_undegraded":"2024-04-20T21:21:12.811501+0000","last_fullsized":"2024-04-20T21:21:12.811501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811537+0000","last_change":"2024-04-20T21:21:12.811537+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811537+0000","last_undegraded":"2024-04-20T21:21:12.811537+0000","last_fullsized":"2024-04-20T21:21:12.811537+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811484+0000","last_change":"2024-04-20T21:21:12.811484+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811484+0000","last_undegraded":"2024-04-20T21:21:12.811484+0000","last_fullsized":"2024-04-20T21:21:12.811484+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811501+0000","last_change":"2024-04-20T21:21:12.811501+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811501+0000","last_undegraded":"2024-04-20T21:21:12.811501+0000","last_fullsized":"2024-04-20T21:21:12.811501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.820124+0000","last_change":"2024-04-20T21:21:12.820124+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.820124+0000","last_undegraded":"2024-04-20T21:21:12.820124+0000","last_fullsized":"2024-04-20T21:21:12.820124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811538+0000","last_change":"2024-04-20T21:21:12.811538+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811538+0000","last_undegraded":"2024-04-20T21:21:12.811538+0000","last_fullsized":"2024-04-20T21:21:12.811538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.814810+0000","last_change":"2024-04-20T21:21:12.814810+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.814810+0000","last_undegraded":"2024-04-20T21:21:12.814810+0000","last_fullsized":"2024-04-20T21:21:12.814810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.815022+0000","last_change":"2024-04-20T21:21:12.815022+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.815022+0000","last_undegraded":"2024-04-20T21:21:12.815022+0000","last_fullsized":"2024-04-20T21:21:12.815022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.814635+0000","last_change":"2024-04-20T21:21:12.814635+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.814635+0000","last_undegraded":"2024-04-20T21:21:12.814635+0000","last_fullsized":"2024-04-20T21:21:12.814635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.823371+0000","last_change":"2024-04-20T21:21:12.823371+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.823371+0000","last_undegraded":"2024-04-20T21:21:12.823371+0000","last_fullsized":"2024-04-20T21:21:12.823371+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.826441+0000","last_change":"2024-04-20T21:21:12.826441+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.826441+0000","last_undegraded":"2024-04-20T21:21:12.826441+0000","last_fullsized":"2024-04-20T21:21:12.826441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-20T21:21:13.803368+0000","last_change":"2024-04-20T21:21:13.803368+0000","last_active":"2024-04-20T21:21:13.803368+0000","last_peered":"2024-04-20T21:21:13.803368+0000","last_clean":"2024-04-20T21:21:13.803368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:13.803368+0000","last_undegraded":"2024-04-20T21:21:13.803368+0000","last_fullsized":"2024-04-20T21:21:13.803368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-20T21:21:12.811717+0000","last_change":"2024-04-20T21:21:12.811717+0000","last_active":"2024-04-20T21:21:12.789156+0000","last_peered":"2024-04-20T21:21:12.789156+0000","last_clean":"2024-04-20T21:21:12.789156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-20T21:21:12.811717+0000","last_undegraded":"2024-04-20T21:21:12.811717+0000","last_fullsized":"2024-04-20T21:21:12.811717+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-20T21:21:12.815633+0000","last_change":"2024-04-20T21:19:19.292405+0000","last_active":"2024-04-20T21:21:12.815633+0000","last_peered":"2024-04-20T21:21:12.815633+0000","last_clean":"2024-04-20T21:21:12.815633+0000","last_became_active":"2024-04-20T21:19:19.290107+0000","last_became_peered":"2024-04-20T21:19:19.290107+0000","last_unstale":"2024-04-20T21:21:12.815633+0000","last_undegraded":"2024-04-20T21:21:12.815633+0000","last_fullsized":"2024-04-20T21:21:12.815633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_clean_scrub_stamp":"2024-04-20T21:19:18.230829+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:48:44.146278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":760960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":170592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":995328,"data_stored":760960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T21:21:19.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T21:21:19.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.938+0000 7f5073200640 1 Processor -- start 2024-04-20T21:21:19.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.939+0000 7f5073200640 1 -- start start 2024-04-20T21:21:19.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.940+0000 7f5073200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f507415b7e0 0x7f507415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.940+0000 7f5073200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f507415c190 0x7f507406ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.940+0000 7f5073200640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f507406ccc0 con 0x7f507415b400 2024-04-20T21:21:19.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.940+0000 7f5073200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f507406d280 con 0x7f507415c190 2024-04-20T21:21:19.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.940+0000 7f5073200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f507406cfa0 con 0x7f507415b7e0 2024-04-20T21:21:19.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.941+0000 7f5071e00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f507415b400 0x7f5074072d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34422/0 (socket says 172.21.15.71:34422) 2024-04-20T21:21:19.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.941+0000 7f5071e00640 1 -- 172.21.15.71:0/3165094382 learned_addr learned my addr 172.21.15.71:0/3165094382 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:19.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.941+0000 7f5069400640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f507415b7e0 0x7f507415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.941+0000 7f5072800640 1 --2- 172.21.15.71:0/3165094382 >> v2:172.21.15.137:3300/0 conn(0x7f507415c190 0x7f507406ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.941+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3120548347 0 0) 0x7f507406ccc0 con 0x7f507415b400 2024-04-20T21:21:19.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.941+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5058003520 con 0x7f507415b400 2024-04-20T21:21:19.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.941+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3404351173 0 0) 0x7f5058003520 con 0x7f507415b400 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f507415b7e0 msgr2=0x7f507415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f507415b7e0 0x7f507415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 >> v2:172.21.15.137:3300/0 conn(0x7f507415c190 msgr2=0x7f507406ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 --2- 172.21.15.71:0/3165094382 >> v2:172.21.15.137:3300/0 conn(0x7f507415c190 0x7f507406ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f507406e440 con 0x7f507415b400 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f5064001670 con 0x7f507415b400 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 >> v1:172.21.15.71:6789/0 conn(0x7f507415b400 legacy=0x7f5074072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 0x7f5058003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f507415b7e0 0x7f5058004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5058004d40 0x7f50580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f507406d280 con 0x7f50580039b0 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f507406cfa0 con 0x7f5058004d40 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f505800ba70 con 0x7f507415b7e0 2024-04-20T21:21:19.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071e00640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 0x7f5058003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5069400640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f507415b7e0 0x7f5058004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5072800640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5058004d40 0x7f50580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071e00640 1 -- 172.21.15.71:0/3165094382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f507415b7e0 msgr2=0x7f5058004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:19.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071e00640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f507415b7e0 0x7f5058004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071e00640 1 -- 172.21.15.71:0/3165094382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5058004d40 msgr2=0x7f50580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:19.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071e00640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5058004d40 0x7f50580051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.942+0000 7f5071e00640 1 -- 172.21.15.71:0/3165094382 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5058003520 con 0x7f50580039b0 2024-04-20T21:21:19.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.944+0000 7f5071e00640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 0x7f5058003dd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f506400c160 tx=0x7f5058005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5294be157c454e05 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:19.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.944+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064007c80 con 0x7f50580039b0 2024-04-20T21:21:19.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.944+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5064030070 con 0x7f50580039b0 2024-04-20T21:21:19.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.944+0000 7f5071400640 1 -- 172.21.15.71:0/3165094382 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064005d30 con 0x7f50580039b0 2024-04-20T21:21:19.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.944+0000 7f5073200640 1 -- 172.21.15.71:0/3165094382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 msgr2=0x7f5058003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:19.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.944+0000 7f5073200640 1 --2- 172.21.15.71:0/3165094382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 0x7f5058003dd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f506400c160 tx=0x7f5058005830 comp rx=0 tx=0).stop 2024-04-20T21:21:19.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.944+0000 7f5072800640 1 -- 172.21.15.71:0/3165094382 reap_dead start 2024-04-20T21:21:19.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.945+0000 7f5073200640 1 -- 172.21.15.71:0/3165094382 shutdown_connections 2024-04-20T21:21:19.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.945+0000 7f5073200640 1 -- 172.21.15.71:0/3165094382 >> 172.21.15.71:0/3165094382 conn(0x7f50740d0040 msgr2=0x7f50740d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:19.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.945+0000 7f5073200640 1 -- 172.21.15.71:0/3165094382 shutdown_connections 2024-04-20T21:21:19.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.945+0000 7f5073200640 1 -- 172.21.15.71:0/3165094382 wait complete. 2024-04-20T21:21:19.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.946+0000 7f5073200640 1 Processor -- start 2024-04-20T21:21:19.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.946+0000 7f5073200640 1 -- start start 2024-04-20T21:21:19.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.947+0000 7f5073200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 0x7f50741497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.947+0000 7f5073200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f507409c660 0x7f507409cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.947+0000 7f5073200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50740b0260 0x7f50740b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.947+0000 7f5073200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f507415c730 con 0x7f50580039b0 2024-04-20T21:21:19.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.947+0000 7f5073200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f507415c5b0 con 0x7f507409c660 2024-04-20T21:21:19.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.947+0000 7f5073200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f507415bc50 con 0x7f50740b0260 2024-04-20T21:21:19.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.948+0000 7f5071e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 0x7f50741497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.948+0000 7f5071e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 0x7f50741497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34762/0 (socket says 172.21.15.71:34762) 2024-04-20T21:21:19.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.948+0000 7f5071e00640 1 -- 172.21.15.71:0/1669859520 learned_addr learned my addr 172.21.15.71:0/1669859520 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:19.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.948+0000 7f5072800640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50740b0260 0x7f50740b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.948+0000 7f5069400640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f507409c660 0x7f507409cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.948+0000 7f5071e00640 1 -- 172.21.15.71:0/1669859520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50740b0260 msgr2=0x7f50740b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:19.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.948+0000 7f5071e00640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50740b0260 0x7f50740b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.948+0000 7f5071e00640 1 -- 172.21.15.71:0/1669859520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f507409c660 msgr2=0x7f507409cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:19.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.948+0000 7f5071e00640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f507409c660 0x7f507409cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:19.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.948+0000 7f5071e00640 1 -- 172.21.15.71:0/1669859520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f507409d200 con 0x7f50580039b0 2024-04-20T21:21:19.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.948+0000 7f5069400640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f507409c660 0x7f507409cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:19.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.949+0000 7f5071e00640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 0x7f50741497a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f506400c280 tx=0x7f507406ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:19.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.949+0000 7f506aa00640 1 -- 172.21.15.71:0/1669859520 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064001be0 con 0x7f50580039b0 2024-04-20T21:21:19.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.949+0000 7f506aa00640 1 -- 172.21.15.71:0/1669859520 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5064004bf0 con 0x7f50580039b0 2024-04-20T21:21:19.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.949+0000 7f506aa00640 1 -- 172.21.15.71:0/1669859520 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064007070 con 0x7f50580039b0 2024-04-20T21:21:19.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.949+0000 7f5073200640 1 -- 172.21.15.71:0/1669859520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f507409d4e0 con 0x7f50580039b0 2024-04-20T21:21:19.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.949+0000 7f5073200640 1 -- 172.21.15.71:0/1669859520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5074149ce0 con 0x7f50580039b0 2024-04-20T21:21:19.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.950+0000 7f5073200640 1 -- 172.21.15.71:0/1669859520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5074075b60 con 0x7f50580039b0 2024-04-20T21:21:19.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.951+0000 7f506aa00640 1 -- 172.21.15.71:0/1669859520 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5064047020 con 0x7f50580039b0 2024-04-20T21:21:19.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.952+0000 7f506aa00640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f505006c8f0 0x7f505006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:19.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.952+0000 7f506aa00640 1 -- 172.21.15.71:0/1669859520 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f50640ace80 con 0x7f50580039b0 2024-04-20T21:21:19.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.952+0000 7f5069400640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f505006c8f0 0x7f505006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:19.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.953+0000 7f5069400640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f505006c8f0 0x7f505006edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f50740b0eb0 tx=0x7f505c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:19.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:19.957+0000 7f506aa00640 1 -- 172.21.15.71:0/1669859520 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f506407b110 con 0x7f50580039b0 2024-04-20T21:21:20.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.152+0000 7f5073200640 1 -- 172.21.15.71:0/1669859520 --> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50740b5220 con 0x7f505006c8f0 2024-04-20T21:21:20.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.171+0000 7f506aa00640 1 -- 172.21.15.71:0/1669859520 <== mgr.4110 v2:172.21.15.71:6832/1511456036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251982 (secure 0 0 0) 0x7f50740b5220 con 0x7f505006c8f0 2024-04-20T21:21:20.173 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:20.175 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-20T21:21:20.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.176+0000 7f5073200640 1 -- 172.21.15.71:0/1669859520 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f505006c8f0 msgr2=0x7f505006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.176+0000 7f5073200640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f505006c8f0 0x7f505006edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f50740b0eb0 tx=0x7f505c008040 comp rx=0 tx=0).stop 2024-04-20T21:21:20.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.176+0000 7f5073200640 1 -- 172.21.15.71:0/1669859520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 msgr2=0x7f50741497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.176+0000 7f5073200640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 0x7f50741497a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f506400c280 tx=0x7f507406ce90 comp rx=0 tx=0).stop 2024-04-20T21:21:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.176+0000 7f5073200640 1 -- 172.21.15.71:0/1669859520 shutdown_connections 2024-04-20T21:21:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.176+0000 7f5073200640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f505006c8f0 0x7f505006edb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.176+0000 7f5073200640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50740b0260 0x7f50740b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.176+0000 7f5073200640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f507409c660 0x7f507409cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.176+0000 7f5073200640 1 --2- 172.21.15.71:0/1669859520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50580039b0 0x7f50741497a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.176+0000 7f5073200640 1 -- 172.21.15.71:0/1669859520 >> 172.21.15.71:0/1669859520 conn(0x7f50740d0040 msgr2=0x7f5074072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.177+0000 7f5073200640 1 -- 172.21.15.71:0/1669859520 shutdown_connections 2024-04-20T21:21:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.177+0000 7f5073200640 1 -- 172.21.15.71:0/1669859520 wait complete. 2024-04-20T21:21:20.194 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-20T21:21:19.833598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225068,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749652,"statfs":{"total":773094113280,"available":772863643648,"internally_reserved":0,"allocated":4857856,"data_stored":2764172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.012342"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860618+0000","last_change":"2024-04-20T21:21:14.863803+0000","last_active":"2024-04-20T21:21:15.860618+0000","last_peered":"2024-04-20T21:21:15.860618+0000","last_clean":"2024-04-20T21:21:15.860618+0000","last_became_active":"2024-04-20T21:21:14.863473+0000","last_became_peered":"2024-04-20T21:21:14.863473+0000","last_unstale":"2024-04-20T21:21:15.860618+0000","last_undegraded":"2024-04-20T21:21:15.860618+0000","last_fullsized":"2024-04-20T21:21:15.860618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:50:41.067836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859945+0000","last_change":"2024-04-20T21:21:14.864597+0000","last_active":"2024-04-20T21:21:15.859945+0000","last_peered":"2024-04-20T21:21:15.859945+0000","last_clean":"2024-04-20T21:21:15.859945+0000","last_became_active":"2024-04-20T21:21:14.864276+0000","last_became_peered":"2024-04-20T21:21:14.864276+0000","last_unstale":"2024-04-20T21:21:15.859945+0000","last_undegraded":"2024-04-20T21:21:15.859945+0000","last_fullsized":"2024-04-20T21:21:15.859945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:58:00.847169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915723+0000","last_change":"2024-04-20T21:21:14.858339+0000","last_active":"2024-04-20T21:21:16.915723+0000","last_peered":"2024-04-20T21:21:16.915723+0000","last_clean":"2024-04-20T21:21:16.915723+0000","last_became_active":"2024-04-20T21:21:14.857837+0000","last_became_peered":"2024-04-20T21:21:14.857837+0000","last_unstale":"2024-04-20T21:21:16.915723+0000","last_undegraded":"2024-04-20T21:21:16.915723+0000","last_fullsized":"2024-04-20T21:21:16.915723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:32.387656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839497+0000","last_change":"2024-04-20T21:21:14.873437+0000","last_active":"2024-04-20T21:21:16.839497+0000","last_peered":"2024-04-20T21:21:16.839497+0000","last_clean":"2024-04-20T21:21:16.839497+0000","last_became_active":"2024-04-20T21:21:14.873135+0000","last_became_peered":"2024-04-20T21:21:14.873135+0000","last_unstale":"2024-04-20T21:21:16.839497+0000","last_undegraded":"2024-04-20T21:21:16.839497+0000","last_fullsized":"2024-04-20T21:21:16.839497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:22.233137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838996+0000","last_change":"2024-04-20T21:21:14.870377+0000","last_active":"2024-04-20T21:21:16.838996+0000","last_peered":"2024-04-20T21:21:16.838996+0000","last_clean":"2024-04-20T21:21:16.838996+0000","last_became_active":"2024-04-20T21:21:14.868821+0000","last_became_peered":"2024-04-20T21:21:14.868821+0000","last_unstale":"2024-04-20T21:21:16.838996+0000","last_undegraded":"2024-04-20T21:21:16.838996+0000","last_fullsized":"2024-04-20T21:21:16.838996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:16:39.973000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914434+0000","last_change":"2024-04-20T21:21:14.868104+0000","last_active":"2024-04-20T21:21:16.914434+0000","last_peered":"2024-04-20T21:21:16.914434+0000","last_clean":"2024-04-20T21:21:16.914434+0000","last_became_active":"2024-04-20T21:21:14.867046+0000","last_became_peered":"2024-04-20T21:21:14.867046+0000","last_unstale":"2024-04-20T21:21:16.914434+0000","last_undegraded":"2024-04-20T21:21:16.914434+0000","last_fullsized":"2024-04-20T21:21:16.914434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:49:59.837058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503929+0000","last_change":"2024-04-20T21:21:14.862506+0000","last_active":"2024-04-20T21:21:16.503929+0000","last_peered":"2024-04-20T21:21:16.503929+0000","last_clean":"2024-04-20T21:21:16.503929+0000","last_became_active":"2024-04-20T21:21:14.862025+0000","last_became_peered":"2024-04-20T21:21:14.862025+0000","last_unstale":"2024-04-20T21:21:16.503929+0000","last_undegraded":"2024-04-20T21:21:16.503929+0000","last_fullsized":"2024-04-20T21:21:16.503929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:27:54.200655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859531+0000","last_change":"2024-04-20T21:21:14.858707+0000","last_active":"2024-04-20T21:21:15.859531+0000","last_peered":"2024-04-20T21:21:15.859531+0000","last_clean":"2024-04-20T21:21:15.859531+0000","last_became_active":"2024-04-20T21:21:14.858433+0000","last_became_peered":"2024-04-20T21:21:14.858433+0000","last_unstale":"2024-04-20T21:21:15.859531+0000","last_undegraded":"2024-04-20T21:21:15.859531+0000","last_fullsized":"2024-04-20T21:21:15.859531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:26:03.453414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915812+0000","last_change":"2024-04-20T21:21:14.859567+0000","last_active":"2024-04-20T21:21:16.915812+0000","last_peered":"2024-04-20T21:21:16.915812+0000","last_clean":"2024-04-20T21:21:16.915812+0000","last_became_active":"2024-04-20T21:21:14.859157+0000","last_became_peered":"2024-04-20T21:21:14.859157+0000","last_unstale":"2024-04-20T21:21:16.915812+0000","last_undegraded":"2024-04-20T21:21:16.915812+0000","last_fullsized":"2024-04-20T21:21:16.915812+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:14:09.298044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503997+0000","last_change":"2024-04-20T21:21:14.857630+0000","last_active":"2024-04-20T21:21:16.503997+0000","last_peered":"2024-04-20T21:21:16.503997+0000","last_clean":"2024-04-20T21:21:16.503997+0000","last_became_active":"2024-04-20T21:21:14.857269+0000","last_became_peered":"2024-04-20T21:21:14.857269+0000","last_unstale":"2024-04-20T21:21:16.503997+0000","last_undegraded":"2024-04-20T21:21:16.503997+0000","last_fullsized":"2024-04-20T21:21:16.503997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:57:59.730923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504353+0000","last_change":"2024-04-20T21:21:14.871863+0000","last_active":"2024-04-20T21:21:16.504353+0000","last_peered":"2024-04-20T21:21:16.504353+0000","last_clean":"2024-04-20T21:21:16.504353+0000","last_became_active":"2024-04-20T21:21:14.871546+0000","last_became_peered":"2024-04-20T21:21:14.871546+0000","last_unstale":"2024-04-20T21:21:16.504353+0000","last_undegraded":"2024-04-20T21:21:16.504353+0000","last_fullsized":"2024-04-20T21:21:16.504353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:36.325484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915472+0000","last_change":"2024-04-20T21:21:14.864901+0000","last_active":"2024-04-20T21:21:16.915472+0000","last_peered":"2024-04-20T21:21:16.915472+0000","last_clean":"2024-04-20T21:21:16.915472+0000","last_became_active":"2024-04-20T21:21:14.862268+0000","last_became_peered":"2024-04-20T21:21:14.862268+0000","last_unstale":"2024-04-20T21:21:16.915472+0000","last_undegraded":"2024-04-20T21:21:16.915472+0000","last_fullsized":"2024-04-20T21:21:16.915472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:35.242959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503693+0000","last_change":"2024-04-20T21:21:14.857737+0000","last_active":"2024-04-20T21:21:16.503693+0000","last_peered":"2024-04-20T21:21:16.503693+0000","last_clean":"2024-04-20T21:21:16.503693+0000","last_became_active":"2024-04-20T21:21:14.857431+0000","last_became_peered":"2024-04-20T21:21:14.857431+0000","last_unstale":"2024-04-20T21:21:16.503693+0000","last_undegraded":"2024-04-20T21:21:16.503693+0000","last_fullsized":"2024-04-20T21:21:16.503693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:38:16.941267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861488+0000","last_change":"2024-04-20T21:21:14.875694+0000","last_active":"2024-04-20T21:21:15.861488+0000","last_peered":"2024-04-20T21:21:15.861488+0000","last_clean":"2024-04-20T21:21:15.861488+0000","last_became_active":"2024-04-20T21:21:14.875399+0000","last_became_peered":"2024-04-20T21:21:14.875399+0000","last_unstale":"2024-04-20T21:21:15.861488+0000","last_undegraded":"2024-04-20T21:21:15.861488+0000","last_fullsized":"2024-04-20T21:21:15.861488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503292+0000","last_change":"2024-04-20T21:21:14.858950+0000","last_active":"2024-04-20T21:21:16.503292+0000","last_peered":"2024-04-20T21:21:16.503292+0000","last_clean":"2024-04-20T21:21:16.503292+0000","last_became_active":"2024-04-20T21:21:14.858606+0000","last_became_peered":"2024-04-20T21:21:14.858606+0000","last_unstale":"2024-04-20T21:21:16.503292+0000","last_undegraded":"2024-04-20T21:21:16.503292+0000","last_fullsized":"2024-04-20T21:21:16.503292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:14:09.298044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916349+0000","last_change":"2024-04-20T21:21:14.855465+0000","last_active":"2024-04-20T21:21:16.916349+0000","last_peered":"2024-04-20T21:21:16.916349+0000","last_clean":"2024-04-20T21:21:16.916349+0000","last_became_active":"2024-04-20T21:21:14.855172+0000","last_became_peered":"2024-04-20T21:21:14.855172+0000","last_unstale":"2024-04-20T21:21:16.916349+0000","last_undegraded":"2024-04-20T21:21:16.916349+0000","last_fullsized":"2024-04-20T21:21:16.916349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917453+0000","last_change":"2024-04-20T21:21:14.860920+0000","last_active":"2024-04-20T21:21:16.917453+0000","last_peered":"2024-04-20T21:21:16.917453+0000","last_clean":"2024-04-20T21:21:16.917453+0000","last_became_active":"2024-04-20T21:21:14.856351+0000","last_became_peered":"2024-04-20T21:21:14.856351+0000","last_unstale":"2024-04-20T21:21:16.917453+0000","last_undegraded":"2024-04-20T21:21:16.917453+0000","last_fullsized":"2024-04-20T21:21:16.917453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:29:28.575895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860277+0000","last_change":"2024-04-20T21:21:14.877013+0000","last_active":"2024-04-20T21:21:15.860277+0000","last_peered":"2024-04-20T21:21:15.860277+0000","last_clean":"2024-04-20T21:21:15.860277+0000","last_became_active":"2024-04-20T21:21:14.876706+0000","last_became_peered":"2024-04-20T21:21:14.876706+0000","last_unstale":"2024-04-20T21:21:15.860277+0000","last_undegraded":"2024-04-20T21:21:15.860277+0000","last_fullsized":"2024-04-20T21:21:15.860277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:43.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839085+0000","last_change":"2024-04-20T21:21:14.856777+0000","last_active":"2024-04-20T21:21:16.839085+0000","last_peered":"2024-04-20T21:21:16.839085+0000","last_clean":"2024-04-20T21:21:16.839085+0000","last_became_active":"2024-04-20T21:21:14.855452+0000","last_became_peered":"2024-04-20T21:21:14.855452+0000","last_unstale":"2024-04-20T21:21:16.839085+0000","last_undegraded":"2024-04-20T21:21:16.839085+0000","last_fullsized":"2024-04-20T21:21:16.839085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:37:17.281450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860213+0000","last_change":"2024-04-20T21:21:14.866614+0000","last_active":"2024-04-20T21:21:15.860213+0000","last_peered":"2024-04-20T21:21:15.860213+0000","last_clean":"2024-04-20T21:21:15.860213+0000","last_became_active":"2024-04-20T21:21:14.866140+0000","last_became_peered":"2024-04-20T21:21:14.866140+0000","last_unstale":"2024-04-20T21:21:15.860213+0000","last_undegraded":"2024-04-20T21:21:15.860213+0000","last_fullsized":"2024-04-20T21:21:15.860213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:23.573740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503678+0000","last_change":"2024-04-20T21:21:14.854745+0000","last_active":"2024-04-20T21:21:16.503678+0000","last_peered":"2024-04-20T21:21:16.503678+0000","last_clean":"2024-04-20T21:21:16.503678+0000","last_became_active":"2024-04-20T21:21:14.854464+0000","last_became_peered":"2024-04-20T21:21:14.854464+0000","last_unstale":"2024-04-20T21:21:16.503678+0000","last_undegraded":"2024-04-20T21:21:16.503678+0000","last_fullsized":"2024-04-20T21:21:16.503678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:40.817426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.862002+0000","last_change":"2024-04-20T21:21:14.872869+0000","last_active":"2024-04-20T21:21:15.862002+0000","last_peered":"2024-04-20T21:21:15.862002+0000","last_clean":"2024-04-20T21:21:15.862002+0000","last_became_active":"2024-04-20T21:21:14.872631+0000","last_became_peered":"2024-04-20T21:21:14.872631+0000","last_unstale":"2024-04-20T21:21:15.862002+0000","last_undegraded":"2024-04-20T21:21:15.862002+0000","last_fullsized":"2024-04-20T21:21:15.862002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:59.360668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916591+0000","last_change":"2024-04-20T21:21:14.842819+0000","last_active":"2024-04-20T21:21:16.916591+0000","last_peered":"2024-04-20T21:21:16.916591+0000","last_clean":"2024-04-20T21:21:16.916591+0000","last_became_active":"2024-04-20T21:21:14.842168+0000","last_became_peered":"2024-04-20T21:21:14.842168+0000","last_unstale":"2024-04-20T21:21:16.916591+0000","last_undegraded":"2024-04-20T21:21:16.916591+0000","last_fullsized":"2024-04-20T21:21:16.916591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839206+0000","last_change":"2024-04-20T21:21:14.842239+0000","last_active":"2024-04-20T21:21:16.839206+0000","last_peered":"2024-04-20T21:21:16.839206+0000","last_clean":"2024-04-20T21:21:16.839206+0000","last_became_active":"2024-04-20T21:21:14.841546+0000","last_became_peered":"2024-04-20T21:21:14.841546+0000","last_unstale":"2024-04-20T21:21:16.839206+0000","last_undegraded":"2024-04-20T21:21:16.839206+0000","last_fullsized":"2024-04-20T21:21:16.839206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:44:47.858452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860663+0000","last_change":"2024-04-20T21:21:14.862627+0000","last_active":"2024-04-20T21:21:15.860663+0000","last_peered":"2024-04-20T21:21:15.860663+0000","last_clean":"2024-04-20T21:21:15.860663+0000","last_became_active":"2024-04-20T21:21:14.862348+0000","last_became_peered":"2024-04-20T21:21:14.862348+0000","last_unstale":"2024-04-20T21:21:15.860663+0000","last_undegraded":"2024-04-20T21:21:15.860663+0000","last_fullsized":"2024-04-20T21:21:15.860663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:54:35.961822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914999+0000","last_change":"2024-04-20T21:21:14.869769+0000","last_active":"2024-04-20T21:21:16.914999+0000","last_peered":"2024-04-20T21:21:16.914999+0000","last_clean":"2024-04-20T21:21:16.914999+0000","last_became_active":"2024-04-20T21:21:14.869490+0000","last_became_peered":"2024-04-20T21:21:14.869490+0000","last_unstale":"2024-04-20T21:21:16.914999+0000","last_undegraded":"2024-04-20T21:21:16.914999+0000","last_fullsized":"2024-04-20T21:21:16.914999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860445+0000","last_change":"2024-04-20T21:21:14.846180+0000","last_active":"2024-04-20T21:21:15.860445+0000","last_peered":"2024-04-20T21:21:15.860445+0000","last_clean":"2024-04-20T21:21:15.860445+0000","last_became_active":"2024-04-20T21:21:14.845844+0000","last_became_peered":"2024-04-20T21:21:14.845844+0000","last_unstale":"2024-04-20T21:21:15.860445+0000","last_undegraded":"2024-04-20T21:21:15.860445+0000","last_fullsized":"2024-04-20T21:21:15.860445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:53.010372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504643+0000","last_change":"2024-04-20T21:21:14.856442+0000","last_active":"2024-04-20T21:21:16.504643+0000","last_peered":"2024-04-20T21:21:16.504643+0000","last_clean":"2024-04-20T21:21:16.504643+0000","last_became_active":"2024-04-20T21:21:14.856130+0000","last_became_peered":"2024-04-20T21:21:14.856130+0000","last_unstale":"2024-04-20T21:21:16.504643+0000","last_undegraded":"2024-04-20T21:21:16.504643+0000","last_fullsized":"2024-04-20T21:21:16.504643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:37:09.139008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859956+0000","last_change":"2024-04-20T21:21:14.857158+0000","last_active":"2024-04-20T21:21:15.859956+0000","last_peered":"2024-04-20T21:21:15.859956+0000","last_clean":"2024-04-20T21:21:15.859956+0000","last_became_active":"2024-04-20T21:21:14.852988+0000","last_became_peered":"2024-04-20T21:21:14.852988+0000","last_unstale":"2024-04-20T21:21:15.859956+0000","last_undegraded":"2024-04-20T21:21:15.859956+0000","last_fullsized":"2024-04-20T21:21:15.859956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:38.325073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859521+0000","last_change":"2024-04-20T21:21:14.855153+0000","last_active":"2024-04-20T21:21:15.859521+0000","last_peered":"2024-04-20T21:21:15.859521+0000","last_clean":"2024-04-20T21:21:15.859521+0000","last_became_active":"2024-04-20T21:21:14.854858+0000","last_became_peered":"2024-04-20T21:21:14.854858+0000","last_unstale":"2024-04-20T21:21:15.859521+0000","last_undegraded":"2024-04-20T21:21:15.859521+0000","last_fullsized":"2024-04-20T21:21:15.859521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:10:30.105415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916765+0000","last_change":"2024-04-20T21:21:14.844379+0000","last_active":"2024-04-20T21:21:16.916765+0000","last_peered":"2024-04-20T21:21:16.916765+0000","last_clean":"2024-04-20T21:21:16.916765+0000","last_became_active":"2024-04-20T21:21:14.840709+0000","last_became_peered":"2024-04-20T21:21:14.840709+0000","last_unstale":"2024-04-20T21:21:16.916765+0000","last_undegraded":"2024-04-20T21:21:16.916765+0000","last_fullsized":"2024-04-20T21:21:16.916765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914616+0000","last_change":"2024-04-20T21:21:14.849087+0000","last_active":"2024-04-20T21:21:16.914616+0000","last_peered":"2024-04-20T21:21:16.914616+0000","last_clean":"2024-04-20T21:21:16.914616+0000","last_became_active":"2024-04-20T21:21:14.848753+0000","last_became_peered":"2024-04-20T21:21:14.848753+0000","last_unstale":"2024-04-20T21:21:16.914616+0000","last_undegraded":"2024-04-20T21:21:16.914616+0000","last_fullsized":"2024-04-20T21:21:16.914616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.668807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917355+0000","last_change":"2024-04-20T21:21:14.854607+0000","last_active":"2024-04-20T21:21:16.917355+0000","last_peered":"2024-04-20T21:21:16.917355+0000","last_clean":"2024-04-20T21:21:16.917355+0000","last_became_active":"2024-04-20T21:21:14.854334+0000","last_became_peered":"2024-04-20T21:21:14.854334+0000","last_unstale":"2024-04-20T21:21:16.917355+0000","last_undegraded":"2024-04-20T21:21:16.917355+0000","last_fullsized":"2024-04-20T21:21:16.917355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:14:09.298044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860470+0000","last_change":"2024-04-20T21:21:13.854943+0000","last_active":"2024-04-20T21:21:15.860470+0000","last_peered":"2024-04-20T21:21:15.860470+0000","last_clean":"2024-04-20T21:21:15.860470+0000","last_became_active":"2024-04-20T21:21:13.852987+0000","last_became_peered":"2024-04-20T21:21:13.852987+0000","last_unstale":"2024-04-20T21:21:15.860470+0000","last_undegraded":"2024-04-20T21:21:15.860470+0000","last_fullsized":"2024-04-20T21:21:15.860470+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:45:20.432399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915087+0000","last_change":"2024-04-20T21:21:14.865422+0000","last_active":"2024-04-20T21:21:16.915087+0000","last_peered":"2024-04-20T21:21:16.915087+0000","last_clean":"2024-04-20T21:21:16.915087+0000","last_became_active":"2024-04-20T21:21:14.865033+0000","last_became_peered":"2024-04-20T21:21:14.865033+0000","last_unstale":"2024-04-20T21:21:16.915087+0000","last_undegraded":"2024-04-20T21:21:16.915087+0000","last_fullsized":"2024-04-20T21:21:16.915087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915666+0000","last_change":"2024-04-20T21:21:13.852552+0000","last_active":"2024-04-20T21:21:16.915666+0000","last_peered":"2024-04-20T21:21:16.915666+0000","last_clean":"2024-04-20T21:21:16.915666+0000","last_became_active":"2024-04-20T21:21:13.852231+0000","last_became_peered":"2024-04-20T21:21:13.852231+0000","last_unstale":"2024-04-20T21:21:16.915666+0000","last_undegraded":"2024-04-20T21:21:16.915666+0000","last_fullsized":"2024-04-20T21:21:16.915666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:51.996160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861499+0000","last_change":"2024-04-20T21:21:14.874272+0000","last_active":"2024-04-20T21:21:15.861499+0000","last_peered":"2024-04-20T21:21:15.861499+0000","last_clean":"2024-04-20T21:21:15.861499+0000","last_became_active":"2024-04-20T21:21:14.873628+0000","last_became_peered":"2024-04-20T21:21:14.873628+0000","last_unstale":"2024-04-20T21:21:15.861499+0000","last_undegraded":"2024-04-20T21:21:15.861499+0000","last_fullsized":"2024-04-20T21:21:15.861499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915232+0000","last_change":"2024-04-20T21:21:13.854104+0000","last_active":"2024-04-20T21:21:16.915232+0000","last_peered":"2024-04-20T21:21:16.915232+0000","last_clean":"2024-04-20T21:21:16.915232+0000","last_became_active":"2024-04-20T21:21:13.853806+0000","last_became_peered":"2024-04-20T21:21:13.853806+0000","last_unstale":"2024-04-20T21:21:16.915232+0000","last_undegraded":"2024-04-20T21:21:16.915232+0000","last_fullsized":"2024-04-20T21:21:16.915232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:54:34.947611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860373+0000","last_change":"2024-04-20T21:21:14.866651+0000","last_active":"2024-04-20T21:21:15.860373+0000","last_peered":"2024-04-20T21:21:15.860373+0000","last_clean":"2024-04-20T21:21:15.860373+0000","last_became_active":"2024-04-20T21:21:14.866366+0000","last_became_peered":"2024-04-20T21:21:14.866366+0000","last_unstale":"2024-04-20T21:21:15.860373+0000","last_undegraded":"2024-04-20T21:21:15.860373+0000","last_fullsized":"2024-04-20T21:21:15.860373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:22:40.054174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861432+0000","last_change":"2024-04-20T21:21:13.850583+0000","last_active":"2024-04-20T21:21:15.861432+0000","last_peered":"2024-04-20T21:21:15.861432+0000","last_clean":"2024-04-20T21:21:15.861432+0000","last_became_active":"2024-04-20T21:21:13.850278+0000","last_became_peered":"2024-04-20T21:21:13.850278+0000","last_unstale":"2024-04-20T21:21:15.861432+0000","last_undegraded":"2024-04-20T21:21:15.861432+0000","last_fullsized":"2024-04-20T21:21:15.861432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:37.310861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914402+0000","last_change":"2024-04-20T21:21:14.859125+0000","last_active":"2024-04-20T21:21:16.914402+0000","last_peered":"2024-04-20T21:21:16.914402+0000","last_clean":"2024-04-20T21:21:16.914402+0000","last_became_active":"2024-04-20T21:21:14.857373+0000","last_became_peered":"2024-04-20T21:21:14.857373+0000","last_unstale":"2024-04-20T21:21:16.914402+0000","last_undegraded":"2024-04-20T21:21:16.914402+0000","last_fullsized":"2024-04-20T21:21:16.914402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.668807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503824+0000","last_change":"2024-04-20T21:21:13.853816+0000","last_active":"2024-04-20T21:21:16.503824+0000","last_peered":"2024-04-20T21:21:16.503824+0000","last_clean":"2024-04-20T21:21:16.503824+0000","last_became_active":"2024-04-20T21:21:13.853491+0000","last_became_peered":"2024-04-20T21:21:13.853491+0000","last_unstale":"2024-04-20T21:21:16.503824+0000","last_undegraded":"2024-04-20T21:21:16.503824+0000","last_fullsized":"2024-04-20T21:21:16.503824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:20:31.052941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503862+0000","last_change":"2024-04-20T21:21:14.872207+0000","last_active":"2024-04-20T21:21:16.503862+0000","last_peered":"2024-04-20T21:21:16.503862+0000","last_clean":"2024-04-20T21:21:16.503862+0000","last_became_active":"2024-04-20T21:21:14.870765+0000","last_became_peered":"2024-04-20T21:21:14.870765+0000","last_unstale":"2024-04-20T21:21:16.503862+0000","last_undegraded":"2024-04-20T21:21:16.503862+0000","last_fullsized":"2024-04-20T21:21:16.503862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:53:23.267234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917102+0000","last_change":"2024-04-20T21:21:13.859366+0000","last_active":"2024-04-20T21:21:16.917102+0000","last_peered":"2024-04-20T21:21:16.917102+0000","last_clean":"2024-04-20T21:21:16.917102+0000","last_became_active":"2024-04-20T21:21:13.858946+0000","last_became_peered":"2024-04-20T21:21:13.858946+0000","last_unstale":"2024-04-20T21:21:16.917102+0000","last_undegraded":"2024-04-20T21:21:16.917102+0000","last_fullsized":"2024-04-20T21:21:16.917102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:10:29.091204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861999+0000","last_change":"2024-04-20T21:21:14.874893+0000","last_active":"2024-04-20T21:21:15.861999+0000","last_peered":"2024-04-20T21:21:15.861999+0000","last_clean":"2024-04-20T21:21:15.861999+0000","last_became_active":"2024-04-20T21:21:14.874544+0000","last_became_peered":"2024-04-20T21:21:14.874544+0000","last_unstale":"2024-04-20T21:21:15.861999+0000","last_undegraded":"2024-04-20T21:21:15.861999+0000","last_fullsized":"2024-04-20T21:21:15.861999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:35.242959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914466+0000","last_change":"2024-04-20T21:21:13.850618+0000","last_active":"2024-04-20T21:21:16.914466+0000","last_peered":"2024-04-20T21:21:16.914466+0000","last_clean":"2024-04-20T21:21:16.914466+0000","last_became_active":"2024-04-20T21:21:13.850356+0000","last_became_peered":"2024-04-20T21:21:13.850356+0000","last_unstale":"2024-04-20T21:21:16.914466+0000","last_undegraded":"2024-04-20T21:21:16.914466+0000","last_fullsized":"2024-04-20T21:21:16.914466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:37.310861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859548+0000","last_change":"2024-04-20T21:21:14.864327+0000","last_active":"2024-04-20T21:21:15.859548+0000","last_peered":"2024-04-20T21:21:15.859548+0000","last_clean":"2024-04-20T21:21:15.859548+0000","last_became_active":"2024-04-20T21:21:14.861546+0000","last_became_peered":"2024-04-20T21:21:14.861546+0000","last_unstale":"2024-04-20T21:21:15.859548+0000","last_undegraded":"2024-04-20T21:21:15.859548+0000","last_fullsized":"2024-04-20T21:21:15.859548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:36.325484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860658+0000","last_change":"2024-04-20T21:21:13.859332+0000","last_active":"2024-04-20T21:21:15.860658+0000","last_peered":"2024-04-20T21:21:15.860658+0000","last_clean":"2024-04-20T21:21:15.860658+0000","last_became_active":"2024-04-20T21:21:13.858593+0000","last_became_peered":"2024-04-20T21:21:13.858593+0000","last_unstale":"2024-04-20T21:21:15.860658+0000","last_undegraded":"2024-04-20T21:21:15.860658+0000","last_fullsized":"2024-04-20T21:21:15.860658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:51.996160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839694+0000","last_change":"2024-04-20T21:21:14.867091+0000","last_active":"2024-04-20T21:21:16.839694+0000","last_peered":"2024-04-20T21:21:16.839694+0000","last_clean":"2024-04-20T21:21:16.839694+0000","last_became_active":"2024-04-20T21:21:14.866832+0000","last_became_peered":"2024-04-20T21:21:14.866832+0000","last_unstale":"2024-04-20T21:21:16.839694+0000","last_undegraded":"2024-04-20T21:21:16.839694+0000","last_fullsized":"2024-04-20T21:21:16.839694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:45:21.446611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860424+0000","last_change":"2024-04-20T21:21:13.846256+0000","last_active":"2024-04-20T21:21:15.860424+0000","last_peered":"2024-04-20T21:21:15.860424+0000","last_clean":"2024-04-20T21:21:15.860424+0000","last_became_active":"2024-04-20T21:21:13.845720+0000","last_became_peered":"2024-04-20T21:21:13.845720+0000","last_unstale":"2024-04-20T21:21:15.860424+0000","last_undegraded":"2024-04-20T21:21:15.860424+0000","last_fullsized":"2024-04-20T21:21:15.860424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:27.895382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916985+0000","last_change":"2024-04-20T21:21:14.848212+0000","last_active":"2024-04-20T21:21:16.916985+0000","last_peered":"2024-04-20T21:21:16.916985+0000","last_clean":"2024-04-20T21:21:16.916985+0000","last_became_active":"2024-04-20T21:21:14.847460+0000","last_became_peered":"2024-04-20T21:21:14.847460+0000","last_unstale":"2024-04-20T21:21:16.916985+0000","last_undegraded":"2024-04-20T21:21:16.916985+0000","last_fullsized":"2024-04-20T21:21:16.916985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:32.387656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504325+0000","last_change":"2024-04-20T21:21:13.854168+0000","last_active":"2024-04-20T21:21:16.504325+0000","last_peered":"2024-04-20T21:21:16.504325+0000","last_clean":"2024-04-20T21:21:16.504325+0000","last_became_active":"2024-04-20T21:21:13.853371+0000","last_became_peered":"2024-04-20T21:21:13.853371+0000","last_unstale":"2024-04-20T21:21:16.504325+0000","last_undegraded":"2024-04-20T21:21:16.504325+0000","last_fullsized":"2024-04-20T21:21:16.504325+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:24:02.233206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915592+0000","last_change":"2024-04-20T21:21:14.858943+0000","last_active":"2024-04-20T21:21:16.915592+0000","last_peered":"2024-04-20T21:21:16.915592+0000","last_clean":"2024-04-20T21:21:16.915592+0000","last_became_active":"2024-04-20T21:21:14.858687+0000","last_became_peered":"2024-04-20T21:21:14.858687+0000","last_unstale":"2024-04-20T21:21:16.915592+0000","last_undegraded":"2024-04-20T21:21:16.915592+0000","last_fullsized":"2024-04-20T21:21:16.915592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:59.360668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504340+0000","last_change":"2024-04-20T21:21:13.852073+0000","last_active":"2024-04-20T21:21:16.504340+0000","last_peered":"2024-04-20T21:21:16.504340+0000","last_clean":"2024-04-20T21:21:16.504340+0000","last_became_active":"2024-04-20T21:21:13.851166+0000","last_became_peered":"2024-04-20T21:21:13.851166+0000","last_unstale":"2024-04-20T21:21:16.504340+0000","last_undegraded":"2024-04-20T21:21:16.504340+0000","last_fullsized":"2024-04-20T21:21:16.504340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861772+0000","last_change":"2024-04-20T21:21:14.873140+0000","last_active":"2024-04-20T21:21:15.861772+0000","last_peered":"2024-04-20T21:21:15.861772+0000","last_clean":"2024-04-20T21:21:15.861772+0000","last_became_active":"2024-04-20T21:21:14.872806+0000","last_became_peered":"2024-04-20T21:21:14.872806+0000","last_unstale":"2024-04-20T21:21:15.861772+0000","last_undegraded":"2024-04-20T21:21:15.861772+0000","last_fullsized":"2024-04-20T21:21:15.861772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859906+0000","last_change":"2024-04-20T21:21:13.854623+0000","last_active":"2024-04-20T21:21:15.859906+0000","last_peered":"2024-04-20T21:21:15.859906+0000","last_clean":"2024-04-20T21:21:15.859906+0000","last_became_active":"2024-04-20T21:21:13.854357+0000","last_became_peered":"2024-04-20T21:21:13.854357+0000","last_unstale":"2024-04-20T21:21:15.859906+0000","last_undegraded":"2024-04-20T21:21:15.859906+0000","last_fullsized":"2024-04-20T21:21:15.859906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:32.176825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914482+0000","last_change":"2024-04-20T21:21:14.857939+0000","last_active":"2024-04-20T21:21:16.914482+0000","last_peered":"2024-04-20T21:21:16.914482+0000","last_clean":"2024-04-20T21:21:16.914482+0000","last_became_active":"2024-04-20T21:21:14.857676+0000","last_became_peered":"2024-04-20T21:21:14.857676+0000","last_unstale":"2024-04-20T21:21:16.914482+0000","last_undegraded":"2024-04-20T21:21:16.914482+0000","last_fullsized":"2024-04-20T21:21:16.914482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859705+0000","last_change":"2024-04-20T21:21:13.847644+0000","last_active":"2024-04-20T21:21:15.859705+0000","last_peered":"2024-04-20T21:21:15.859705+0000","last_clean":"2024-04-20T21:21:15.859705+0000","last_became_active":"2024-04-20T21:21:13.846847+0000","last_became_peered":"2024-04-20T21:21:13.846847+0000","last_unstale":"2024-04-20T21:21:15.859705+0000","last_undegraded":"2024-04-20T21:21:15.859705+0000","last_fullsized":"2024-04-20T21:21:15.859705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:02.155842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859665+0000","last_change":"2024-04-20T21:21:14.861546+0000","last_active":"2024-04-20T21:21:15.859665+0000","last_peered":"2024-04-20T21:21:15.859665+0000","last_clean":"2024-04-20T21:21:15.859665+0000","last_became_active":"2024-04-20T21:21:14.861240+0000","last_became_peered":"2024-04-20T21:21:14.861240+0000","last_unstale":"2024-04-20T21:21:15.859665+0000","last_undegraded":"2024-04-20T21:21:15.859665+0000","last_fullsized":"2024-04-20T21:21:15.859665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:37:09.139008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914500+0000","last_change":"2024-04-20T21:21:13.849628+0000","last_active":"2024-04-20T21:21:16.914500+0000","last_peered":"2024-04-20T21:21:16.914500+0000","last_clean":"2024-04-20T21:21:16.914500+0000","last_became_active":"2024-04-20T21:21:13.849326+0000","last_became_peered":"2024-04-20T21:21:13.849326+0000","last_unstale":"2024-04-20T21:21:16.914500+0000","last_undegraded":"2024-04-20T21:21:16.914500+0000","last_fullsized":"2024-04-20T21:21:16.914500+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917493+0000","last_change":"2024-04-20T21:21:14.844280+0000","last_active":"2024-04-20T21:21:16.917493+0000","last_peered":"2024-04-20T21:21:16.917493+0000","last_clean":"2024-04-20T21:21:16.917493+0000","last_became_active":"2024-04-20T21:21:14.843920+0000","last_became_peered":"2024-04-20T21:21:14.843920+0000","last_unstale":"2024-04-20T21:21:16.917493+0000","last_undegraded":"2024-04-20T21:21:16.917493+0000","last_fullsized":"2024-04-20T21:21:16.917493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:38:16.941267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859203+0000","last_change":"2024-04-20T21:21:13.857369+0000","last_active":"2024-04-20T21:21:15.859203+0000","last_peered":"2024-04-20T21:21:15.859203+0000","last_clean":"2024-04-20T21:21:15.859203+0000","last_became_active":"2024-04-20T21:21:13.856231+0000","last_became_peered":"2024-04-20T21:21:13.856231+0000","last_unstale":"2024-04-20T21:21:15.859203+0000","last_undegraded":"2024-04-20T21:21:15.859203+0000","last_fullsized":"2024-04-20T21:21:15.859203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:21.218925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859673+0000","last_change":"2024-04-20T21:21:14.862052+0000","last_active":"2024-04-20T21:21:15.859673+0000","last_peered":"2024-04-20T21:21:15.859673+0000","last_clean":"2024-04-20T21:21:15.859673+0000","last_became_active":"2024-04-20T21:21:14.861071+0000","last_became_peered":"2024-04-20T21:21:14.861071+0000","last_unstale":"2024-04-20T21:21:15.859673+0000","last_undegraded":"2024-04-20T21:21:15.859673+0000","last_fullsized":"2024-04-20T21:21:15.859673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:15:19.755482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916259+0000","last_change":"2024-04-20T21:21:13.860489+0000","last_active":"2024-04-20T21:21:16.916259+0000","last_peered":"2024-04-20T21:21:16.916259+0000","last_clean":"2024-04-20T21:21:16.916259+0000","last_became_active":"2024-04-20T21:21:13.859676+0000","last_became_peered":"2024-04-20T21:21:13.859676+0000","last_unstale":"2024-04-20T21:21:16.916259+0000","last_undegraded":"2024-04-20T21:21:16.916259+0000","last_fullsized":"2024-04-20T21:21:16.916259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:09:15.823481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860186+0000","last_change":"2024-04-20T21:21:14.863015+0000","last_active":"2024-04-20T21:21:15.860186+0000","last_peered":"2024-04-20T21:21:15.860186+0000","last_clean":"2024-04-20T21:21:15.860186+0000","last_became_active":"2024-04-20T21:21:14.862733+0000","last_became_peered":"2024-04-20T21:21:14.862733+0000","last_unstale":"2024-04-20T21:21:15.860186+0000","last_undegraded":"2024-04-20T21:21:15.860186+0000","last_fullsized":"2024-04-20T21:21:15.860186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:17:18.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504152+0000","last_change":"2024-04-20T21:21:13.855388+0000","last_active":"2024-04-20T21:21:16.504152+0000","last_peered":"2024-04-20T21:21:16.504152+0000","last_clean":"2024-04-20T21:21:16.504152+0000","last_became_active":"2024-04-20T21:21:13.854344+0000","last_became_peered":"2024-04-20T21:21:13.854344+0000","last_unstale":"2024-04-20T21:21:16.504152+0000","last_undegraded":"2024-04-20T21:21:16.504152+0000","last_fullsized":"2024-04-20T21:21:16.504152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:51.996160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504191+0000","last_change":"2024-04-20T21:21:14.871059+0000","last_active":"2024-04-20T21:21:16.504191+0000","last_peered":"2024-04-20T21:21:16.504191+0000","last_clean":"2024-04-20T21:21:16.504191+0000","last_became_active":"2024-04-20T21:21:14.870705+0000","last_became_peered":"2024-04-20T21:21:14.870705+0000","last_unstale":"2024-04-20T21:21:16.504191+0000","last_undegraded":"2024-04-20T21:21:16.504191+0000","last_fullsized":"2024-04-20T21:21:16.504191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:26:03.453414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861562+0000","last_change":"2024-04-20T21:21:13.855754+0000","last_active":"2024-04-20T21:21:15.861562+0000","last_peered":"2024-04-20T21:21:15.861562+0000","last_clean":"2024-04-20T21:21:15.861562+0000","last_became_active":"2024-04-20T21:21:13.855416+0000","last_became_peered":"2024-04-20T21:21:13.855416+0000","last_unstale":"2024-04-20T21:21:15.861562+0000","last_undegraded":"2024-04-20T21:21:15.861562+0000","last_fullsized":"2024-04-20T21:21:15.861562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861349+0000","last_change":"2024-04-20T21:21:14.874492+0000","last_active":"2024-04-20T21:21:15.861349+0000","last_peered":"2024-04-20T21:21:15.861349+0000","last_clean":"2024-04-20T21:21:15.861349+0000","last_became_active":"2024-04-20T21:21:14.873871+0000","last_became_peered":"2024-04-20T21:21:14.873871+0000","last_unstale":"2024-04-20T21:21:15.861349+0000","last_undegraded":"2024-04-20T21:21:15.861349+0000","last_fullsized":"2024-04-20T21:21:15.861349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.668807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838936+0000","last_change":"2024-04-20T21:21:13.852987+0000","last_active":"2024-04-20T21:21:16.838936+0000","last_peered":"2024-04-20T21:21:16.838936+0000","last_clean":"2024-04-20T21:21:16.838936+0000","last_became_active":"2024-04-20T21:21:13.852708+0000","last_became_peered":"2024-04-20T21:21:13.852708+0000","last_unstale":"2024-04-20T21:21:16.838936+0000","last_undegraded":"2024-04-20T21:21:16.838936+0000","last_fullsized":"2024-04-20T21:21:16.838936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:58:55.889971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839441+0000","last_change":"2024-04-20T21:21:14.856563+0000","last_active":"2024-04-20T21:21:16.839441+0000","last_peered":"2024-04-20T21:21:16.839441+0000","last_clean":"2024-04-20T21:21:16.839441+0000","last_became_active":"2024-04-20T21:21:14.856248+0000","last_became_peered":"2024-04-20T21:21:14.856248+0000","last_unstale":"2024-04-20T21:21:16.839441+0000","last_undegraded":"2024-04-20T21:21:16.839441+0000","last_fullsized":"2024-04-20T21:21:16.839441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:23:43.018615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914745+0000","last_change":"2024-04-20T21:21:13.854000+0000","last_active":"2024-04-20T21:21:16.914745+0000","last_peered":"2024-04-20T21:21:16.914745+0000","last_clean":"2024-04-20T21:21:16.914745+0000","last_became_active":"2024-04-20T21:21:13.853604+0000","last_became_peered":"2024-04-20T21:21:13.853604+0000","last_unstale":"2024-04-20T21:21:16.914745+0000","last_undegraded":"2024-04-20T21:21:16.914745+0000","last_fullsized":"2024-04-20T21:21:16.914745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916862+0000","last_change":"2024-04-20T21:21:14.841984+0000","last_active":"2024-04-20T21:21:16.916862+0000","last_peered":"2024-04-20T21:21:16.916862+0000","last_clean":"2024-04-20T21:21:16.916862+0000","last_became_active":"2024-04-20T21:21:14.841641+0000","last_became_peered":"2024-04-20T21:21:14.841641+0000","last_unstale":"2024-04-20T21:21:16.916862+0000","last_undegraded":"2024-04-20T21:21:16.916862+0000","last_fullsized":"2024-04-20T21:21:16.916862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:35.242959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838605+0000","last_change":"2024-04-20T21:21:13.839573+0000","last_active":"2024-04-20T21:21:16.838605+0000","last_peered":"2024-04-20T21:21:16.838605+0000","last_clean":"2024-04-20T21:21:16.838605+0000","last_became_active":"2024-04-20T21:21:13.839221+0000","last_became_peered":"2024-04-20T21:21:13.839221+0000","last_unstale":"2024-04-20T21:21:16.838605+0000","last_undegraded":"2024-04-20T21:21:16.838605+0000","last_fullsized":"2024-04-20T21:21:16.838605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:06:13.391506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915084+0000","last_change":"2024-04-20T21:21:14.859655+0000","last_active":"2024-04-20T21:21:16.915084+0000","last_peered":"2024-04-20T21:21:16.915084+0000","last_clean":"2024-04-20T21:21:16.915084+0000","last_became_active":"2024-04-20T21:21:14.859340+0000","last_became_peered":"2024-04-20T21:21:14.859340+0000","last_unstale":"2024-04-20T21:21:16.915084+0000","last_undegraded":"2024-04-20T21:21:16.915084+0000","last_fullsized":"2024-04-20T21:21:16.915084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838594+0000","last_change":"2024-04-20T21:21:13.848527+0000","last_active":"2024-04-20T21:21:16.838594+0000","last_peered":"2024-04-20T21:21:16.838594+0000","last_clean":"2024-04-20T21:21:16.838594+0000","last_became_active":"2024-04-20T21:21:13.848170+0000","last_became_peered":"2024-04-20T21:21:13.848170+0000","last_unstale":"2024-04-20T21:21:16.838594+0000","last_undegraded":"2024-04-20T21:21:16.838594+0000","last_fullsized":"2024-04-20T21:21:16.838594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:55:51.845936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503657+0000","last_change":"2024-04-20T21:21:14.858608+0000","last_active":"2024-04-20T21:21:16.503657+0000","last_peered":"2024-04-20T21:21:16.503657+0000","last_clean":"2024-04-20T21:21:16.503657+0000","last_became_active":"2024-04-20T21:21:14.858254+0000","last_became_peered":"2024-04-20T21:21:14.858254+0000","last_unstale":"2024-04-20T21:21:16.503657+0000","last_undegraded":"2024-04-20T21:21:16.503657+0000","last_fullsized":"2024-04-20T21:21:16.503657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:29:28.575895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916746+0000","last_change":"2024-04-20T21:21:13.861471+0000","last_active":"2024-04-20T21:21:16.916746+0000","last_peered":"2024-04-20T21:21:16.916746+0000","last_clean":"2024-04-20T21:21:16.916746+0000","last_became_active":"2024-04-20T21:21:13.861170+0000","last_became_peered":"2024-04-20T21:21:13.861170+0000","last_unstale":"2024-04-20T21:21:16.916746+0000","last_undegraded":"2024-04-20T21:21:16.916746+0000","last_fullsized":"2024-04-20T21:21:16.916746+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:37.310861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859507+0000","last_change":"2024-04-20T21:21:14.864561+0000","last_active":"2024-04-20T21:21:15.859507+0000","last_peered":"2024-04-20T21:21:15.859507+0000","last_clean":"2024-04-20T21:21:15.859507+0000","last_became_active":"2024-04-20T21:21:14.861444+0000","last_became_peered":"2024-04-20T21:21:14.861444+0000","last_unstale":"2024-04-20T21:21:15.859507+0000","last_undegraded":"2024-04-20T21:21:15.859507+0000","last_fullsized":"2024-04-20T21:21:15.859507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:49:06.104703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838928+0000","last_change":"2024-04-20T21:21:13.838221+0000","last_active":"2024-04-20T21:21:16.838928+0000","last_peered":"2024-04-20T21:21:16.838928+0000","last_clean":"2024-04-20T21:21:16.838928+0000","last_became_active":"2024-04-20T21:21:13.837654+0000","last_became_peered":"2024-04-20T21:21:13.837654+0000","last_unstale":"2024-04-20T21:21:16.838928+0000","last_undegraded":"2024-04-20T21:21:16.838928+0000","last_fullsized":"2024-04-20T21:21:16.838928+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:23:34.226864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914778+0000","last_change":"2024-04-20T21:21:14.867009+0000","last_active":"2024-04-20T21:21:16.914778+0000","last_peered":"2024-04-20T21:21:16.914778+0000","last_clean":"2024-04-20T21:21:16.914778+0000","last_became_active":"2024-04-20T21:21:14.864737+0000","last_became_peered":"2024-04-20T21:21:14.864737+0000","last_unstale":"2024-04-20T21:21:16.914778+0000","last_undegraded":"2024-04-20T21:21:16.914778+0000","last_fullsized":"2024-04-20T21:21:16.914778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504416+0000","last_change":"2024-04-20T21:21:13.853633+0000","last_active":"2024-04-20T21:21:16.504416+0000","last_peered":"2024-04-20T21:21:16.504416+0000","last_clean":"2024-04-20T21:21:16.504416+0000","last_became_active":"2024-04-20T21:21:13.853333+0000","last_became_peered":"2024-04-20T21:21:13.853333+0000","last_unstale":"2024-04-20T21:21:16.504416+0000","last_undegraded":"2024-04-20T21:21:16.504416+0000","last_fullsized":"2024-04-20T21:21:16.504416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:54:34.947611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916949+0000","last_change":"2024-04-20T21:21:14.848001+0000","last_active":"2024-04-20T21:21:16.916949+0000","last_peered":"2024-04-20T21:21:16.916949+0000","last_clean":"2024-04-20T21:21:16.916949+0000","last_became_active":"2024-04-20T21:21:14.847002+0000","last_became_peered":"2024-04-20T21:21:14.847002+0000","last_unstale":"2024-04-20T21:21:16.916949+0000","last_undegraded":"2024-04-20T21:21:16.916949+0000","last_fullsized":"2024-04-20T21:21:16.916949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:59.360668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839148+0000","last_change":"2024-04-20T21:21:13.856053+0000","last_active":"2024-04-20T21:21:16.839148+0000","last_peered":"2024-04-20T21:21:16.839148+0000","last_clean":"2024-04-20T21:21:16.839148+0000","last_became_active":"2024-04-20T21:21:13.855739+0000","last_became_peered":"2024-04-20T21:21:13.855739+0000","last_unstale":"2024-04-20T21:21:16.839148+0000","last_undegraded":"2024-04-20T21:21:16.839148+0000","last_fullsized":"2024-04-20T21:21:16.839148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:50:02.925021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860241+0000","last_change":"2024-04-20T21:21:14.875179+0000","last_active":"2024-04-20T21:21:15.860241+0000","last_peered":"2024-04-20T21:21:15.860241+0000","last_clean":"2024-04-20T21:21:15.860241+0000","last_became_active":"2024-04-20T21:21:14.874815+0000","last_became_peered":"2024-04-20T21:21:14.874815+0000","last_unstale":"2024-04-20T21:21:15.860241+0000","last_undegraded":"2024-04-20T21:21:15.860241+0000","last_fullsized":"2024-04-20T21:21:15.860241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:44:49.884018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915471+0000","last_change":"2024-04-20T21:21:13.850690+0000","last_active":"2024-04-20T21:21:16.915471+0000","last_peered":"2024-04-20T21:21:16.915471+0000","last_clean":"2024-04-20T21:21:16.915471+0000","last_became_active":"2024-04-20T21:21:13.850378+0000","last_became_peered":"2024-04-20T21:21:13.850378+0000","last_unstale":"2024-04-20T21:21:16.915471+0000","last_undegraded":"2024-04-20T21:21:16.915471+0000","last_fullsized":"2024-04-20T21:21:16.915471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914702+0000","last_change":"2024-04-20T21:21:14.857308+0000","last_active":"2024-04-20T21:21:16.914702+0000","last_peered":"2024-04-20T21:21:16.914702+0000","last_clean":"2024-04-20T21:21:16.914702+0000","last_became_active":"2024-04-20T21:21:14.856877+0000","last_became_peered":"2024-04-20T21:21:14.856877+0000","last_unstale":"2024-04-20T21:21:16.914702+0000","last_undegraded":"2024-04-20T21:21:16.914702+0000","last_fullsized":"2024-04-20T21:21:16.914702+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915163+0000","last_change":"2024-04-20T21:21:13.857813+0000","last_active":"2024-04-20T21:21:16.915163+0000","last_peered":"2024-04-20T21:21:16.915163+0000","last_clean":"2024-04-20T21:21:16.915163+0000","last_became_active":"2024-04-20T21:21:13.857492+0000","last_became_peered":"2024-04-20T21:21:13.857492+0000","last_unstale":"2024-04-20T21:21:16.915163+0000","last_undegraded":"2024-04-20T21:21:16.915163+0000","last_fullsized":"2024-04-20T21:21:16.915163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914401+0000","last_change":"2024-04-20T21:21:14.860886+0000","last_active":"2024-04-20T21:21:16.914401+0000","last_peered":"2024-04-20T21:21:16.914401+0000","last_clean":"2024-04-20T21:21:16.914401+0000","last_became_active":"2024-04-20T21:21:14.852943+0000","last_became_peered":"2024-04-20T21:21:14.852943+0000","last_unstale":"2024-04-20T21:21:16.914401+0000","last_undegraded":"2024-04-20T21:21:16.914401+0000","last_fullsized":"2024-04-20T21:21:16.914401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:41:58.001860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859185+0000","last_change":"2024-04-20T21:21:13.853508+0000","last_active":"2024-04-20T21:21:15.859185+0000","last_peered":"2024-04-20T21:21:15.859185+0000","last_clean":"2024-04-20T21:21:15.859185+0000","last_became_active":"2024-04-20T21:21:13.852602+0000","last_became_peered":"2024-04-20T21:21:13.852602+0000","last_unstale":"2024-04-20T21:21:15.859185+0000","last_undegraded":"2024-04-20T21:21:15.859185+0000","last_fullsized":"2024-04-20T21:21:15.859185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:23:42.004403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861282+0000","last_change":"2024-04-20T21:21:14.872005+0000","last_active":"2024-04-20T21:21:15.861282+0000","last_peered":"2024-04-20T21:21:15.861282+0000","last_clean":"2024-04-20T21:21:15.861282+0000","last_became_active":"2024-04-20T21:21:14.871673+0000","last_became_peered":"2024-04-20T21:21:14.871673+0000","last_unstale":"2024-04-20T21:21:15.861282+0000","last_undegraded":"2024-04-20T21:21:15.861282+0000","last_fullsized":"2024-04-20T21:21:15.861282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:49:59.837058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860843+0000","last_change":"2024-04-20T21:21:13.850262+0000","last_active":"2024-04-20T21:21:15.860843+0000","last_peered":"2024-04-20T21:21:15.860843+0000","last_clean":"2024-04-20T21:21:15.860843+0000","last_became_active":"2024-04-20T21:21:13.848714+0000","last_became_peered":"2024-04-20T21:21:13.848714+0000","last_unstale":"2024-04-20T21:21:15.860843+0000","last_undegraded":"2024-04-20T21:21:15.860843+0000","last_fullsized":"2024-04-20T21:21:15.860843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917482+0000","last_change":"2024-04-20T21:21:14.842928+0000","last_active":"2024-04-20T21:21:16.917482+0000","last_peered":"2024-04-20T21:21:16.917482+0000","last_clean":"2024-04-20T21:21:16.917482+0000","last_became_active":"2024-04-20T21:21:14.842611+0000","last_became_peered":"2024-04-20T21:21:14.842611+0000","last_unstale":"2024-04-20T21:21:16.917482+0000","last_undegraded":"2024-04-20T21:21:16.917482+0000","last_fullsized":"2024-04-20T21:21:16.917482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:40.817426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859213+0000","last_change":"2024-04-20T21:21:13.844580+0000","last_active":"2024-04-20T21:21:15.859213+0000","last_peered":"2024-04-20T21:21:15.859213+0000","last_clean":"2024-04-20T21:21:15.859213+0000","last_became_active":"2024-04-20T21:21:13.844220+0000","last_became_peered":"2024-04-20T21:21:13.844220+0000","last_unstale":"2024-04-20T21:21:15.859213+0000","last_undegraded":"2024-04-20T21:21:15.859213+0000","last_fullsized":"2024-04-20T21:21:15.859213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:52.654595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504067+0000","last_change":"2024-04-20T21:21:14.860837+0000","last_active":"2024-04-20T21:21:16.504067+0000","last_peered":"2024-04-20T21:21:16.504067+0000","last_clean":"2024-04-20T21:21:16.504067+0000","last_became_active":"2024-04-20T21:21:14.860448+0000","last_became_peered":"2024-04-20T21:21:14.860448+0000","last_unstale":"2024-04-20T21:21:16.504067+0000","last_undegraded":"2024-04-20T21:21:16.504067+0000","last_fullsized":"2024-04-20T21:21:16.504067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:49:06.104703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917495+0000","last_change":"2024-04-20T21:21:13.860626+0000","last_active":"2024-04-20T21:21:16.917495+0000","last_peered":"2024-04-20T21:21:16.917495+0000","last_clean":"2024-04-20T21:21:16.917495+0000","last_became_active":"2024-04-20T21:21:13.860108+0000","last_became_peered":"2024-04-20T21:21:13.860108+0000","last_unstale":"2024-04-20T21:21:16.917495+0000","last_undegraded":"2024-04-20T21:21:16.917495+0000","last_fullsized":"2024-04-20T21:21:16.917495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916590+0000","last_change":"2024-04-20T21:19:19.292405+0000","last_active":"2024-04-20T21:21:16.916590+0000","last_peered":"2024-04-20T21:21:16.916590+0000","last_clean":"2024-04-20T21:21:16.916590+0000","last_became_active":"2024-04-20T21:19:19.290107+0000","last_became_peered":"2024-04-20T21:19:19.290107+0000","last_unstale":"2024-04-20T21:21:16.916590+0000","last_undegraded":"2024-04-20T21:21:16.916590+0000","last_fullsized":"2024-04-20T21:21:16.916590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_clean_scrub_stamp":"2024-04-20T21:19:18.230829+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:48:44.146278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":197439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":787729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T21:21:20.198 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-20T21:21:20.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.439+0000 7f6caaa00640 1 Processor -- start 2024-04-20T21:21:20.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.440+0000 7f6caaa00640 1 -- start start 2024-04-20T21:21:20.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.441+0000 7f6caaa00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ca415e8a0 0x7f6ca406e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.441+0000 7f6caaa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca40d0a70 0x7f6ca40ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.441+0000 7f6caaa00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca406f060 con 0x7f6ca406dbb0 2024-04-20T21:21:20.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.441+0000 7f6caaa00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca406e7c0 con 0x7f6ca415e8a0 2024-04-20T21:21:20.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.441+0000 7f6caaa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca406eaa0 con 0x7f6ca40d0a70 2024-04-20T21:21:20.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.441+0000 7f6ca3e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ca415e8a0 0x7f6ca406e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:20.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.441+0000 7f6ca3e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ca415e8a0 0x7f6ca406e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34766/0 (socket says 172.21.15.71:34766) 2024-04-20T21:21:20.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.441+0000 7f6ca3e00640 1 -- 172.21.15.71:0/74370830 learned_addr learned my addr 172.21.15.71:0/74370830 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:20.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.442+0000 7f6ca3e00640 1 -- 172.21.15.71:0/74370830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca40d0a70 msgr2=0x7f6ca40ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:20.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.442+0000 7f6ca3e00640 1 --2- 172.21.15.71:0/74370830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca40d0a70 0x7f6ca40ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.442+0000 7f6ca3e00640 1 -- 172.21.15.71:0/74370830 >> v1:172.21.15.71:6789/0 conn(0x7f6ca406dbb0 legacy=0x7f6ca40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.442+0000 7f6ca3e00640 1 -- 172.21.15.71:0/74370830 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca406ed80 con 0x7f6ca415e8a0 2024-04-20T21:21:20.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.443+0000 7f6ca3e00640 1 --2- 172.21.15.71:0/74370830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ca415e8a0 0x7f6ca406e1e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009e50 tx=0x7f6c9402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f2421cc5dcacfe server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.443+0000 7f6ca2a00640 1 -- 172.21.15.71:0/74370830 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9402cb00 con 0x7f6ca415e8a0 2024-04-20T21:21:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.443+0000 7f6ca2a00640 1 -- 172.21.15.71:0/74370830 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9402cca0 con 0x7f6ca415e8a0 2024-04-20T21:21:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.443+0000 7f6ca2a00640 1 -- 172.21.15.71:0/74370830 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c94034610 con 0x7f6ca415e8a0 2024-04-20T21:21:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.444+0000 7f6caaa00640 1 -- 172.21.15.71:0/74370830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ca415e8a0 msgr2=0x7f6ca406e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.444+0000 7f6caaa00640 1 --2- 172.21.15.71:0/74370830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ca415e8a0 0x7f6ca406e1e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009e50 tx=0x7f6c9402bf60 comp rx=0 tx=0).stop 2024-04-20T21:21:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.444+0000 7f6caaa00640 1 -- 172.21.15.71:0/74370830 shutdown_connections 2024-04-20T21:21:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.444+0000 7f6caaa00640 1 --2- 172.21.15.71:0/74370830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca40d0a70 0x7f6ca40ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.444+0000 7f6caaa00640 1 --2- 172.21.15.71:0/74370830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ca415e8a0 0x7f6ca406e1e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.444+0000 7f6caaa00640 1 -- 172.21.15.71:0/74370830 >> 172.21.15.71:0/74370830 conn(0x7f6ca40b3350 msgr2=0x7f6ca40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.444+0000 7f6caaa00640 1 -- 172.21.15.71:0/74370830 shutdown_connections 2024-04-20T21:21:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.444+0000 7f6caaa00640 1 -- 172.21.15.71:0/74370830 wait complete. 2024-04-20T21:21:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.446+0000 7f6caaa00640 1 Processor -- start 2024-04-20T21:21:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.446+0000 7f6caaa00640 1 -- start start 2024-04-20T21:21:20.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6caaa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca406dbb0 0x7f6ca414d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6caaa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca40d0a70 0x7f6ca4153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6caaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ca415e8a0 0x7f6ca41f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6caaa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca406fef0 con 0x7f6ca415e8a0 2024-04-20T21:21:20.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6caaa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca406fd70 con 0x7f6ca406dbb0 2024-04-20T21:21:20.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6caaa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca40adbc0 con 0x7f6ca40d0a70 2024-04-20T21:21:20.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6ca8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ca415e8a0 0x7f6ca41f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:20.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6ca8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ca415e8a0 0x7f6ca41f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34770/0 (socket says 172.21.15.71:34770) 2024-04-20T21:21:20.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6ca8a00640 1 -- 172.21.15.71:0/2546991709 learned_addr learned my addr 172.21.15.71:0/2546991709 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:20.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6ca3e00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca406dbb0 0x7f6ca414d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:20.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6ca3400640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca40d0a70 0x7f6ca4153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:20.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6ca8a00640 1 -- 172.21.15.71:0/2546991709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca40d0a70 msgr2=0x7f6ca4153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6ca8a00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca40d0a70 0x7f6ca4153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6ca8a00640 1 -- 172.21.15.71:0/2546991709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca406dbb0 msgr2=0x7f6ca414d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.447+0000 7f6ca8a00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca406dbb0 0x7f6ca414d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.448+0000 7f6ca8a00640 1 -- 172.21.15.71:0/2546991709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca414de60 con 0x7f6ca415e8a0 2024-04-20T21:21:20.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.448+0000 7f6ca3e00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca406dbb0 0x7f6ca414d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:20.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.448+0000 7f6ca8a00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ca415e8a0 0x7f6ca41f4910 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00b410 tx=0x7f6c9c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:20.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.448+0000 7f6c9be00640 1 -- 172.21.15.71:0/2546991709 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c015020 con 0x7f6ca415e8a0 2024-04-20T21:21:20.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.448+0000 7f6c9be00640 1 -- 172.21.15.71:0/2546991709 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9c011850 con 0x7f6ca415e8a0 2024-04-20T21:21:20.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.448+0000 7f6c9be00640 1 -- 172.21.15.71:0/2546991709 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c011c40 con 0x7f6ca415e8a0 2024-04-20T21:21:20.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.448+0000 7f6caaa00640 1 -- 172.21.15.71:0/2546991709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca4151610 con 0x7f6ca415e8a0 2024-04-20T21:21:20.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.448+0000 7f6caaa00640 1 -- 172.21.15.71:0/2546991709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca4151eb0 con 0x7f6ca415e8a0 2024-04-20T21:21:20.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.449+0000 7f6caaa00640 1 -- 172.21.15.71:0/2546991709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca4068980 con 0x7f6ca415e8a0 2024-04-20T21:21:20.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.450+0000 7f6c9be00640 1 -- 172.21.15.71:0/2546991709 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c9c018020 con 0x7f6ca415e8a0 2024-04-20T21:21:20.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.452+0000 7f6c9be00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c8006c920 0x7f6c8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.452+0000 7f6c9be00640 1 -- 172.21.15.71:0/2546991709 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6c9c08bb10 con 0x7f6ca415e8a0 2024-04-20T21:21:20.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.452+0000 7f6ca3e00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c8006c920 0x7f6c8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:20.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.453+0000 7f6ca3e00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c8006c920 0x7f6c8006ede0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c94035000 tx=0x7f6c94030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:20.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.456+0000 7f6c9be00640 1 -- 172.21.15.71:0/2546991709 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6c9c01f020 con 0x7f6ca415e8a0 2024-04-20T21:21:20.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.732+0000 7f6caaa00640 1 -- 172.21.15.71:0/2546991709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6ca406d160 con 0x7f6ca415e8a0 2024-04-20T21:21:20.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.733+0000 7f6c9be00640 1 -- 172.21.15.71:0/2546991709 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1013 (secure 0 0 0) 0x7f6c9c0172c0 con 0x7f6ca415e8a0 2024-04-20T21:21:20.732 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:20.732 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":136,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1713647957,"num_in_osds":8,"osd_in_since":1713647947,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":230469632,"bytes_avail":772863643648,"bytes_total":773094113280,"write_bytes_sec":2384,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5505}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-20T21:20:35.818731+0000","services":{}},"progress_events":{}} 2024-04-20T21:21:20.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 -- 172.21.15.71:0/2546991709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c8006c920 msgr2=0x7f6c8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c8006c920 0x7f6c8006ede0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c94035000 tx=0x7f6c94030000 comp rx=0 tx=0).stop 2024-04-20T21:21:20.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 -- 172.21.15.71:0/2546991709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ca415e8a0 msgr2=0x7f6ca41f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ca415e8a0 0x7f6ca41f4910 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00b410 tx=0x7f6c9c00b8d0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 -- 172.21.15.71:0/2546991709 shutdown_connections 2024-04-20T21:21:20.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f6c8006c920 0x7f6c8006ede0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ca415e8a0 0x7f6ca41f4910 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca40d0a70 0x7f6ca4153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 --2- 172.21.15.71:0/2546991709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca406dbb0 0x7f6ca414d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 -- 172.21.15.71:0/2546991709 >> 172.21.15.71:0/2546991709 conn(0x7f6ca40b3350 msgr2=0x7f6ca415f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:20.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 -- 172.21.15.71:0/2546991709 shutdown_connections 2024-04-20T21:21:20.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.736+0000 7f6caaa00640 1 -- 172.21.15.71:0/2546991709 wait complete. 2024-04-20T21:21:20.753 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-20T21:21:20.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T21:21:20.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.953+0000 7f205e000640 1 Processor -- start 2024-04-20T21:21:20.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.953+0000 7f205e000640 1 -- start start 2024-04-20T21:21:20.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.955+0000 7f205e000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f205806def0 0x7f2058071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.955+0000 7f205e000640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205806b900 con 0x7f205806da90 2024-04-20T21:21:20.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.955+0000 7f205e000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205806bba0 con 0x7f205815a7b0 2024-04-20T21:21:20.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.955+0000 7f205e000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f20580b50a0 con 0x7f205806def0 2024-04-20T21:21:20.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.955+0000 7f204fe00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f205806da90 0x7f205806c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34438/0 (socket says 172.21.15.71:34438) 2024-04-20T21:21:20.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.955+0000 7f204fe00640 1 -- 172.21.15.71:0/3465637666 learned_addr learned my addr 172.21.15.71:0/3465637666 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f205d600640 1 --2- 172.21.15.71:0/3465637666 >> v2:172.21.15.137:3300/0 conn(0x7f205806def0 0x7f2058071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2140974532 0 0) 0x7f205806b900 con 0x7f205806da90 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f203c003520 con 0x7f205806da90 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4121097496 0 0) 0x7f203c003520 con 0x7f205806da90 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 >> v2:172.21.15.137:3300/0 conn(0x7f205806def0 msgr2=0x7f2058071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 --2- 172.21.15.71:0/3465637666 >> v2:172.21.15.137:3300/0 conn(0x7f205806def0 0x7f2058071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 >> v1:172.21.15.137:6789/0 conn(0x7f205815a7b0 legacy=0x7f20580adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205806be80 con 0x7f205806da90 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f2040001690 con 0x7f205806da90 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 >> v1:172.21.15.71:6789/0 conn(0x7f205806da90 legacy=0x7f205806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 --2- 172.21.15.71:0/3465637666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0039b0 0x7f203c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 --2- 172.21.15.71:0/3465637666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f203c004800 0x7f203c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 --2- 172.21.15.71:0/3465637666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f203c0051c0 0x7f203c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f20580b50a0 con 0x7f203c0039b0 2024-04-20T21:21:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f203c00e320 con 0x7f203c0051c0 2024-04-20T21:21:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.956+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f203c00e520 con 0x7f203c004800 2024-04-20T21:21:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.957+0000 7f205cc00640 1 --2- 172.21.15.71:0/3465637666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0039b0 0x7f203c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.957+0000 7f205cc00640 1 -- 172.21.15.71:0/3465637666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f203c004800 msgr2=0x7f203c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.957+0000 7f205cc00640 1 --2- 172.21.15.71:0/3465637666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f203c004800 0x7f203c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.957+0000 7f205d600640 1 --2- 172.21.15.71:0/3465637666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f203c0051c0 0x7f203c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.957+0000 7f205cc00640 1 -- 172.21.15.71:0/3465637666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f203c0051c0 msgr2=0x7f203c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.957+0000 7f205cc00640 1 --2- 172.21.15.71:0/3465637666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f203c0051c0 0x7f203c00dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.957+0000 7f205cc00640 1 -- 172.21.15.71:0/3465637666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203c003520 con 0x7f203c0039b0 2024-04-20T21:21:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.957+0000 7f205d600640 1 -- 172.21.15.71:0/3465637666 reap_dead start 2024-04-20T21:21:20.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.958+0000 7f205cc00640 1 --2- 172.21.15.71:0/3465637666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0039b0 0x7f203c003dd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2048001750 tx=0x7f203c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e97b59719c87c55 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:20.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.958+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048001370 con 0x7f203c0039b0 2024-04-20T21:21:20.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.958+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20480052d0 con 0x7f203c0039b0 2024-04-20T21:21:20.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.959+0000 7f2057e00640 1 -- 172.21.15.71:0/3465637666 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048003830 con 0x7f203c0039b0 2024-04-20T21:21:20.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.959+0000 7f205e000640 1 -- 172.21.15.71:0/3465637666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0039b0 msgr2=0x7f203c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.959+0000 7f205e000640 1 --2- 172.21.15.71:0/3465637666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0039b0 0x7f203c003dd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2048001750 tx=0x7f203c005830 comp rx=0 tx=0).stop 2024-04-20T21:21:20.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.959+0000 7f205e000640 1 -- 172.21.15.71:0/3465637666 shutdown_connections 2024-04-20T21:21:20.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.959+0000 7f205e000640 1 --2- 172.21.15.71:0/3465637666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0039b0 0x7f203c003dd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.959+0000 7f205e000640 1 -- 172.21.15.71:0/3465637666 >> 172.21.15.71:0/3465637666 conn(0x7f20580d0040 msgr2=0x7f20580d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:20.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.959+0000 7f205e000640 1 -- 172.21.15.71:0/3465637666 shutdown_connections 2024-04-20T21:21:20.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.959+0000 7f205e000640 1 -- 172.21.15.71:0/3465637666 wait complete. 2024-04-20T21:21:20.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.961+0000 7f205e000640 1 Processor -- start 2024-04-20T21:21:20.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.961+0000 7f205e000640 1 -- start start 2024-04-20T21:21:20.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.962+0000 7f205e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f203c0039b0 0x7f205814da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.962+0000 7f205e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f205806e4b0 0x7f205806e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.962+0000 7f205e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205814f600 0x7f205814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.962+0000 7f205e000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f20580ae670 con 0x7f205806e4b0 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.962+0000 7f205e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f205806e330 con 0x7f205814f600 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.962+0000 7f205e000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f205806c440 con 0x7f203c0039b0 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.962+0000 7f204fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f205806e4b0 0x7f205806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.962+0000 7f204fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f205806e4b0 0x7f205806e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34792/0 (socket says 172.21.15.71:34792) 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.962+0000 7f204fe00640 1 -- 172.21.15.71:0/3641146615 learned_addr learned my addr 172.21.15.71:0/3641146615 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.963+0000 7f204fe00640 1 -- 172.21.15.71:0/3641146615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f203c0039b0 msgr2=0x7f205814da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.963+0000 7f204fe00640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f203c0039b0 0x7f205814da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.963+0000 7f204fe00640 1 -- 172.21.15.71:0/3641146615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205814f600 msgr2=0x7f205814fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.963+0000 7f204fe00640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205814f600 0x7f205814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.963+0000 7f204fe00640 1 -- 172.21.15.71:0/3641146615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205814df40 con 0x7f205806e4b0 2024-04-20T21:21:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.963+0000 7f204fe00640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f205806e4b0 0x7f205806e930 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f204000c730 tx=0x7f204000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:20.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.963+0000 7f2055600640 1 -- 172.21.15.71:0/3641146615 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2040018070 con 0x7f205806e4b0 2024-04-20T21:21:20.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.963+0000 7f2055600640 1 -- 172.21.15.71:0/3641146615 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20400072f0 con 0x7f205806e4b0 2024-04-20T21:21:20.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.963+0000 7f2055600640 1 -- 172.21.15.71:0/3641146615 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20400047e0 con 0x7f205806e4b0 2024-04-20T21:21:20.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.963+0000 7f205e000640 1 -- 172.21.15.71:0/3641146615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2058155630 con 0x7f205806e4b0 2024-04-20T21:21:20.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.964+0000 7f205e000640 1 -- 172.21.15.71:0/3641146615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20581f3550 con 0x7f205806e4b0 2024-04-20T21:21:20.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.965+0000 7f205e000640 1 -- 172.21.15.71:0/3641146615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2058075b60 con 0x7f205806e4b0 2024-04-20T21:21:20.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.966+0000 7f2055600640 1 -- 172.21.15.71:0/3641146615 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2040004b90 con 0x7f205806e4b0 2024-04-20T21:21:20.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.966+0000 7f2055600640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f203406c8f0 0x7f203406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:20.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.967+0000 7f2055600640 1 -- 172.21.15.71:0/3641146615 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f204008b450 con 0x7f205806e4b0 2024-04-20T21:21:20.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.967+0000 7f205cc00640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f203406c8f0 0x7f203406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:20.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.968+0000 7f205cc00640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f203406c8f0 0x7f203406edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2048033000 tx=0x7f204802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:20.971+0000 7f2055600640 1 -- 172.21.15.71:0/3641146615 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2040059780 con 0x7f205806e4b0 2024-04-20T21:21:21.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.167+0000 7f205e000640 1 -- 172.21.15.71:0/3641146615 --> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20581583c0 con 0x7f203406c8f0 2024-04-20T21:21:21.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.184+0000 7f2055600640 1 -- 172.21.15.71:0/3641146615 <== mgr.4110 v2:172.21.15.71:6832/1511456036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251982 (secure 0 0 0) 0x7f20581583c0 con 0x7f203406c8f0 2024-04-20T21:21:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:21.188 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-20T21:21:21.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.190+0000 7f205e000640 1 -- 172.21.15.71:0/3641146615 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f203406c8f0 msgr2=0x7f203406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:21.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.190+0000 7f205e000640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f203406c8f0 0x7f203406edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2048033000 tx=0x7f204802f000 comp rx=0 tx=0).stop 2024-04-20T21:21:21.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.190+0000 7f205e000640 1 -- 172.21.15.71:0/3641146615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f205806e4b0 msgr2=0x7f205806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:21.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.190+0000 7f205e000640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f205806e4b0 0x7f205806e930 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f204000c730 tx=0x7f204000cbf0 comp rx=0 tx=0).stop 2024-04-20T21:21:21.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.190+0000 7f205e000640 1 -- 172.21.15.71:0/3641146615 shutdown_connections 2024-04-20T21:21:21.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.190+0000 7f205e000640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f203406c8f0 0x7f203406edb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:21.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.190+0000 7f205e000640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205814f600 0x7f205814fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:21.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.190+0000 7f205e000640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f205806e4b0 0x7f205806e930 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:21.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.190+0000 7f205e000640 1 --2- 172.21.15.71:0/3641146615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f203c0039b0 0x7f205814da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:21.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.190+0000 7f205e000640 1 -- 172.21.15.71:0/3641146615 >> 172.21.15.71:0/3641146615 conn(0x7f20580d0040 msgr2=0x7f205814e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:21.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.191+0000 7f205e000640 1 -- 172.21.15.71:0/3641146615 shutdown_connections 2024-04-20T21:21:21.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:21.191+0000 7f205e000640 1 -- 172.21.15.71:0/3641146615 wait complete. 2024-04-20T21:21:21.208 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-20T21:21:19.833598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225068,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749652,"statfs":{"total":773094113280,"available":772863643648,"internally_reserved":0,"allocated":4857856,"data_stored":2764172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.012342"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860618+0000","last_change":"2024-04-20T21:21:14.863803+0000","last_active":"2024-04-20T21:21:15.860618+0000","last_peered":"2024-04-20T21:21:15.860618+0000","last_clean":"2024-04-20T21:21:15.860618+0000","last_became_active":"2024-04-20T21:21:14.863473+0000","last_became_peered":"2024-04-20T21:21:14.863473+0000","last_unstale":"2024-04-20T21:21:15.860618+0000","last_undegraded":"2024-04-20T21:21:15.860618+0000","last_fullsized":"2024-04-20T21:21:15.860618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:50:41.067836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859945+0000","last_change":"2024-04-20T21:21:14.864597+0000","last_active":"2024-04-20T21:21:15.859945+0000","last_peered":"2024-04-20T21:21:15.859945+0000","last_clean":"2024-04-20T21:21:15.859945+0000","last_became_active":"2024-04-20T21:21:14.864276+0000","last_became_peered":"2024-04-20T21:21:14.864276+0000","last_unstale":"2024-04-20T21:21:15.859945+0000","last_undegraded":"2024-04-20T21:21:15.859945+0000","last_fullsized":"2024-04-20T21:21:15.859945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:58:00.847169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915723+0000","last_change":"2024-04-20T21:21:14.858339+0000","last_active":"2024-04-20T21:21:16.915723+0000","last_peered":"2024-04-20T21:21:16.915723+0000","last_clean":"2024-04-20T21:21:16.915723+0000","last_became_active":"2024-04-20T21:21:14.857837+0000","last_became_peered":"2024-04-20T21:21:14.857837+0000","last_unstale":"2024-04-20T21:21:16.915723+0000","last_undegraded":"2024-04-20T21:21:16.915723+0000","last_fullsized":"2024-04-20T21:21:16.915723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:32.387656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839497+0000","last_change":"2024-04-20T21:21:14.873437+0000","last_active":"2024-04-20T21:21:16.839497+0000","last_peered":"2024-04-20T21:21:16.839497+0000","last_clean":"2024-04-20T21:21:16.839497+0000","last_became_active":"2024-04-20T21:21:14.873135+0000","last_became_peered":"2024-04-20T21:21:14.873135+0000","last_unstale":"2024-04-20T21:21:16.839497+0000","last_undegraded":"2024-04-20T21:21:16.839497+0000","last_fullsized":"2024-04-20T21:21:16.839497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:22.233137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838996+0000","last_change":"2024-04-20T21:21:14.870377+0000","last_active":"2024-04-20T21:21:16.838996+0000","last_peered":"2024-04-20T21:21:16.838996+0000","last_clean":"2024-04-20T21:21:16.838996+0000","last_became_active":"2024-04-20T21:21:14.868821+0000","last_became_peered":"2024-04-20T21:21:14.868821+0000","last_unstale":"2024-04-20T21:21:16.838996+0000","last_undegraded":"2024-04-20T21:21:16.838996+0000","last_fullsized":"2024-04-20T21:21:16.838996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:16:39.973000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914434+0000","last_change":"2024-04-20T21:21:14.868104+0000","last_active":"2024-04-20T21:21:16.914434+0000","last_peered":"2024-04-20T21:21:16.914434+0000","last_clean":"2024-04-20T21:21:16.914434+0000","last_became_active":"2024-04-20T21:21:14.867046+0000","last_became_peered":"2024-04-20T21:21:14.867046+0000","last_unstale":"2024-04-20T21:21:16.914434+0000","last_undegraded":"2024-04-20T21:21:16.914434+0000","last_fullsized":"2024-04-20T21:21:16.914434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:49:59.837058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503929+0000","last_change":"2024-04-20T21:21:14.862506+0000","last_active":"2024-04-20T21:21:16.503929+0000","last_peered":"2024-04-20T21:21:16.503929+0000","last_clean":"2024-04-20T21:21:16.503929+0000","last_became_active":"2024-04-20T21:21:14.862025+0000","last_became_peered":"2024-04-20T21:21:14.862025+0000","last_unstale":"2024-04-20T21:21:16.503929+0000","last_undegraded":"2024-04-20T21:21:16.503929+0000","last_fullsized":"2024-04-20T21:21:16.503929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:27:54.200655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859531+0000","last_change":"2024-04-20T21:21:14.858707+0000","last_active":"2024-04-20T21:21:15.859531+0000","last_peered":"2024-04-20T21:21:15.859531+0000","last_clean":"2024-04-20T21:21:15.859531+0000","last_became_active":"2024-04-20T21:21:14.858433+0000","last_became_peered":"2024-04-20T21:21:14.858433+0000","last_unstale":"2024-04-20T21:21:15.859531+0000","last_undegraded":"2024-04-20T21:21:15.859531+0000","last_fullsized":"2024-04-20T21:21:15.859531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:26:03.453414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915812+0000","last_change":"2024-04-20T21:21:14.859567+0000","last_active":"2024-04-20T21:21:16.915812+0000","last_peered":"2024-04-20T21:21:16.915812+0000","last_clean":"2024-04-20T21:21:16.915812+0000","last_became_active":"2024-04-20T21:21:14.859157+0000","last_became_peered":"2024-04-20T21:21:14.859157+0000","last_unstale":"2024-04-20T21:21:16.915812+0000","last_undegraded":"2024-04-20T21:21:16.915812+0000","last_fullsized":"2024-04-20T21:21:16.915812+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:14:09.298044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503997+0000","last_change":"2024-04-20T21:21:14.857630+0000","last_active":"2024-04-20T21:21:16.503997+0000","last_peered":"2024-04-20T21:21:16.503997+0000","last_clean":"2024-04-20T21:21:16.503997+0000","last_became_active":"2024-04-20T21:21:14.857269+0000","last_became_peered":"2024-04-20T21:21:14.857269+0000","last_unstale":"2024-04-20T21:21:16.503997+0000","last_undegraded":"2024-04-20T21:21:16.503997+0000","last_fullsized":"2024-04-20T21:21:16.503997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:57:59.730923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504353+0000","last_change":"2024-04-20T21:21:14.871863+0000","last_active":"2024-04-20T21:21:16.504353+0000","last_peered":"2024-04-20T21:21:16.504353+0000","last_clean":"2024-04-20T21:21:16.504353+0000","last_became_active":"2024-04-20T21:21:14.871546+0000","last_became_peered":"2024-04-20T21:21:14.871546+0000","last_unstale":"2024-04-20T21:21:16.504353+0000","last_undegraded":"2024-04-20T21:21:16.504353+0000","last_fullsized":"2024-04-20T21:21:16.504353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:36.325484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915472+0000","last_change":"2024-04-20T21:21:14.864901+0000","last_active":"2024-04-20T21:21:16.915472+0000","last_peered":"2024-04-20T21:21:16.915472+0000","last_clean":"2024-04-20T21:21:16.915472+0000","last_became_active":"2024-04-20T21:21:14.862268+0000","last_became_peered":"2024-04-20T21:21:14.862268+0000","last_unstale":"2024-04-20T21:21:16.915472+0000","last_undegraded":"2024-04-20T21:21:16.915472+0000","last_fullsized":"2024-04-20T21:21:16.915472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:35.242959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503693+0000","last_change":"2024-04-20T21:21:14.857737+0000","last_active":"2024-04-20T21:21:16.503693+0000","last_peered":"2024-04-20T21:21:16.503693+0000","last_clean":"2024-04-20T21:21:16.503693+0000","last_became_active":"2024-04-20T21:21:14.857431+0000","last_became_peered":"2024-04-20T21:21:14.857431+0000","last_unstale":"2024-04-20T21:21:16.503693+0000","last_undegraded":"2024-04-20T21:21:16.503693+0000","last_fullsized":"2024-04-20T21:21:16.503693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:38:16.941267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861488+0000","last_change":"2024-04-20T21:21:14.875694+0000","last_active":"2024-04-20T21:21:15.861488+0000","last_peered":"2024-04-20T21:21:15.861488+0000","last_clean":"2024-04-20T21:21:15.861488+0000","last_became_active":"2024-04-20T21:21:14.875399+0000","last_became_peered":"2024-04-20T21:21:14.875399+0000","last_unstale":"2024-04-20T21:21:15.861488+0000","last_undegraded":"2024-04-20T21:21:15.861488+0000","last_fullsized":"2024-04-20T21:21:15.861488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503292+0000","last_change":"2024-04-20T21:21:14.858950+0000","last_active":"2024-04-20T21:21:16.503292+0000","last_peered":"2024-04-20T21:21:16.503292+0000","last_clean":"2024-04-20T21:21:16.503292+0000","last_became_active":"2024-04-20T21:21:14.858606+0000","last_became_peered":"2024-04-20T21:21:14.858606+0000","last_unstale":"2024-04-20T21:21:16.503292+0000","last_undegraded":"2024-04-20T21:21:16.503292+0000","last_fullsized":"2024-04-20T21:21:16.503292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:14:09.298044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916349+0000","last_change":"2024-04-20T21:21:14.855465+0000","last_active":"2024-04-20T21:21:16.916349+0000","last_peered":"2024-04-20T21:21:16.916349+0000","last_clean":"2024-04-20T21:21:16.916349+0000","last_became_active":"2024-04-20T21:21:14.855172+0000","last_became_peered":"2024-04-20T21:21:14.855172+0000","last_unstale":"2024-04-20T21:21:16.916349+0000","last_undegraded":"2024-04-20T21:21:16.916349+0000","last_fullsized":"2024-04-20T21:21:16.916349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917453+0000","last_change":"2024-04-20T21:21:14.860920+0000","last_active":"2024-04-20T21:21:16.917453+0000","last_peered":"2024-04-20T21:21:16.917453+0000","last_clean":"2024-04-20T21:21:16.917453+0000","last_became_active":"2024-04-20T21:21:14.856351+0000","last_became_peered":"2024-04-20T21:21:14.856351+0000","last_unstale":"2024-04-20T21:21:16.917453+0000","last_undegraded":"2024-04-20T21:21:16.917453+0000","last_fullsized":"2024-04-20T21:21:16.917453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:29:28.575895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860277+0000","last_change":"2024-04-20T21:21:14.877013+0000","last_active":"2024-04-20T21:21:15.860277+0000","last_peered":"2024-04-20T21:21:15.860277+0000","last_clean":"2024-04-20T21:21:15.860277+0000","last_became_active":"2024-04-20T21:21:14.876706+0000","last_became_peered":"2024-04-20T21:21:14.876706+0000","last_unstale":"2024-04-20T21:21:15.860277+0000","last_undegraded":"2024-04-20T21:21:15.860277+0000","last_fullsized":"2024-04-20T21:21:15.860277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:43.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839085+0000","last_change":"2024-04-20T21:21:14.856777+0000","last_active":"2024-04-20T21:21:16.839085+0000","last_peered":"2024-04-20T21:21:16.839085+0000","last_clean":"2024-04-20T21:21:16.839085+0000","last_became_active":"2024-04-20T21:21:14.855452+0000","last_became_peered":"2024-04-20T21:21:14.855452+0000","last_unstale":"2024-04-20T21:21:16.839085+0000","last_undegraded":"2024-04-20T21:21:16.839085+0000","last_fullsized":"2024-04-20T21:21:16.839085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:37:17.281450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860213+0000","last_change":"2024-04-20T21:21:14.866614+0000","last_active":"2024-04-20T21:21:15.860213+0000","last_peered":"2024-04-20T21:21:15.860213+0000","last_clean":"2024-04-20T21:21:15.860213+0000","last_became_active":"2024-04-20T21:21:14.866140+0000","last_became_peered":"2024-04-20T21:21:14.866140+0000","last_unstale":"2024-04-20T21:21:15.860213+0000","last_undegraded":"2024-04-20T21:21:15.860213+0000","last_fullsized":"2024-04-20T21:21:15.860213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:23.573740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503678+0000","last_change":"2024-04-20T21:21:14.854745+0000","last_active":"2024-04-20T21:21:16.503678+0000","last_peered":"2024-04-20T21:21:16.503678+0000","last_clean":"2024-04-20T21:21:16.503678+0000","last_became_active":"2024-04-20T21:21:14.854464+0000","last_became_peered":"2024-04-20T21:21:14.854464+0000","last_unstale":"2024-04-20T21:21:16.503678+0000","last_undegraded":"2024-04-20T21:21:16.503678+0000","last_fullsized":"2024-04-20T21:21:16.503678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:40.817426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.862002+0000","last_change":"2024-04-20T21:21:14.872869+0000","last_active":"2024-04-20T21:21:15.862002+0000","last_peered":"2024-04-20T21:21:15.862002+0000","last_clean":"2024-04-20T21:21:15.862002+0000","last_became_active":"2024-04-20T21:21:14.872631+0000","last_became_peered":"2024-04-20T21:21:14.872631+0000","last_unstale":"2024-04-20T21:21:15.862002+0000","last_undegraded":"2024-04-20T21:21:15.862002+0000","last_fullsized":"2024-04-20T21:21:15.862002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:59.360668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916591+0000","last_change":"2024-04-20T21:21:14.842819+0000","last_active":"2024-04-20T21:21:16.916591+0000","last_peered":"2024-04-20T21:21:16.916591+0000","last_clean":"2024-04-20T21:21:16.916591+0000","last_became_active":"2024-04-20T21:21:14.842168+0000","last_became_peered":"2024-04-20T21:21:14.842168+0000","last_unstale":"2024-04-20T21:21:16.916591+0000","last_undegraded":"2024-04-20T21:21:16.916591+0000","last_fullsized":"2024-04-20T21:21:16.916591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839206+0000","last_change":"2024-04-20T21:21:14.842239+0000","last_active":"2024-04-20T21:21:16.839206+0000","last_peered":"2024-04-20T21:21:16.839206+0000","last_clean":"2024-04-20T21:21:16.839206+0000","last_became_active":"2024-04-20T21:21:14.841546+0000","last_became_peered":"2024-04-20T21:21:14.841546+0000","last_unstale":"2024-04-20T21:21:16.839206+0000","last_undegraded":"2024-04-20T21:21:16.839206+0000","last_fullsized":"2024-04-20T21:21:16.839206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:44:47.858452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860663+0000","last_change":"2024-04-20T21:21:14.862627+0000","last_active":"2024-04-20T21:21:15.860663+0000","last_peered":"2024-04-20T21:21:15.860663+0000","last_clean":"2024-04-20T21:21:15.860663+0000","last_became_active":"2024-04-20T21:21:14.862348+0000","last_became_peered":"2024-04-20T21:21:14.862348+0000","last_unstale":"2024-04-20T21:21:15.860663+0000","last_undegraded":"2024-04-20T21:21:15.860663+0000","last_fullsized":"2024-04-20T21:21:15.860663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:54:35.961822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914999+0000","last_change":"2024-04-20T21:21:14.869769+0000","last_active":"2024-04-20T21:21:16.914999+0000","last_peered":"2024-04-20T21:21:16.914999+0000","last_clean":"2024-04-20T21:21:16.914999+0000","last_became_active":"2024-04-20T21:21:14.869490+0000","last_became_peered":"2024-04-20T21:21:14.869490+0000","last_unstale":"2024-04-20T21:21:16.914999+0000","last_undegraded":"2024-04-20T21:21:16.914999+0000","last_fullsized":"2024-04-20T21:21:16.914999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860445+0000","last_change":"2024-04-20T21:21:14.846180+0000","last_active":"2024-04-20T21:21:15.860445+0000","last_peered":"2024-04-20T21:21:15.860445+0000","last_clean":"2024-04-20T21:21:15.860445+0000","last_became_active":"2024-04-20T21:21:14.845844+0000","last_became_peered":"2024-04-20T21:21:14.845844+0000","last_unstale":"2024-04-20T21:21:15.860445+0000","last_undegraded":"2024-04-20T21:21:15.860445+0000","last_fullsized":"2024-04-20T21:21:15.860445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:53.010372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504643+0000","last_change":"2024-04-20T21:21:14.856442+0000","last_active":"2024-04-20T21:21:16.504643+0000","last_peered":"2024-04-20T21:21:16.504643+0000","last_clean":"2024-04-20T21:21:16.504643+0000","last_became_active":"2024-04-20T21:21:14.856130+0000","last_became_peered":"2024-04-20T21:21:14.856130+0000","last_unstale":"2024-04-20T21:21:16.504643+0000","last_undegraded":"2024-04-20T21:21:16.504643+0000","last_fullsized":"2024-04-20T21:21:16.504643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:37:09.139008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859956+0000","last_change":"2024-04-20T21:21:14.857158+0000","last_active":"2024-04-20T21:21:15.859956+0000","last_peered":"2024-04-20T21:21:15.859956+0000","last_clean":"2024-04-20T21:21:15.859956+0000","last_became_active":"2024-04-20T21:21:14.852988+0000","last_became_peered":"2024-04-20T21:21:14.852988+0000","last_unstale":"2024-04-20T21:21:15.859956+0000","last_undegraded":"2024-04-20T21:21:15.859956+0000","last_fullsized":"2024-04-20T21:21:15.859956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:38.325073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859521+0000","last_change":"2024-04-20T21:21:14.855153+0000","last_active":"2024-04-20T21:21:15.859521+0000","last_peered":"2024-04-20T21:21:15.859521+0000","last_clean":"2024-04-20T21:21:15.859521+0000","last_became_active":"2024-04-20T21:21:14.854858+0000","last_became_peered":"2024-04-20T21:21:14.854858+0000","last_unstale":"2024-04-20T21:21:15.859521+0000","last_undegraded":"2024-04-20T21:21:15.859521+0000","last_fullsized":"2024-04-20T21:21:15.859521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:10:30.105415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916765+0000","last_change":"2024-04-20T21:21:14.844379+0000","last_active":"2024-04-20T21:21:16.916765+0000","last_peered":"2024-04-20T21:21:16.916765+0000","last_clean":"2024-04-20T21:21:16.916765+0000","last_became_active":"2024-04-20T21:21:14.840709+0000","last_became_peered":"2024-04-20T21:21:14.840709+0000","last_unstale":"2024-04-20T21:21:16.916765+0000","last_undegraded":"2024-04-20T21:21:16.916765+0000","last_fullsized":"2024-04-20T21:21:16.916765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914616+0000","last_change":"2024-04-20T21:21:14.849087+0000","last_active":"2024-04-20T21:21:16.914616+0000","last_peered":"2024-04-20T21:21:16.914616+0000","last_clean":"2024-04-20T21:21:16.914616+0000","last_became_active":"2024-04-20T21:21:14.848753+0000","last_became_peered":"2024-04-20T21:21:14.848753+0000","last_unstale":"2024-04-20T21:21:16.914616+0000","last_undegraded":"2024-04-20T21:21:16.914616+0000","last_fullsized":"2024-04-20T21:21:16.914616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.668807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917355+0000","last_change":"2024-04-20T21:21:14.854607+0000","last_active":"2024-04-20T21:21:16.917355+0000","last_peered":"2024-04-20T21:21:16.917355+0000","last_clean":"2024-04-20T21:21:16.917355+0000","last_became_active":"2024-04-20T21:21:14.854334+0000","last_became_peered":"2024-04-20T21:21:14.854334+0000","last_unstale":"2024-04-20T21:21:16.917355+0000","last_undegraded":"2024-04-20T21:21:16.917355+0000","last_fullsized":"2024-04-20T21:21:16.917355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:14:09.298044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860470+0000","last_change":"2024-04-20T21:21:13.854943+0000","last_active":"2024-04-20T21:21:15.860470+0000","last_peered":"2024-04-20T21:21:15.860470+0000","last_clean":"2024-04-20T21:21:15.860470+0000","last_became_active":"2024-04-20T21:21:13.852987+0000","last_became_peered":"2024-04-20T21:21:13.852987+0000","last_unstale":"2024-04-20T21:21:15.860470+0000","last_undegraded":"2024-04-20T21:21:15.860470+0000","last_fullsized":"2024-04-20T21:21:15.860470+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:45:20.432399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915087+0000","last_change":"2024-04-20T21:21:14.865422+0000","last_active":"2024-04-20T21:21:16.915087+0000","last_peered":"2024-04-20T21:21:16.915087+0000","last_clean":"2024-04-20T21:21:16.915087+0000","last_became_active":"2024-04-20T21:21:14.865033+0000","last_became_peered":"2024-04-20T21:21:14.865033+0000","last_unstale":"2024-04-20T21:21:16.915087+0000","last_undegraded":"2024-04-20T21:21:16.915087+0000","last_fullsized":"2024-04-20T21:21:16.915087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915666+0000","last_change":"2024-04-20T21:21:13.852552+0000","last_active":"2024-04-20T21:21:16.915666+0000","last_peered":"2024-04-20T21:21:16.915666+0000","last_clean":"2024-04-20T21:21:16.915666+0000","last_became_active":"2024-04-20T21:21:13.852231+0000","last_became_peered":"2024-04-20T21:21:13.852231+0000","last_unstale":"2024-04-20T21:21:16.915666+0000","last_undegraded":"2024-04-20T21:21:16.915666+0000","last_fullsized":"2024-04-20T21:21:16.915666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:51.996160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861499+0000","last_change":"2024-04-20T21:21:14.874272+0000","last_active":"2024-04-20T21:21:15.861499+0000","last_peered":"2024-04-20T21:21:15.861499+0000","last_clean":"2024-04-20T21:21:15.861499+0000","last_became_active":"2024-04-20T21:21:14.873628+0000","last_became_peered":"2024-04-20T21:21:14.873628+0000","last_unstale":"2024-04-20T21:21:15.861499+0000","last_undegraded":"2024-04-20T21:21:15.861499+0000","last_fullsized":"2024-04-20T21:21:15.861499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915232+0000","last_change":"2024-04-20T21:21:13.854104+0000","last_active":"2024-04-20T21:21:16.915232+0000","last_peered":"2024-04-20T21:21:16.915232+0000","last_clean":"2024-04-20T21:21:16.915232+0000","last_became_active":"2024-04-20T21:21:13.853806+0000","last_became_peered":"2024-04-20T21:21:13.853806+0000","last_unstale":"2024-04-20T21:21:16.915232+0000","last_undegraded":"2024-04-20T21:21:16.915232+0000","last_fullsized":"2024-04-20T21:21:16.915232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:54:34.947611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860373+0000","last_change":"2024-04-20T21:21:14.866651+0000","last_active":"2024-04-20T21:21:15.860373+0000","last_peered":"2024-04-20T21:21:15.860373+0000","last_clean":"2024-04-20T21:21:15.860373+0000","last_became_active":"2024-04-20T21:21:14.866366+0000","last_became_peered":"2024-04-20T21:21:14.866366+0000","last_unstale":"2024-04-20T21:21:15.860373+0000","last_undegraded":"2024-04-20T21:21:15.860373+0000","last_fullsized":"2024-04-20T21:21:15.860373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:22:40.054174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861432+0000","last_change":"2024-04-20T21:21:13.850583+0000","last_active":"2024-04-20T21:21:15.861432+0000","last_peered":"2024-04-20T21:21:15.861432+0000","last_clean":"2024-04-20T21:21:15.861432+0000","last_became_active":"2024-04-20T21:21:13.850278+0000","last_became_peered":"2024-04-20T21:21:13.850278+0000","last_unstale":"2024-04-20T21:21:15.861432+0000","last_undegraded":"2024-04-20T21:21:15.861432+0000","last_fullsized":"2024-04-20T21:21:15.861432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:37.310861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914402+0000","last_change":"2024-04-20T21:21:14.859125+0000","last_active":"2024-04-20T21:21:16.914402+0000","last_peered":"2024-04-20T21:21:16.914402+0000","last_clean":"2024-04-20T21:21:16.914402+0000","last_became_active":"2024-04-20T21:21:14.857373+0000","last_became_peered":"2024-04-20T21:21:14.857373+0000","last_unstale":"2024-04-20T21:21:16.914402+0000","last_undegraded":"2024-04-20T21:21:16.914402+0000","last_fullsized":"2024-04-20T21:21:16.914402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.668807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503824+0000","last_change":"2024-04-20T21:21:13.853816+0000","last_active":"2024-04-20T21:21:16.503824+0000","last_peered":"2024-04-20T21:21:16.503824+0000","last_clean":"2024-04-20T21:21:16.503824+0000","last_became_active":"2024-04-20T21:21:13.853491+0000","last_became_peered":"2024-04-20T21:21:13.853491+0000","last_unstale":"2024-04-20T21:21:16.503824+0000","last_undegraded":"2024-04-20T21:21:16.503824+0000","last_fullsized":"2024-04-20T21:21:16.503824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:20:31.052941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503862+0000","last_change":"2024-04-20T21:21:14.872207+0000","last_active":"2024-04-20T21:21:16.503862+0000","last_peered":"2024-04-20T21:21:16.503862+0000","last_clean":"2024-04-20T21:21:16.503862+0000","last_became_active":"2024-04-20T21:21:14.870765+0000","last_became_peered":"2024-04-20T21:21:14.870765+0000","last_unstale":"2024-04-20T21:21:16.503862+0000","last_undegraded":"2024-04-20T21:21:16.503862+0000","last_fullsized":"2024-04-20T21:21:16.503862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:53:23.267234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917102+0000","last_change":"2024-04-20T21:21:13.859366+0000","last_active":"2024-04-20T21:21:16.917102+0000","last_peered":"2024-04-20T21:21:16.917102+0000","last_clean":"2024-04-20T21:21:16.917102+0000","last_became_active":"2024-04-20T21:21:13.858946+0000","last_became_peered":"2024-04-20T21:21:13.858946+0000","last_unstale":"2024-04-20T21:21:16.917102+0000","last_undegraded":"2024-04-20T21:21:16.917102+0000","last_fullsized":"2024-04-20T21:21:16.917102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:10:29.091204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861999+0000","last_change":"2024-04-20T21:21:14.874893+0000","last_active":"2024-04-20T21:21:15.861999+0000","last_peered":"2024-04-20T21:21:15.861999+0000","last_clean":"2024-04-20T21:21:15.861999+0000","last_became_active":"2024-04-20T21:21:14.874544+0000","last_became_peered":"2024-04-20T21:21:14.874544+0000","last_unstale":"2024-04-20T21:21:15.861999+0000","last_undegraded":"2024-04-20T21:21:15.861999+0000","last_fullsized":"2024-04-20T21:21:15.861999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:35.242959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914466+0000","last_change":"2024-04-20T21:21:13.850618+0000","last_active":"2024-04-20T21:21:16.914466+0000","last_peered":"2024-04-20T21:21:16.914466+0000","last_clean":"2024-04-20T21:21:16.914466+0000","last_became_active":"2024-04-20T21:21:13.850356+0000","last_became_peered":"2024-04-20T21:21:13.850356+0000","last_unstale":"2024-04-20T21:21:16.914466+0000","last_undegraded":"2024-04-20T21:21:16.914466+0000","last_fullsized":"2024-04-20T21:21:16.914466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:37.310861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859548+0000","last_change":"2024-04-20T21:21:14.864327+0000","last_active":"2024-04-20T21:21:15.859548+0000","last_peered":"2024-04-20T21:21:15.859548+0000","last_clean":"2024-04-20T21:21:15.859548+0000","last_became_active":"2024-04-20T21:21:14.861546+0000","last_became_peered":"2024-04-20T21:21:14.861546+0000","last_unstale":"2024-04-20T21:21:15.859548+0000","last_undegraded":"2024-04-20T21:21:15.859548+0000","last_fullsized":"2024-04-20T21:21:15.859548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:36.325484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860658+0000","last_change":"2024-04-20T21:21:13.859332+0000","last_active":"2024-04-20T21:21:15.860658+0000","last_peered":"2024-04-20T21:21:15.860658+0000","last_clean":"2024-04-20T21:21:15.860658+0000","last_became_active":"2024-04-20T21:21:13.858593+0000","last_became_peered":"2024-04-20T21:21:13.858593+0000","last_unstale":"2024-04-20T21:21:15.860658+0000","last_undegraded":"2024-04-20T21:21:15.860658+0000","last_fullsized":"2024-04-20T21:21:15.860658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:51.996160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839694+0000","last_change":"2024-04-20T21:21:14.867091+0000","last_active":"2024-04-20T21:21:16.839694+0000","last_peered":"2024-04-20T21:21:16.839694+0000","last_clean":"2024-04-20T21:21:16.839694+0000","last_became_active":"2024-04-20T21:21:14.866832+0000","last_became_peered":"2024-04-20T21:21:14.866832+0000","last_unstale":"2024-04-20T21:21:16.839694+0000","last_undegraded":"2024-04-20T21:21:16.839694+0000","last_fullsized":"2024-04-20T21:21:16.839694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:45:21.446611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860424+0000","last_change":"2024-04-20T21:21:13.846256+0000","last_active":"2024-04-20T21:21:15.860424+0000","last_peered":"2024-04-20T21:21:15.860424+0000","last_clean":"2024-04-20T21:21:15.860424+0000","last_became_active":"2024-04-20T21:21:13.845720+0000","last_became_peered":"2024-04-20T21:21:13.845720+0000","last_unstale":"2024-04-20T21:21:15.860424+0000","last_undegraded":"2024-04-20T21:21:15.860424+0000","last_fullsized":"2024-04-20T21:21:15.860424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:27.895382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916985+0000","last_change":"2024-04-20T21:21:14.848212+0000","last_active":"2024-04-20T21:21:16.916985+0000","last_peered":"2024-04-20T21:21:16.916985+0000","last_clean":"2024-04-20T21:21:16.916985+0000","last_became_active":"2024-04-20T21:21:14.847460+0000","last_became_peered":"2024-04-20T21:21:14.847460+0000","last_unstale":"2024-04-20T21:21:16.916985+0000","last_undegraded":"2024-04-20T21:21:16.916985+0000","last_fullsized":"2024-04-20T21:21:16.916985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:32.387656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504325+0000","last_change":"2024-04-20T21:21:13.854168+0000","last_active":"2024-04-20T21:21:16.504325+0000","last_peered":"2024-04-20T21:21:16.504325+0000","last_clean":"2024-04-20T21:21:16.504325+0000","last_became_active":"2024-04-20T21:21:13.853371+0000","last_became_peered":"2024-04-20T21:21:13.853371+0000","last_unstale":"2024-04-20T21:21:16.504325+0000","last_undegraded":"2024-04-20T21:21:16.504325+0000","last_fullsized":"2024-04-20T21:21:16.504325+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:24:02.233206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915592+0000","last_change":"2024-04-20T21:21:14.858943+0000","last_active":"2024-04-20T21:21:16.915592+0000","last_peered":"2024-04-20T21:21:16.915592+0000","last_clean":"2024-04-20T21:21:16.915592+0000","last_became_active":"2024-04-20T21:21:14.858687+0000","last_became_peered":"2024-04-20T21:21:14.858687+0000","last_unstale":"2024-04-20T21:21:16.915592+0000","last_undegraded":"2024-04-20T21:21:16.915592+0000","last_fullsized":"2024-04-20T21:21:16.915592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:59.360668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504340+0000","last_change":"2024-04-20T21:21:13.852073+0000","last_active":"2024-04-20T21:21:16.504340+0000","last_peered":"2024-04-20T21:21:16.504340+0000","last_clean":"2024-04-20T21:21:16.504340+0000","last_became_active":"2024-04-20T21:21:13.851166+0000","last_became_peered":"2024-04-20T21:21:13.851166+0000","last_unstale":"2024-04-20T21:21:16.504340+0000","last_undegraded":"2024-04-20T21:21:16.504340+0000","last_fullsized":"2024-04-20T21:21:16.504340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861772+0000","last_change":"2024-04-20T21:21:14.873140+0000","last_active":"2024-04-20T21:21:15.861772+0000","last_peered":"2024-04-20T21:21:15.861772+0000","last_clean":"2024-04-20T21:21:15.861772+0000","last_became_active":"2024-04-20T21:21:14.872806+0000","last_became_peered":"2024-04-20T21:21:14.872806+0000","last_unstale":"2024-04-20T21:21:15.861772+0000","last_undegraded":"2024-04-20T21:21:15.861772+0000","last_fullsized":"2024-04-20T21:21:15.861772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859906+0000","last_change":"2024-04-20T21:21:13.854623+0000","last_active":"2024-04-20T21:21:15.859906+0000","last_peered":"2024-04-20T21:21:15.859906+0000","last_clean":"2024-04-20T21:21:15.859906+0000","last_became_active":"2024-04-20T21:21:13.854357+0000","last_became_peered":"2024-04-20T21:21:13.854357+0000","last_unstale":"2024-04-20T21:21:15.859906+0000","last_undegraded":"2024-04-20T21:21:15.859906+0000","last_fullsized":"2024-04-20T21:21:15.859906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:32.176825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914482+0000","last_change":"2024-04-20T21:21:14.857939+0000","last_active":"2024-04-20T21:21:16.914482+0000","last_peered":"2024-04-20T21:21:16.914482+0000","last_clean":"2024-04-20T21:21:16.914482+0000","last_became_active":"2024-04-20T21:21:14.857676+0000","last_became_peered":"2024-04-20T21:21:14.857676+0000","last_unstale":"2024-04-20T21:21:16.914482+0000","last_undegraded":"2024-04-20T21:21:16.914482+0000","last_fullsized":"2024-04-20T21:21:16.914482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859705+0000","last_change":"2024-04-20T21:21:13.847644+0000","last_active":"2024-04-20T21:21:15.859705+0000","last_peered":"2024-04-20T21:21:15.859705+0000","last_clean":"2024-04-20T21:21:15.859705+0000","last_became_active":"2024-04-20T21:21:13.846847+0000","last_became_peered":"2024-04-20T21:21:13.846847+0000","last_unstale":"2024-04-20T21:21:15.859705+0000","last_undegraded":"2024-04-20T21:21:15.859705+0000","last_fullsized":"2024-04-20T21:21:15.859705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:02.155842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859665+0000","last_change":"2024-04-20T21:21:14.861546+0000","last_active":"2024-04-20T21:21:15.859665+0000","last_peered":"2024-04-20T21:21:15.859665+0000","last_clean":"2024-04-20T21:21:15.859665+0000","last_became_active":"2024-04-20T21:21:14.861240+0000","last_became_peered":"2024-04-20T21:21:14.861240+0000","last_unstale":"2024-04-20T21:21:15.859665+0000","last_undegraded":"2024-04-20T21:21:15.859665+0000","last_fullsized":"2024-04-20T21:21:15.859665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:37:09.139008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914500+0000","last_change":"2024-04-20T21:21:13.849628+0000","last_active":"2024-04-20T21:21:16.914500+0000","last_peered":"2024-04-20T21:21:16.914500+0000","last_clean":"2024-04-20T21:21:16.914500+0000","last_became_active":"2024-04-20T21:21:13.849326+0000","last_became_peered":"2024-04-20T21:21:13.849326+0000","last_unstale":"2024-04-20T21:21:16.914500+0000","last_undegraded":"2024-04-20T21:21:16.914500+0000","last_fullsized":"2024-04-20T21:21:16.914500+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917493+0000","last_change":"2024-04-20T21:21:14.844280+0000","last_active":"2024-04-20T21:21:16.917493+0000","last_peered":"2024-04-20T21:21:16.917493+0000","last_clean":"2024-04-20T21:21:16.917493+0000","last_became_active":"2024-04-20T21:21:14.843920+0000","last_became_peered":"2024-04-20T21:21:14.843920+0000","last_unstale":"2024-04-20T21:21:16.917493+0000","last_undegraded":"2024-04-20T21:21:16.917493+0000","last_fullsized":"2024-04-20T21:21:16.917493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:38:16.941267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859203+0000","last_change":"2024-04-20T21:21:13.857369+0000","last_active":"2024-04-20T21:21:15.859203+0000","last_peered":"2024-04-20T21:21:15.859203+0000","last_clean":"2024-04-20T21:21:15.859203+0000","last_became_active":"2024-04-20T21:21:13.856231+0000","last_became_peered":"2024-04-20T21:21:13.856231+0000","last_unstale":"2024-04-20T21:21:15.859203+0000","last_undegraded":"2024-04-20T21:21:15.859203+0000","last_fullsized":"2024-04-20T21:21:15.859203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:21.218925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859673+0000","last_change":"2024-04-20T21:21:14.862052+0000","last_active":"2024-04-20T21:21:15.859673+0000","last_peered":"2024-04-20T21:21:15.859673+0000","last_clean":"2024-04-20T21:21:15.859673+0000","last_became_active":"2024-04-20T21:21:14.861071+0000","last_became_peered":"2024-04-20T21:21:14.861071+0000","last_unstale":"2024-04-20T21:21:15.859673+0000","last_undegraded":"2024-04-20T21:21:15.859673+0000","last_fullsized":"2024-04-20T21:21:15.859673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:15:19.755482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916259+0000","last_change":"2024-04-20T21:21:13.860489+0000","last_active":"2024-04-20T21:21:16.916259+0000","last_peered":"2024-04-20T21:21:16.916259+0000","last_clean":"2024-04-20T21:21:16.916259+0000","last_became_active":"2024-04-20T21:21:13.859676+0000","last_became_peered":"2024-04-20T21:21:13.859676+0000","last_unstale":"2024-04-20T21:21:16.916259+0000","last_undegraded":"2024-04-20T21:21:16.916259+0000","last_fullsized":"2024-04-20T21:21:16.916259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:09:15.823481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860186+0000","last_change":"2024-04-20T21:21:14.863015+0000","last_active":"2024-04-20T21:21:15.860186+0000","last_peered":"2024-04-20T21:21:15.860186+0000","last_clean":"2024-04-20T21:21:15.860186+0000","last_became_active":"2024-04-20T21:21:14.862733+0000","last_became_peered":"2024-04-20T21:21:14.862733+0000","last_unstale":"2024-04-20T21:21:15.860186+0000","last_undegraded":"2024-04-20T21:21:15.860186+0000","last_fullsized":"2024-04-20T21:21:15.860186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:17:18.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504152+0000","last_change":"2024-04-20T21:21:13.855388+0000","last_active":"2024-04-20T21:21:16.504152+0000","last_peered":"2024-04-20T21:21:16.504152+0000","last_clean":"2024-04-20T21:21:16.504152+0000","last_became_active":"2024-04-20T21:21:13.854344+0000","last_became_peered":"2024-04-20T21:21:13.854344+0000","last_unstale":"2024-04-20T21:21:16.504152+0000","last_undegraded":"2024-04-20T21:21:16.504152+0000","last_fullsized":"2024-04-20T21:21:16.504152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:51.996160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504191+0000","last_change":"2024-04-20T21:21:14.871059+0000","last_active":"2024-04-20T21:21:16.504191+0000","last_peered":"2024-04-20T21:21:16.504191+0000","last_clean":"2024-04-20T21:21:16.504191+0000","last_became_active":"2024-04-20T21:21:14.870705+0000","last_became_peered":"2024-04-20T21:21:14.870705+0000","last_unstale":"2024-04-20T21:21:16.504191+0000","last_undegraded":"2024-04-20T21:21:16.504191+0000","last_fullsized":"2024-04-20T21:21:16.504191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:26:03.453414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861562+0000","last_change":"2024-04-20T21:21:13.855754+0000","last_active":"2024-04-20T21:21:15.861562+0000","last_peered":"2024-04-20T21:21:15.861562+0000","last_clean":"2024-04-20T21:21:15.861562+0000","last_became_active":"2024-04-20T21:21:13.855416+0000","last_became_peered":"2024-04-20T21:21:13.855416+0000","last_unstale":"2024-04-20T21:21:15.861562+0000","last_undegraded":"2024-04-20T21:21:15.861562+0000","last_fullsized":"2024-04-20T21:21:15.861562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861349+0000","last_change":"2024-04-20T21:21:14.874492+0000","last_active":"2024-04-20T21:21:15.861349+0000","last_peered":"2024-04-20T21:21:15.861349+0000","last_clean":"2024-04-20T21:21:15.861349+0000","last_became_active":"2024-04-20T21:21:14.873871+0000","last_became_peered":"2024-04-20T21:21:14.873871+0000","last_unstale":"2024-04-20T21:21:15.861349+0000","last_undegraded":"2024-04-20T21:21:15.861349+0000","last_fullsized":"2024-04-20T21:21:15.861349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.668807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838936+0000","last_change":"2024-04-20T21:21:13.852987+0000","last_active":"2024-04-20T21:21:16.838936+0000","last_peered":"2024-04-20T21:21:16.838936+0000","last_clean":"2024-04-20T21:21:16.838936+0000","last_became_active":"2024-04-20T21:21:13.852708+0000","last_became_peered":"2024-04-20T21:21:13.852708+0000","last_unstale":"2024-04-20T21:21:16.838936+0000","last_undegraded":"2024-04-20T21:21:16.838936+0000","last_fullsized":"2024-04-20T21:21:16.838936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:58:55.889971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839441+0000","last_change":"2024-04-20T21:21:14.856563+0000","last_active":"2024-04-20T21:21:16.839441+0000","last_peered":"2024-04-20T21:21:16.839441+0000","last_clean":"2024-04-20T21:21:16.839441+0000","last_became_active":"2024-04-20T21:21:14.856248+0000","last_became_peered":"2024-04-20T21:21:14.856248+0000","last_unstale":"2024-04-20T21:21:16.839441+0000","last_undegraded":"2024-04-20T21:21:16.839441+0000","last_fullsized":"2024-04-20T21:21:16.839441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:23:43.018615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914745+0000","last_change":"2024-04-20T21:21:13.854000+0000","last_active":"2024-04-20T21:21:16.914745+0000","last_peered":"2024-04-20T21:21:16.914745+0000","last_clean":"2024-04-20T21:21:16.914745+0000","last_became_active":"2024-04-20T21:21:13.853604+0000","last_became_peered":"2024-04-20T21:21:13.853604+0000","last_unstale":"2024-04-20T21:21:16.914745+0000","last_undegraded":"2024-04-20T21:21:16.914745+0000","last_fullsized":"2024-04-20T21:21:16.914745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916862+0000","last_change":"2024-04-20T21:21:14.841984+0000","last_active":"2024-04-20T21:21:16.916862+0000","last_peered":"2024-04-20T21:21:16.916862+0000","last_clean":"2024-04-20T21:21:16.916862+0000","last_became_active":"2024-04-20T21:21:14.841641+0000","last_became_peered":"2024-04-20T21:21:14.841641+0000","last_unstale":"2024-04-20T21:21:16.916862+0000","last_undegraded":"2024-04-20T21:21:16.916862+0000","last_fullsized":"2024-04-20T21:21:16.916862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:35.242959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838605+0000","last_change":"2024-04-20T21:21:13.839573+0000","last_active":"2024-04-20T21:21:16.838605+0000","last_peered":"2024-04-20T21:21:16.838605+0000","last_clean":"2024-04-20T21:21:16.838605+0000","last_became_active":"2024-04-20T21:21:13.839221+0000","last_became_peered":"2024-04-20T21:21:13.839221+0000","last_unstale":"2024-04-20T21:21:16.838605+0000","last_undegraded":"2024-04-20T21:21:16.838605+0000","last_fullsized":"2024-04-20T21:21:16.838605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:06:13.391506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915084+0000","last_change":"2024-04-20T21:21:14.859655+0000","last_active":"2024-04-20T21:21:16.915084+0000","last_peered":"2024-04-20T21:21:16.915084+0000","last_clean":"2024-04-20T21:21:16.915084+0000","last_became_active":"2024-04-20T21:21:14.859340+0000","last_became_peered":"2024-04-20T21:21:14.859340+0000","last_unstale":"2024-04-20T21:21:16.915084+0000","last_undegraded":"2024-04-20T21:21:16.915084+0000","last_fullsized":"2024-04-20T21:21:16.915084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838594+0000","last_change":"2024-04-20T21:21:13.848527+0000","last_active":"2024-04-20T21:21:16.838594+0000","last_peered":"2024-04-20T21:21:16.838594+0000","last_clean":"2024-04-20T21:21:16.838594+0000","last_became_active":"2024-04-20T21:21:13.848170+0000","last_became_peered":"2024-04-20T21:21:13.848170+0000","last_unstale":"2024-04-20T21:21:16.838594+0000","last_undegraded":"2024-04-20T21:21:16.838594+0000","last_fullsized":"2024-04-20T21:21:16.838594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:55:51.845936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503657+0000","last_change":"2024-04-20T21:21:14.858608+0000","last_active":"2024-04-20T21:21:16.503657+0000","last_peered":"2024-04-20T21:21:16.503657+0000","last_clean":"2024-04-20T21:21:16.503657+0000","last_became_active":"2024-04-20T21:21:14.858254+0000","last_became_peered":"2024-04-20T21:21:14.858254+0000","last_unstale":"2024-04-20T21:21:16.503657+0000","last_undegraded":"2024-04-20T21:21:16.503657+0000","last_fullsized":"2024-04-20T21:21:16.503657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:29:28.575895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916746+0000","last_change":"2024-04-20T21:21:13.861471+0000","last_active":"2024-04-20T21:21:16.916746+0000","last_peered":"2024-04-20T21:21:16.916746+0000","last_clean":"2024-04-20T21:21:16.916746+0000","last_became_active":"2024-04-20T21:21:13.861170+0000","last_became_peered":"2024-04-20T21:21:13.861170+0000","last_unstale":"2024-04-20T21:21:16.916746+0000","last_undegraded":"2024-04-20T21:21:16.916746+0000","last_fullsized":"2024-04-20T21:21:16.916746+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:37.310861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859507+0000","last_change":"2024-04-20T21:21:14.864561+0000","last_active":"2024-04-20T21:21:15.859507+0000","last_peered":"2024-04-20T21:21:15.859507+0000","last_clean":"2024-04-20T21:21:15.859507+0000","last_became_active":"2024-04-20T21:21:14.861444+0000","last_became_peered":"2024-04-20T21:21:14.861444+0000","last_unstale":"2024-04-20T21:21:15.859507+0000","last_undegraded":"2024-04-20T21:21:15.859507+0000","last_fullsized":"2024-04-20T21:21:15.859507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:49:06.104703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838928+0000","last_change":"2024-04-20T21:21:13.838221+0000","last_active":"2024-04-20T21:21:16.838928+0000","last_peered":"2024-04-20T21:21:16.838928+0000","last_clean":"2024-04-20T21:21:16.838928+0000","last_became_active":"2024-04-20T21:21:13.837654+0000","last_became_peered":"2024-04-20T21:21:13.837654+0000","last_unstale":"2024-04-20T21:21:16.838928+0000","last_undegraded":"2024-04-20T21:21:16.838928+0000","last_fullsized":"2024-04-20T21:21:16.838928+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:23:34.226864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914778+0000","last_change":"2024-04-20T21:21:14.867009+0000","last_active":"2024-04-20T21:21:16.914778+0000","last_peered":"2024-04-20T21:21:16.914778+0000","last_clean":"2024-04-20T21:21:16.914778+0000","last_became_active":"2024-04-20T21:21:14.864737+0000","last_became_peered":"2024-04-20T21:21:14.864737+0000","last_unstale":"2024-04-20T21:21:16.914778+0000","last_undegraded":"2024-04-20T21:21:16.914778+0000","last_fullsized":"2024-04-20T21:21:16.914778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504416+0000","last_change":"2024-04-20T21:21:13.853633+0000","last_active":"2024-04-20T21:21:16.504416+0000","last_peered":"2024-04-20T21:21:16.504416+0000","last_clean":"2024-04-20T21:21:16.504416+0000","last_became_active":"2024-04-20T21:21:13.853333+0000","last_became_peered":"2024-04-20T21:21:13.853333+0000","last_unstale":"2024-04-20T21:21:16.504416+0000","last_undegraded":"2024-04-20T21:21:16.504416+0000","last_fullsized":"2024-04-20T21:21:16.504416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:54:34.947611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916949+0000","last_change":"2024-04-20T21:21:14.848001+0000","last_active":"2024-04-20T21:21:16.916949+0000","last_peered":"2024-04-20T21:21:16.916949+0000","last_clean":"2024-04-20T21:21:16.916949+0000","last_became_active":"2024-04-20T21:21:14.847002+0000","last_became_peered":"2024-04-20T21:21:14.847002+0000","last_unstale":"2024-04-20T21:21:16.916949+0000","last_undegraded":"2024-04-20T21:21:16.916949+0000","last_fullsized":"2024-04-20T21:21:16.916949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:59.360668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839148+0000","last_change":"2024-04-20T21:21:13.856053+0000","last_active":"2024-04-20T21:21:16.839148+0000","last_peered":"2024-04-20T21:21:16.839148+0000","last_clean":"2024-04-20T21:21:16.839148+0000","last_became_active":"2024-04-20T21:21:13.855739+0000","last_became_peered":"2024-04-20T21:21:13.855739+0000","last_unstale":"2024-04-20T21:21:16.839148+0000","last_undegraded":"2024-04-20T21:21:16.839148+0000","last_fullsized":"2024-04-20T21:21:16.839148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:50:02.925021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860241+0000","last_change":"2024-04-20T21:21:14.875179+0000","last_active":"2024-04-20T21:21:15.860241+0000","last_peered":"2024-04-20T21:21:15.860241+0000","last_clean":"2024-04-20T21:21:15.860241+0000","last_became_active":"2024-04-20T21:21:14.874815+0000","last_became_peered":"2024-04-20T21:21:14.874815+0000","last_unstale":"2024-04-20T21:21:15.860241+0000","last_undegraded":"2024-04-20T21:21:15.860241+0000","last_fullsized":"2024-04-20T21:21:15.860241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:44:49.884018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915471+0000","last_change":"2024-04-20T21:21:13.850690+0000","last_active":"2024-04-20T21:21:16.915471+0000","last_peered":"2024-04-20T21:21:16.915471+0000","last_clean":"2024-04-20T21:21:16.915471+0000","last_became_active":"2024-04-20T21:21:13.850378+0000","last_became_peered":"2024-04-20T21:21:13.850378+0000","last_unstale":"2024-04-20T21:21:16.915471+0000","last_undegraded":"2024-04-20T21:21:16.915471+0000","last_fullsized":"2024-04-20T21:21:16.915471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914702+0000","last_change":"2024-04-20T21:21:14.857308+0000","last_active":"2024-04-20T21:21:16.914702+0000","last_peered":"2024-04-20T21:21:16.914702+0000","last_clean":"2024-04-20T21:21:16.914702+0000","last_became_active":"2024-04-20T21:21:14.856877+0000","last_became_peered":"2024-04-20T21:21:14.856877+0000","last_unstale":"2024-04-20T21:21:16.914702+0000","last_undegraded":"2024-04-20T21:21:16.914702+0000","last_fullsized":"2024-04-20T21:21:16.914702+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915163+0000","last_change":"2024-04-20T21:21:13.857813+0000","last_active":"2024-04-20T21:21:16.915163+0000","last_peered":"2024-04-20T21:21:16.915163+0000","last_clean":"2024-04-20T21:21:16.915163+0000","last_became_active":"2024-04-20T21:21:13.857492+0000","last_became_peered":"2024-04-20T21:21:13.857492+0000","last_unstale":"2024-04-20T21:21:16.915163+0000","last_undegraded":"2024-04-20T21:21:16.915163+0000","last_fullsized":"2024-04-20T21:21:16.915163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914401+0000","last_change":"2024-04-20T21:21:14.860886+0000","last_active":"2024-04-20T21:21:16.914401+0000","last_peered":"2024-04-20T21:21:16.914401+0000","last_clean":"2024-04-20T21:21:16.914401+0000","last_became_active":"2024-04-20T21:21:14.852943+0000","last_became_peered":"2024-04-20T21:21:14.852943+0000","last_unstale":"2024-04-20T21:21:16.914401+0000","last_undegraded":"2024-04-20T21:21:16.914401+0000","last_fullsized":"2024-04-20T21:21:16.914401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:41:58.001860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859185+0000","last_change":"2024-04-20T21:21:13.853508+0000","last_active":"2024-04-20T21:21:15.859185+0000","last_peered":"2024-04-20T21:21:15.859185+0000","last_clean":"2024-04-20T21:21:15.859185+0000","last_became_active":"2024-04-20T21:21:13.852602+0000","last_became_peered":"2024-04-20T21:21:13.852602+0000","last_unstale":"2024-04-20T21:21:15.859185+0000","last_undegraded":"2024-04-20T21:21:15.859185+0000","last_fullsized":"2024-04-20T21:21:15.859185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:23:42.004403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861282+0000","last_change":"2024-04-20T21:21:14.872005+0000","last_active":"2024-04-20T21:21:15.861282+0000","last_peered":"2024-04-20T21:21:15.861282+0000","last_clean":"2024-04-20T21:21:15.861282+0000","last_became_active":"2024-04-20T21:21:14.871673+0000","last_became_peered":"2024-04-20T21:21:14.871673+0000","last_unstale":"2024-04-20T21:21:15.861282+0000","last_undegraded":"2024-04-20T21:21:15.861282+0000","last_fullsized":"2024-04-20T21:21:15.861282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:49:59.837058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860843+0000","last_change":"2024-04-20T21:21:13.850262+0000","last_active":"2024-04-20T21:21:15.860843+0000","last_peered":"2024-04-20T21:21:15.860843+0000","last_clean":"2024-04-20T21:21:15.860843+0000","last_became_active":"2024-04-20T21:21:13.848714+0000","last_became_peered":"2024-04-20T21:21:13.848714+0000","last_unstale":"2024-04-20T21:21:15.860843+0000","last_undegraded":"2024-04-20T21:21:15.860843+0000","last_fullsized":"2024-04-20T21:21:15.860843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917482+0000","last_change":"2024-04-20T21:21:14.842928+0000","last_active":"2024-04-20T21:21:16.917482+0000","last_peered":"2024-04-20T21:21:16.917482+0000","last_clean":"2024-04-20T21:21:16.917482+0000","last_became_active":"2024-04-20T21:21:14.842611+0000","last_became_peered":"2024-04-20T21:21:14.842611+0000","last_unstale":"2024-04-20T21:21:16.917482+0000","last_undegraded":"2024-04-20T21:21:16.917482+0000","last_fullsized":"2024-04-20T21:21:16.917482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:40.817426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859213+0000","last_change":"2024-04-20T21:21:13.844580+0000","last_active":"2024-04-20T21:21:15.859213+0000","last_peered":"2024-04-20T21:21:15.859213+0000","last_clean":"2024-04-20T21:21:15.859213+0000","last_became_active":"2024-04-20T21:21:13.844220+0000","last_became_peered":"2024-04-20T21:21:13.844220+0000","last_unstale":"2024-04-20T21:21:15.859213+0000","last_undegraded":"2024-04-20T21:21:15.859213+0000","last_fullsized":"2024-04-20T21:21:15.859213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:52.654595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504067+0000","last_change":"2024-04-20T21:21:14.860837+0000","last_active":"2024-04-20T21:21:16.504067+0000","last_peered":"2024-04-20T21:21:16.504067+0000","last_clean":"2024-04-20T21:21:16.504067+0000","last_became_active":"2024-04-20T21:21:14.860448+0000","last_became_peered":"2024-04-20T21:21:14.860448+0000","last_unstale":"2024-04-20T21:21:16.504067+0000","last_undegraded":"2024-04-20T21:21:16.504067+0000","last_fullsized":"2024-04-20T21:21:16.504067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:49:06.104703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917495+0000","last_change":"2024-04-20T21:21:13.860626+0000","last_active":"2024-04-20T21:21:16.917495+0000","last_peered":"2024-04-20T21:21:16.917495+0000","last_clean":"2024-04-20T21:21:16.917495+0000","last_became_active":"2024-04-20T21:21:13.860108+0000","last_became_peered":"2024-04-20T21:21:13.860108+0000","last_unstale":"2024-04-20T21:21:16.917495+0000","last_undegraded":"2024-04-20T21:21:16.917495+0000","last_fullsized":"2024-04-20T21:21:16.917495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916590+0000","last_change":"2024-04-20T21:19:19.292405+0000","last_active":"2024-04-20T21:21:16.916590+0000","last_peered":"2024-04-20T21:21:16.916590+0000","last_clean":"2024-04-20T21:21:16.916590+0000","last_became_active":"2024-04-20T21:19:19.290107+0000","last_became_peered":"2024-04-20T21:19:19.290107+0000","last_unstale":"2024-04-20T21:21:16.916590+0000","last_undegraded":"2024-04-20T21:21:16.916590+0000","last_fullsized":"2024-04-20T21:21:16.916590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_clean_scrub_stamp":"2024-04-20T21:19:18.230829+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:48:44.146278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":197439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":787729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T21:21:22.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:21:22.968 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:21:24.213 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T21:21:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.423+0000 7fedd3e00640 1 Processor -- start 2024-04-20T21:21:24.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.423+0000 7fedd3e00640 1 -- start start 2024-04-20T21:21:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedd3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fedd4159e10 0x7fedd4071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedd3e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fedd415a1f0 0x7fedd4071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedd3e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd415cc90 con 0x7fedd406da90 2024-04-20T21:21:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedd3e00640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fedd4072900 con 0x7fedd415a1f0 2024-04-20T21:21:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedd3e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fedd415ca40 con 0x7fedd4159e10 2024-04-20T21:21:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedcbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fedd415a1f0 0x7fedd4071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedcbe00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fedd415a1f0 0x7fedd4071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36454/0 (socket says 172.21.15.71:36454) 2024-04-20T21:21:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedcbe00640 1 -- 172.21.15.71:0/248854483 learned_addr learned my addr 172.21.15.71:0/248854483 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedcbe00640 1 -- 172.21.15.71:0/248854483 >> v2:172.21.15.137:3300/0 conn(0x7fedd4159e10 msgr2=0x7fedd4071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:24.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedcbe00640 1 --2- 172.21.15.71:0/248854483 >> v2:172.21.15.137:3300/0 conn(0x7fedd4159e10 0x7fedd4071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedcbe00640 1 -- 172.21.15.71:0/248854483 >> v1:172.21.15.137:6789/0 conn(0x7fedd406da90 legacy=0x7fedd4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:24.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.425+0000 7fedcbe00640 1 -- 172.21.15.71:0/248854483 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd415cf70 con 0x7fedd415a1f0 2024-04-20T21:21:24.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.426+0000 7fedcbe00640 1 --2- 172.21.15.71:0/248854483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd415a1f0 0x7fedd4071fc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fedd4073f30 tx=0x7fedbc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cb344c0881c30a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:24.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.427+0000 7fedd2000640 1 -- 172.21.15.71:0/248854483 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc035020 con 0x7fedd415a1f0 2024-04-20T21:21:24.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.427+0000 7fedd2000640 1 -- 172.21.15.71:0/248854483 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedbc031870 con 0x7fedd415a1f0 2024-04-20T21:21:24.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.427+0000 7fedd2000640 1 -- 172.21.15.71:0/248854483 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc031c40 con 0x7fedd415a1f0 2024-04-20T21:21:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.428+0000 7fedd3e00640 1 -- 172.21.15.71:0/248854483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd415a1f0 msgr2=0x7fedd4071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.428+0000 7fedd3e00640 1 --2- 172.21.15.71:0/248854483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd415a1f0 0x7fedd4071fc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fedd4073f30 tx=0x7fedbc02b910 comp rx=0 tx=0).stop 2024-04-20T21:21:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.428+0000 7fedd3e00640 1 -- 172.21.15.71:0/248854483 shutdown_connections 2024-04-20T21:21:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.428+0000 7fedd3e00640 1 --2- 172.21.15.71:0/248854483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd415a1f0 0x7fedd4071fc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.428+0000 7fedd3e00640 1 --2- 172.21.15.71:0/248854483 >> v2:172.21.15.137:3300/0 conn(0x7fedd4159e10 0x7fedd4071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.428+0000 7fedd3e00640 1 -- 172.21.15.71:0/248854483 >> 172.21.15.71:0/248854483 conn(0x7fedd40d0040 msgr2=0x7fedd40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.428+0000 7fedd3e00640 1 -- 172.21.15.71:0/248854483 shutdown_connections 2024-04-20T21:21:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.428+0000 7fedd3e00640 1 -- 172.21.15.71:0/248854483 wait complete. 2024-04-20T21:21:24.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.430+0000 7fedd3e00640 1 Processor -- start 2024-04-20T21:21:24.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.430+0000 7fedd3e00640 1 -- start start 2024-04-20T21:21:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.431+0000 7fedd3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd406da90 0x7fedd4154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.431+0000 7fedd3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fedd4159e10 0x7fedd4158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.431+0000 7fedd3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd415a1f0 0x7fedd415ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.431+0000 7fedd3e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fedd415d810 con 0x7fedd415a1f0 2024-04-20T21:21:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.431+0000 7fedd3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fedd415d530 con 0x7fedd406da90 2024-04-20T21:21:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.431+0000 7fedd3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fedd406b900 con 0x7fedd4159e10 2024-04-20T21:21:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.432+0000 7fedd3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd415a1f0 0x7fedd415ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.432+0000 7fedd3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd415a1f0 0x7fedd415ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36466/0 (socket says 172.21.15.71:36466) 2024-04-20T21:21:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.432+0000 7fedd3400640 1 -- 172.21.15.71:0/110140355 learned_addr learned my addr 172.21.15.71:0/110140355 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.432+0000 7fedcbe00640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fedd4159e10 0x7fedd4158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.432+0000 7fedd2a00640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd406da90 0x7fedd4154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.432+0000 7fedd3400640 1 -- 172.21.15.71:0/110140355 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fedd4159e10 msgr2=0x7fedd4158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.432+0000 7fedd3400640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fedd4159e10 0x7fedd4158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.432+0000 7fedd3400640 1 -- 172.21.15.71:0/110140355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd406da90 msgr2=0x7fedd4154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.432+0000 7fedd3400640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd406da90 0x7fedd4154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.432+0000 7fedd3400640 1 -- 172.21.15.71:0/110140355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd40b43e0 con 0x7fedd415a1f0 2024-04-20T21:21:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.433+0000 7fedd3400640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd415a1f0 0x7fedd415ff50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00c780 tx=0x7fedcc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:24.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.433+0000 7fedcaa00640 1 -- 172.21.15.71:0/110140355 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc017070 con 0x7fedd415a1f0 2024-04-20T21:21:24.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.433+0000 7fedcaa00640 1 -- 172.21.15.71:0/110140355 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc003da0 con 0x7fedd415a1f0 2024-04-20T21:21:24.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.433+0000 7fedd3e00640 1 -- 172.21.15.71:0/110140355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd40b46c0 con 0x7fedd415a1f0 2024-04-20T21:21:24.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.433+0000 7fedcaa00640 1 -- 172.21.15.71:0/110140355 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0052b0 con 0x7fedd415a1f0 2024-04-20T21:21:24.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.433+0000 7fedd3e00640 1 -- 172.21.15.71:0/110140355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd40b4c80 con 0x7fedd415a1f0 2024-04-20T21:21:24.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.434+0000 7fedd3e00640 1 -- 172.21.15.71:0/110140355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd406e170 con 0x7fedd415a1f0 2024-04-20T21:21:24.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.436+0000 7fedcaa00640 1 -- 172.21.15.71:0/110140355 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fedcc01a070 con 0x7fedd415a1f0 2024-04-20T21:21:24.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.436+0000 7fedcaa00640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb006c8f0 0x7fedb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.437+0000 7fedcaa00640 1 -- 172.21.15.71:0/110140355 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fedcc08b3c0 con 0x7fedd415a1f0 2024-04-20T21:21:24.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.437+0000 7fedd2a00640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb006c8f0 0x7fedb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.438+0000 7fedd2a00640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb006c8f0 0x7fedb006edb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009890 tx=0x7fedc4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:24.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.441+0000 7fedcaa00640 1 -- 172.21.15.71:0/110140355 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fedd406e170 con 0x7fedd415a1f0 2024-04-20T21:21:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.638+0000 7fedd3e00640 1 -- 172.21.15.71:0/110140355 --> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedd40ae5b0 con 0x7fedb006c8f0 2024-04-20T21:21:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.644+0000 7fedcaa00640 1 -- 172.21.15.71:0/110140355 <== mgr.4110 v2:172.21.15.71:6832/1511456036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251847 (secure 0 0 0) 0x7fedd40ae5b0 con 0x7fedb006c8f0 2024-04-20T21:21:24.647 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 -- 172.21.15.71:0/110140355 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb006c8f0 msgr2=0x7fedb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb006c8f0 0x7fedb006edb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009890 tx=0x7fedc4008040 comp rx=0 tx=0).stop 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 -- 172.21.15.71:0/110140355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd415a1f0 msgr2=0x7fedd415ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd415a1f0 0x7fedd415ff50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00c780 tx=0x7fedcc00cc40 comp rx=0 tx=0).stop 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 -- 172.21.15.71:0/110140355 shutdown_connections 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fedb006c8f0 0x7fedb006edb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedd415a1f0 0x7fedd415ff50 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fedd4159e10 0x7fedd4158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 --2- 172.21.15.71:0/110140355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd406da90 0x7fedd4154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 -- 172.21.15.71:0/110140355 >> 172.21.15.71:0/110140355 conn(0x7fedd40d0040 msgr2=0x7fedd41553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 -- 172.21.15.71:0/110140355 shutdown_connections 2024-04-20T21:21:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.651+0000 7fedd3e00640 1 -- 172.21.15.71:0/110140355 wait complete. 2024-04-20T21:21:24.669 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-04-20T21:21:23.834806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225068,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749652,"statfs":{"total":773094113280,"available":772863643648,"internally_reserved":0,"allocated":4857856,"data_stored":2764172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.009276"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860618+0000","last_change":"2024-04-20T21:21:14.863803+0000","last_active":"2024-04-20T21:21:15.860618+0000","last_peered":"2024-04-20T21:21:15.860618+0000","last_clean":"2024-04-20T21:21:15.860618+0000","last_became_active":"2024-04-20T21:21:14.863473+0000","last_became_peered":"2024-04-20T21:21:14.863473+0000","last_unstale":"2024-04-20T21:21:15.860618+0000","last_undegraded":"2024-04-20T21:21:15.860618+0000","last_fullsized":"2024-04-20T21:21:15.860618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:50:41.067836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859945+0000","last_change":"2024-04-20T21:21:14.864597+0000","last_active":"2024-04-20T21:21:15.859945+0000","last_peered":"2024-04-20T21:21:15.859945+0000","last_clean":"2024-04-20T21:21:15.859945+0000","last_became_active":"2024-04-20T21:21:14.864276+0000","last_became_peered":"2024-04-20T21:21:14.864276+0000","last_unstale":"2024-04-20T21:21:15.859945+0000","last_undegraded":"2024-04-20T21:21:15.859945+0000","last_fullsized":"2024-04-20T21:21:15.859945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:58:00.847169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915723+0000","last_change":"2024-04-20T21:21:14.858339+0000","last_active":"2024-04-20T21:21:16.915723+0000","last_peered":"2024-04-20T21:21:16.915723+0000","last_clean":"2024-04-20T21:21:16.915723+0000","last_became_active":"2024-04-20T21:21:14.857837+0000","last_became_peered":"2024-04-20T21:21:14.857837+0000","last_unstale":"2024-04-20T21:21:16.915723+0000","last_undegraded":"2024-04-20T21:21:16.915723+0000","last_fullsized":"2024-04-20T21:21:16.915723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:32.387656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839497+0000","last_change":"2024-04-20T21:21:14.873437+0000","last_active":"2024-04-20T21:21:16.839497+0000","last_peered":"2024-04-20T21:21:16.839497+0000","last_clean":"2024-04-20T21:21:16.839497+0000","last_became_active":"2024-04-20T21:21:14.873135+0000","last_became_peered":"2024-04-20T21:21:14.873135+0000","last_unstale":"2024-04-20T21:21:16.839497+0000","last_undegraded":"2024-04-20T21:21:16.839497+0000","last_fullsized":"2024-04-20T21:21:16.839497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:22.233137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838996+0000","last_change":"2024-04-20T21:21:14.870377+0000","last_active":"2024-04-20T21:21:16.838996+0000","last_peered":"2024-04-20T21:21:16.838996+0000","last_clean":"2024-04-20T21:21:16.838996+0000","last_became_active":"2024-04-20T21:21:14.868821+0000","last_became_peered":"2024-04-20T21:21:14.868821+0000","last_unstale":"2024-04-20T21:21:16.838996+0000","last_undegraded":"2024-04-20T21:21:16.838996+0000","last_fullsized":"2024-04-20T21:21:16.838996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:16:39.973000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914434+0000","last_change":"2024-04-20T21:21:14.868104+0000","last_active":"2024-04-20T21:21:16.914434+0000","last_peered":"2024-04-20T21:21:16.914434+0000","last_clean":"2024-04-20T21:21:16.914434+0000","last_became_active":"2024-04-20T21:21:14.867046+0000","last_became_peered":"2024-04-20T21:21:14.867046+0000","last_unstale":"2024-04-20T21:21:16.914434+0000","last_undegraded":"2024-04-20T21:21:16.914434+0000","last_fullsized":"2024-04-20T21:21:16.914434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:49:59.837058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503929+0000","last_change":"2024-04-20T21:21:14.862506+0000","last_active":"2024-04-20T21:21:16.503929+0000","last_peered":"2024-04-20T21:21:16.503929+0000","last_clean":"2024-04-20T21:21:16.503929+0000","last_became_active":"2024-04-20T21:21:14.862025+0000","last_became_peered":"2024-04-20T21:21:14.862025+0000","last_unstale":"2024-04-20T21:21:16.503929+0000","last_undegraded":"2024-04-20T21:21:16.503929+0000","last_fullsized":"2024-04-20T21:21:16.503929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:27:54.200655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859531+0000","last_change":"2024-04-20T21:21:14.858707+0000","last_active":"2024-04-20T21:21:15.859531+0000","last_peered":"2024-04-20T21:21:15.859531+0000","last_clean":"2024-04-20T21:21:15.859531+0000","last_became_active":"2024-04-20T21:21:14.858433+0000","last_became_peered":"2024-04-20T21:21:14.858433+0000","last_unstale":"2024-04-20T21:21:15.859531+0000","last_undegraded":"2024-04-20T21:21:15.859531+0000","last_fullsized":"2024-04-20T21:21:15.859531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:26:03.453414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915812+0000","last_change":"2024-04-20T21:21:14.859567+0000","last_active":"2024-04-20T21:21:16.915812+0000","last_peered":"2024-04-20T21:21:16.915812+0000","last_clean":"2024-04-20T21:21:16.915812+0000","last_became_active":"2024-04-20T21:21:14.859157+0000","last_became_peered":"2024-04-20T21:21:14.859157+0000","last_unstale":"2024-04-20T21:21:16.915812+0000","last_undegraded":"2024-04-20T21:21:16.915812+0000","last_fullsized":"2024-04-20T21:21:16.915812+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:14:09.298044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503997+0000","last_change":"2024-04-20T21:21:14.857630+0000","last_active":"2024-04-20T21:21:16.503997+0000","last_peered":"2024-04-20T21:21:16.503997+0000","last_clean":"2024-04-20T21:21:16.503997+0000","last_became_active":"2024-04-20T21:21:14.857269+0000","last_became_peered":"2024-04-20T21:21:14.857269+0000","last_unstale":"2024-04-20T21:21:16.503997+0000","last_undegraded":"2024-04-20T21:21:16.503997+0000","last_fullsized":"2024-04-20T21:21:16.503997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:57:59.730923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504353+0000","last_change":"2024-04-20T21:21:14.871863+0000","last_active":"2024-04-20T21:21:16.504353+0000","last_peered":"2024-04-20T21:21:16.504353+0000","last_clean":"2024-04-20T21:21:16.504353+0000","last_became_active":"2024-04-20T21:21:14.871546+0000","last_became_peered":"2024-04-20T21:21:14.871546+0000","last_unstale":"2024-04-20T21:21:16.504353+0000","last_undegraded":"2024-04-20T21:21:16.504353+0000","last_fullsized":"2024-04-20T21:21:16.504353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:36.325484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915472+0000","last_change":"2024-04-20T21:21:14.864901+0000","last_active":"2024-04-20T21:21:16.915472+0000","last_peered":"2024-04-20T21:21:16.915472+0000","last_clean":"2024-04-20T21:21:16.915472+0000","last_became_active":"2024-04-20T21:21:14.862268+0000","last_became_peered":"2024-04-20T21:21:14.862268+0000","last_unstale":"2024-04-20T21:21:16.915472+0000","last_undegraded":"2024-04-20T21:21:16.915472+0000","last_fullsized":"2024-04-20T21:21:16.915472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:35.242959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503693+0000","last_change":"2024-04-20T21:21:14.857737+0000","last_active":"2024-04-20T21:21:16.503693+0000","last_peered":"2024-04-20T21:21:16.503693+0000","last_clean":"2024-04-20T21:21:16.503693+0000","last_became_active":"2024-04-20T21:21:14.857431+0000","last_became_peered":"2024-04-20T21:21:14.857431+0000","last_unstale":"2024-04-20T21:21:16.503693+0000","last_undegraded":"2024-04-20T21:21:16.503693+0000","last_fullsized":"2024-04-20T21:21:16.503693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:38:16.941267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861488+0000","last_change":"2024-04-20T21:21:14.875694+0000","last_active":"2024-04-20T21:21:15.861488+0000","last_peered":"2024-04-20T21:21:15.861488+0000","last_clean":"2024-04-20T21:21:15.861488+0000","last_became_active":"2024-04-20T21:21:14.875399+0000","last_became_peered":"2024-04-20T21:21:14.875399+0000","last_unstale":"2024-04-20T21:21:15.861488+0000","last_undegraded":"2024-04-20T21:21:15.861488+0000","last_fullsized":"2024-04-20T21:21:15.861488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503292+0000","last_change":"2024-04-20T21:21:14.858950+0000","last_active":"2024-04-20T21:21:16.503292+0000","last_peered":"2024-04-20T21:21:16.503292+0000","last_clean":"2024-04-20T21:21:16.503292+0000","last_became_active":"2024-04-20T21:21:14.858606+0000","last_became_peered":"2024-04-20T21:21:14.858606+0000","last_unstale":"2024-04-20T21:21:16.503292+0000","last_undegraded":"2024-04-20T21:21:16.503292+0000","last_fullsized":"2024-04-20T21:21:16.503292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:14:09.298044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916349+0000","last_change":"2024-04-20T21:21:14.855465+0000","last_active":"2024-04-20T21:21:16.916349+0000","last_peered":"2024-04-20T21:21:16.916349+0000","last_clean":"2024-04-20T21:21:16.916349+0000","last_became_active":"2024-04-20T21:21:14.855172+0000","last_became_peered":"2024-04-20T21:21:14.855172+0000","last_unstale":"2024-04-20T21:21:16.916349+0000","last_undegraded":"2024-04-20T21:21:16.916349+0000","last_fullsized":"2024-04-20T21:21:16.916349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917453+0000","last_change":"2024-04-20T21:21:14.860920+0000","last_active":"2024-04-20T21:21:16.917453+0000","last_peered":"2024-04-20T21:21:16.917453+0000","last_clean":"2024-04-20T21:21:16.917453+0000","last_became_active":"2024-04-20T21:21:14.856351+0000","last_became_peered":"2024-04-20T21:21:14.856351+0000","last_unstale":"2024-04-20T21:21:16.917453+0000","last_undegraded":"2024-04-20T21:21:16.917453+0000","last_fullsized":"2024-04-20T21:21:16.917453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:29:28.575895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860277+0000","last_change":"2024-04-20T21:21:14.877013+0000","last_active":"2024-04-20T21:21:15.860277+0000","last_peered":"2024-04-20T21:21:15.860277+0000","last_clean":"2024-04-20T21:21:15.860277+0000","last_became_active":"2024-04-20T21:21:14.876706+0000","last_became_peered":"2024-04-20T21:21:14.876706+0000","last_unstale":"2024-04-20T21:21:15.860277+0000","last_undegraded":"2024-04-20T21:21:15.860277+0000","last_fullsized":"2024-04-20T21:21:15.860277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:43.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839085+0000","last_change":"2024-04-20T21:21:14.856777+0000","last_active":"2024-04-20T21:21:16.839085+0000","last_peered":"2024-04-20T21:21:16.839085+0000","last_clean":"2024-04-20T21:21:16.839085+0000","last_became_active":"2024-04-20T21:21:14.855452+0000","last_became_peered":"2024-04-20T21:21:14.855452+0000","last_unstale":"2024-04-20T21:21:16.839085+0000","last_undegraded":"2024-04-20T21:21:16.839085+0000","last_fullsized":"2024-04-20T21:21:16.839085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:37:17.281450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860213+0000","last_change":"2024-04-20T21:21:14.866614+0000","last_active":"2024-04-20T21:21:15.860213+0000","last_peered":"2024-04-20T21:21:15.860213+0000","last_clean":"2024-04-20T21:21:15.860213+0000","last_became_active":"2024-04-20T21:21:14.866140+0000","last_became_peered":"2024-04-20T21:21:14.866140+0000","last_unstale":"2024-04-20T21:21:15.860213+0000","last_undegraded":"2024-04-20T21:21:15.860213+0000","last_fullsized":"2024-04-20T21:21:15.860213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:23.573740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503678+0000","last_change":"2024-04-20T21:21:14.854745+0000","last_active":"2024-04-20T21:21:16.503678+0000","last_peered":"2024-04-20T21:21:16.503678+0000","last_clean":"2024-04-20T21:21:16.503678+0000","last_became_active":"2024-04-20T21:21:14.854464+0000","last_became_peered":"2024-04-20T21:21:14.854464+0000","last_unstale":"2024-04-20T21:21:16.503678+0000","last_undegraded":"2024-04-20T21:21:16.503678+0000","last_fullsized":"2024-04-20T21:21:16.503678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:40.817426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.862002+0000","last_change":"2024-04-20T21:21:14.872869+0000","last_active":"2024-04-20T21:21:15.862002+0000","last_peered":"2024-04-20T21:21:15.862002+0000","last_clean":"2024-04-20T21:21:15.862002+0000","last_became_active":"2024-04-20T21:21:14.872631+0000","last_became_peered":"2024-04-20T21:21:14.872631+0000","last_unstale":"2024-04-20T21:21:15.862002+0000","last_undegraded":"2024-04-20T21:21:15.862002+0000","last_fullsized":"2024-04-20T21:21:15.862002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:59.360668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916591+0000","last_change":"2024-04-20T21:21:14.842819+0000","last_active":"2024-04-20T21:21:16.916591+0000","last_peered":"2024-04-20T21:21:16.916591+0000","last_clean":"2024-04-20T21:21:16.916591+0000","last_became_active":"2024-04-20T21:21:14.842168+0000","last_became_peered":"2024-04-20T21:21:14.842168+0000","last_unstale":"2024-04-20T21:21:16.916591+0000","last_undegraded":"2024-04-20T21:21:16.916591+0000","last_fullsized":"2024-04-20T21:21:16.916591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839206+0000","last_change":"2024-04-20T21:21:14.842239+0000","last_active":"2024-04-20T21:21:16.839206+0000","last_peered":"2024-04-20T21:21:16.839206+0000","last_clean":"2024-04-20T21:21:16.839206+0000","last_became_active":"2024-04-20T21:21:14.841546+0000","last_became_peered":"2024-04-20T21:21:14.841546+0000","last_unstale":"2024-04-20T21:21:16.839206+0000","last_undegraded":"2024-04-20T21:21:16.839206+0000","last_fullsized":"2024-04-20T21:21:16.839206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:44:47.858452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860663+0000","last_change":"2024-04-20T21:21:14.862627+0000","last_active":"2024-04-20T21:21:15.860663+0000","last_peered":"2024-04-20T21:21:15.860663+0000","last_clean":"2024-04-20T21:21:15.860663+0000","last_became_active":"2024-04-20T21:21:14.862348+0000","last_became_peered":"2024-04-20T21:21:14.862348+0000","last_unstale":"2024-04-20T21:21:15.860663+0000","last_undegraded":"2024-04-20T21:21:15.860663+0000","last_fullsized":"2024-04-20T21:21:15.860663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:54:35.961822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914999+0000","last_change":"2024-04-20T21:21:14.869769+0000","last_active":"2024-04-20T21:21:16.914999+0000","last_peered":"2024-04-20T21:21:16.914999+0000","last_clean":"2024-04-20T21:21:16.914999+0000","last_became_active":"2024-04-20T21:21:14.869490+0000","last_became_peered":"2024-04-20T21:21:14.869490+0000","last_unstale":"2024-04-20T21:21:16.914999+0000","last_undegraded":"2024-04-20T21:21:16.914999+0000","last_fullsized":"2024-04-20T21:21:16.914999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860445+0000","last_change":"2024-04-20T21:21:14.846180+0000","last_active":"2024-04-20T21:21:15.860445+0000","last_peered":"2024-04-20T21:21:15.860445+0000","last_clean":"2024-04-20T21:21:15.860445+0000","last_became_active":"2024-04-20T21:21:14.845844+0000","last_became_peered":"2024-04-20T21:21:14.845844+0000","last_unstale":"2024-04-20T21:21:15.860445+0000","last_undegraded":"2024-04-20T21:21:15.860445+0000","last_fullsized":"2024-04-20T21:21:15.860445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:53.010372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504643+0000","last_change":"2024-04-20T21:21:14.856442+0000","last_active":"2024-04-20T21:21:16.504643+0000","last_peered":"2024-04-20T21:21:16.504643+0000","last_clean":"2024-04-20T21:21:16.504643+0000","last_became_active":"2024-04-20T21:21:14.856130+0000","last_became_peered":"2024-04-20T21:21:14.856130+0000","last_unstale":"2024-04-20T21:21:16.504643+0000","last_undegraded":"2024-04-20T21:21:16.504643+0000","last_fullsized":"2024-04-20T21:21:16.504643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:37:09.139008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859956+0000","last_change":"2024-04-20T21:21:14.857158+0000","last_active":"2024-04-20T21:21:15.859956+0000","last_peered":"2024-04-20T21:21:15.859956+0000","last_clean":"2024-04-20T21:21:15.859956+0000","last_became_active":"2024-04-20T21:21:14.852988+0000","last_became_peered":"2024-04-20T21:21:14.852988+0000","last_unstale":"2024-04-20T21:21:15.859956+0000","last_undegraded":"2024-04-20T21:21:15.859956+0000","last_fullsized":"2024-04-20T21:21:15.859956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:38.325073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859521+0000","last_change":"2024-04-20T21:21:14.855153+0000","last_active":"2024-04-20T21:21:15.859521+0000","last_peered":"2024-04-20T21:21:15.859521+0000","last_clean":"2024-04-20T21:21:15.859521+0000","last_became_active":"2024-04-20T21:21:14.854858+0000","last_became_peered":"2024-04-20T21:21:14.854858+0000","last_unstale":"2024-04-20T21:21:15.859521+0000","last_undegraded":"2024-04-20T21:21:15.859521+0000","last_fullsized":"2024-04-20T21:21:15.859521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:10:30.105415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916765+0000","last_change":"2024-04-20T21:21:14.844379+0000","last_active":"2024-04-20T21:21:16.916765+0000","last_peered":"2024-04-20T21:21:16.916765+0000","last_clean":"2024-04-20T21:21:16.916765+0000","last_became_active":"2024-04-20T21:21:14.840709+0000","last_became_peered":"2024-04-20T21:21:14.840709+0000","last_unstale":"2024-04-20T21:21:16.916765+0000","last_undegraded":"2024-04-20T21:21:16.916765+0000","last_fullsized":"2024-04-20T21:21:16.916765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914616+0000","last_change":"2024-04-20T21:21:14.849087+0000","last_active":"2024-04-20T21:21:16.914616+0000","last_peered":"2024-04-20T21:21:16.914616+0000","last_clean":"2024-04-20T21:21:16.914616+0000","last_became_active":"2024-04-20T21:21:14.848753+0000","last_became_peered":"2024-04-20T21:21:14.848753+0000","last_unstale":"2024-04-20T21:21:16.914616+0000","last_undegraded":"2024-04-20T21:21:16.914616+0000","last_fullsized":"2024-04-20T21:21:16.914616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.668807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917355+0000","last_change":"2024-04-20T21:21:14.854607+0000","last_active":"2024-04-20T21:21:16.917355+0000","last_peered":"2024-04-20T21:21:16.917355+0000","last_clean":"2024-04-20T21:21:16.917355+0000","last_became_active":"2024-04-20T21:21:14.854334+0000","last_became_peered":"2024-04-20T21:21:14.854334+0000","last_unstale":"2024-04-20T21:21:16.917355+0000","last_undegraded":"2024-04-20T21:21:16.917355+0000","last_fullsized":"2024-04-20T21:21:16.917355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:14:09.298044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860470+0000","last_change":"2024-04-20T21:21:13.854943+0000","last_active":"2024-04-20T21:21:15.860470+0000","last_peered":"2024-04-20T21:21:15.860470+0000","last_clean":"2024-04-20T21:21:15.860470+0000","last_became_active":"2024-04-20T21:21:13.852987+0000","last_became_peered":"2024-04-20T21:21:13.852987+0000","last_unstale":"2024-04-20T21:21:15.860470+0000","last_undegraded":"2024-04-20T21:21:15.860470+0000","last_fullsized":"2024-04-20T21:21:15.860470+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:45:20.432399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915087+0000","last_change":"2024-04-20T21:21:14.865422+0000","last_active":"2024-04-20T21:21:16.915087+0000","last_peered":"2024-04-20T21:21:16.915087+0000","last_clean":"2024-04-20T21:21:16.915087+0000","last_became_active":"2024-04-20T21:21:14.865033+0000","last_became_peered":"2024-04-20T21:21:14.865033+0000","last_unstale":"2024-04-20T21:21:16.915087+0000","last_undegraded":"2024-04-20T21:21:16.915087+0000","last_fullsized":"2024-04-20T21:21:16.915087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915666+0000","last_change":"2024-04-20T21:21:13.852552+0000","last_active":"2024-04-20T21:21:16.915666+0000","last_peered":"2024-04-20T21:21:16.915666+0000","last_clean":"2024-04-20T21:21:16.915666+0000","last_became_active":"2024-04-20T21:21:13.852231+0000","last_became_peered":"2024-04-20T21:21:13.852231+0000","last_unstale":"2024-04-20T21:21:16.915666+0000","last_undegraded":"2024-04-20T21:21:16.915666+0000","last_fullsized":"2024-04-20T21:21:16.915666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:51.996160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861499+0000","last_change":"2024-04-20T21:21:14.874272+0000","last_active":"2024-04-20T21:21:15.861499+0000","last_peered":"2024-04-20T21:21:15.861499+0000","last_clean":"2024-04-20T21:21:15.861499+0000","last_became_active":"2024-04-20T21:21:14.873628+0000","last_became_peered":"2024-04-20T21:21:14.873628+0000","last_unstale":"2024-04-20T21:21:15.861499+0000","last_undegraded":"2024-04-20T21:21:15.861499+0000","last_fullsized":"2024-04-20T21:21:15.861499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915232+0000","last_change":"2024-04-20T21:21:13.854104+0000","last_active":"2024-04-20T21:21:16.915232+0000","last_peered":"2024-04-20T21:21:16.915232+0000","last_clean":"2024-04-20T21:21:16.915232+0000","last_became_active":"2024-04-20T21:21:13.853806+0000","last_became_peered":"2024-04-20T21:21:13.853806+0000","last_unstale":"2024-04-20T21:21:16.915232+0000","last_undegraded":"2024-04-20T21:21:16.915232+0000","last_fullsized":"2024-04-20T21:21:16.915232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:54:34.947611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860373+0000","last_change":"2024-04-20T21:21:14.866651+0000","last_active":"2024-04-20T21:21:15.860373+0000","last_peered":"2024-04-20T21:21:15.860373+0000","last_clean":"2024-04-20T21:21:15.860373+0000","last_became_active":"2024-04-20T21:21:14.866366+0000","last_became_peered":"2024-04-20T21:21:14.866366+0000","last_unstale":"2024-04-20T21:21:15.860373+0000","last_undegraded":"2024-04-20T21:21:15.860373+0000","last_fullsized":"2024-04-20T21:21:15.860373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:22:40.054174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861432+0000","last_change":"2024-04-20T21:21:13.850583+0000","last_active":"2024-04-20T21:21:15.861432+0000","last_peered":"2024-04-20T21:21:15.861432+0000","last_clean":"2024-04-20T21:21:15.861432+0000","last_became_active":"2024-04-20T21:21:13.850278+0000","last_became_peered":"2024-04-20T21:21:13.850278+0000","last_unstale":"2024-04-20T21:21:15.861432+0000","last_undegraded":"2024-04-20T21:21:15.861432+0000","last_fullsized":"2024-04-20T21:21:15.861432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:37.310861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914402+0000","last_change":"2024-04-20T21:21:14.859125+0000","last_active":"2024-04-20T21:21:16.914402+0000","last_peered":"2024-04-20T21:21:16.914402+0000","last_clean":"2024-04-20T21:21:16.914402+0000","last_became_active":"2024-04-20T21:21:14.857373+0000","last_became_peered":"2024-04-20T21:21:14.857373+0000","last_unstale":"2024-04-20T21:21:16.914402+0000","last_undegraded":"2024-04-20T21:21:16.914402+0000","last_fullsized":"2024-04-20T21:21:16.914402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.668807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503824+0000","last_change":"2024-04-20T21:21:13.853816+0000","last_active":"2024-04-20T21:21:16.503824+0000","last_peered":"2024-04-20T21:21:16.503824+0000","last_clean":"2024-04-20T21:21:16.503824+0000","last_became_active":"2024-04-20T21:21:13.853491+0000","last_became_peered":"2024-04-20T21:21:13.853491+0000","last_unstale":"2024-04-20T21:21:16.503824+0000","last_undegraded":"2024-04-20T21:21:16.503824+0000","last_fullsized":"2024-04-20T21:21:16.503824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:20:31.052941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503862+0000","last_change":"2024-04-20T21:21:14.872207+0000","last_active":"2024-04-20T21:21:16.503862+0000","last_peered":"2024-04-20T21:21:16.503862+0000","last_clean":"2024-04-20T21:21:16.503862+0000","last_became_active":"2024-04-20T21:21:14.870765+0000","last_became_peered":"2024-04-20T21:21:14.870765+0000","last_unstale":"2024-04-20T21:21:16.503862+0000","last_undegraded":"2024-04-20T21:21:16.503862+0000","last_fullsized":"2024-04-20T21:21:16.503862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:53:23.267234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917102+0000","last_change":"2024-04-20T21:21:13.859366+0000","last_active":"2024-04-20T21:21:16.917102+0000","last_peered":"2024-04-20T21:21:16.917102+0000","last_clean":"2024-04-20T21:21:16.917102+0000","last_became_active":"2024-04-20T21:21:13.858946+0000","last_became_peered":"2024-04-20T21:21:13.858946+0000","last_unstale":"2024-04-20T21:21:16.917102+0000","last_undegraded":"2024-04-20T21:21:16.917102+0000","last_fullsized":"2024-04-20T21:21:16.917102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:10:29.091204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861999+0000","last_change":"2024-04-20T21:21:14.874893+0000","last_active":"2024-04-20T21:21:15.861999+0000","last_peered":"2024-04-20T21:21:15.861999+0000","last_clean":"2024-04-20T21:21:15.861999+0000","last_became_active":"2024-04-20T21:21:14.874544+0000","last_became_peered":"2024-04-20T21:21:14.874544+0000","last_unstale":"2024-04-20T21:21:15.861999+0000","last_undegraded":"2024-04-20T21:21:15.861999+0000","last_fullsized":"2024-04-20T21:21:15.861999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:35.242959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914466+0000","last_change":"2024-04-20T21:21:13.850618+0000","last_active":"2024-04-20T21:21:16.914466+0000","last_peered":"2024-04-20T21:21:16.914466+0000","last_clean":"2024-04-20T21:21:16.914466+0000","last_became_active":"2024-04-20T21:21:13.850356+0000","last_became_peered":"2024-04-20T21:21:13.850356+0000","last_unstale":"2024-04-20T21:21:16.914466+0000","last_undegraded":"2024-04-20T21:21:16.914466+0000","last_fullsized":"2024-04-20T21:21:16.914466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:37.310861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859548+0000","last_change":"2024-04-20T21:21:14.864327+0000","last_active":"2024-04-20T21:21:15.859548+0000","last_peered":"2024-04-20T21:21:15.859548+0000","last_clean":"2024-04-20T21:21:15.859548+0000","last_became_active":"2024-04-20T21:21:14.861546+0000","last_became_peered":"2024-04-20T21:21:14.861546+0000","last_unstale":"2024-04-20T21:21:15.859548+0000","last_undegraded":"2024-04-20T21:21:15.859548+0000","last_fullsized":"2024-04-20T21:21:15.859548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:36.325484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860658+0000","last_change":"2024-04-20T21:21:13.859332+0000","last_active":"2024-04-20T21:21:15.860658+0000","last_peered":"2024-04-20T21:21:15.860658+0000","last_clean":"2024-04-20T21:21:15.860658+0000","last_became_active":"2024-04-20T21:21:13.858593+0000","last_became_peered":"2024-04-20T21:21:13.858593+0000","last_unstale":"2024-04-20T21:21:15.860658+0000","last_undegraded":"2024-04-20T21:21:15.860658+0000","last_fullsized":"2024-04-20T21:21:15.860658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:51.996160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839694+0000","last_change":"2024-04-20T21:21:14.867091+0000","last_active":"2024-04-20T21:21:16.839694+0000","last_peered":"2024-04-20T21:21:16.839694+0000","last_clean":"2024-04-20T21:21:16.839694+0000","last_became_active":"2024-04-20T21:21:14.866832+0000","last_became_peered":"2024-04-20T21:21:14.866832+0000","last_unstale":"2024-04-20T21:21:16.839694+0000","last_undegraded":"2024-04-20T21:21:16.839694+0000","last_fullsized":"2024-04-20T21:21:16.839694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:45:21.446611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860424+0000","last_change":"2024-04-20T21:21:13.846256+0000","last_active":"2024-04-20T21:21:15.860424+0000","last_peered":"2024-04-20T21:21:15.860424+0000","last_clean":"2024-04-20T21:21:15.860424+0000","last_became_active":"2024-04-20T21:21:13.845720+0000","last_became_peered":"2024-04-20T21:21:13.845720+0000","last_unstale":"2024-04-20T21:21:15.860424+0000","last_undegraded":"2024-04-20T21:21:15.860424+0000","last_fullsized":"2024-04-20T21:21:15.860424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:27.895382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916985+0000","last_change":"2024-04-20T21:21:14.848212+0000","last_active":"2024-04-20T21:21:16.916985+0000","last_peered":"2024-04-20T21:21:16.916985+0000","last_clean":"2024-04-20T21:21:16.916985+0000","last_became_active":"2024-04-20T21:21:14.847460+0000","last_became_peered":"2024-04-20T21:21:14.847460+0000","last_unstale":"2024-04-20T21:21:16.916985+0000","last_undegraded":"2024-04-20T21:21:16.916985+0000","last_fullsized":"2024-04-20T21:21:16.916985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:32.387656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504325+0000","last_change":"2024-04-20T21:21:13.854168+0000","last_active":"2024-04-20T21:21:16.504325+0000","last_peered":"2024-04-20T21:21:16.504325+0000","last_clean":"2024-04-20T21:21:16.504325+0000","last_became_active":"2024-04-20T21:21:13.853371+0000","last_became_peered":"2024-04-20T21:21:13.853371+0000","last_unstale":"2024-04-20T21:21:16.504325+0000","last_undegraded":"2024-04-20T21:21:16.504325+0000","last_fullsized":"2024-04-20T21:21:16.504325+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:24:02.233206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915592+0000","last_change":"2024-04-20T21:21:14.858943+0000","last_active":"2024-04-20T21:21:16.915592+0000","last_peered":"2024-04-20T21:21:16.915592+0000","last_clean":"2024-04-20T21:21:16.915592+0000","last_became_active":"2024-04-20T21:21:14.858687+0000","last_became_peered":"2024-04-20T21:21:14.858687+0000","last_unstale":"2024-04-20T21:21:16.915592+0000","last_undegraded":"2024-04-20T21:21:16.915592+0000","last_fullsized":"2024-04-20T21:21:16.915592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:59.360668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504340+0000","last_change":"2024-04-20T21:21:13.852073+0000","last_active":"2024-04-20T21:21:16.504340+0000","last_peered":"2024-04-20T21:21:16.504340+0000","last_clean":"2024-04-20T21:21:16.504340+0000","last_became_active":"2024-04-20T21:21:13.851166+0000","last_became_peered":"2024-04-20T21:21:13.851166+0000","last_unstale":"2024-04-20T21:21:16.504340+0000","last_undegraded":"2024-04-20T21:21:16.504340+0000","last_fullsized":"2024-04-20T21:21:16.504340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861772+0000","last_change":"2024-04-20T21:21:14.873140+0000","last_active":"2024-04-20T21:21:15.861772+0000","last_peered":"2024-04-20T21:21:15.861772+0000","last_clean":"2024-04-20T21:21:15.861772+0000","last_became_active":"2024-04-20T21:21:14.872806+0000","last_became_peered":"2024-04-20T21:21:14.872806+0000","last_unstale":"2024-04-20T21:21:15.861772+0000","last_undegraded":"2024-04-20T21:21:15.861772+0000","last_fullsized":"2024-04-20T21:21:15.861772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859906+0000","last_change":"2024-04-20T21:21:13.854623+0000","last_active":"2024-04-20T21:21:15.859906+0000","last_peered":"2024-04-20T21:21:15.859906+0000","last_clean":"2024-04-20T21:21:15.859906+0000","last_became_active":"2024-04-20T21:21:13.854357+0000","last_became_peered":"2024-04-20T21:21:13.854357+0000","last_unstale":"2024-04-20T21:21:15.859906+0000","last_undegraded":"2024-04-20T21:21:15.859906+0000","last_fullsized":"2024-04-20T21:21:15.859906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:32.176825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914482+0000","last_change":"2024-04-20T21:21:14.857939+0000","last_active":"2024-04-20T21:21:16.914482+0000","last_peered":"2024-04-20T21:21:16.914482+0000","last_clean":"2024-04-20T21:21:16.914482+0000","last_became_active":"2024-04-20T21:21:14.857676+0000","last_became_peered":"2024-04-20T21:21:14.857676+0000","last_unstale":"2024-04-20T21:21:16.914482+0000","last_undegraded":"2024-04-20T21:21:16.914482+0000","last_fullsized":"2024-04-20T21:21:16.914482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859705+0000","last_change":"2024-04-20T21:21:13.847644+0000","last_active":"2024-04-20T21:21:15.859705+0000","last_peered":"2024-04-20T21:21:15.859705+0000","last_clean":"2024-04-20T21:21:15.859705+0000","last_became_active":"2024-04-20T21:21:13.846847+0000","last_became_peered":"2024-04-20T21:21:13.846847+0000","last_unstale":"2024-04-20T21:21:15.859705+0000","last_undegraded":"2024-04-20T21:21:15.859705+0000","last_fullsized":"2024-04-20T21:21:15.859705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:02.155842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859665+0000","last_change":"2024-04-20T21:21:14.861546+0000","last_active":"2024-04-20T21:21:15.859665+0000","last_peered":"2024-04-20T21:21:15.859665+0000","last_clean":"2024-04-20T21:21:15.859665+0000","last_became_active":"2024-04-20T21:21:14.861240+0000","last_became_peered":"2024-04-20T21:21:14.861240+0000","last_unstale":"2024-04-20T21:21:15.859665+0000","last_undegraded":"2024-04-20T21:21:15.859665+0000","last_fullsized":"2024-04-20T21:21:15.859665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:37:09.139008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914500+0000","last_change":"2024-04-20T21:21:13.849628+0000","last_active":"2024-04-20T21:21:16.914500+0000","last_peered":"2024-04-20T21:21:16.914500+0000","last_clean":"2024-04-20T21:21:16.914500+0000","last_became_active":"2024-04-20T21:21:13.849326+0000","last_became_peered":"2024-04-20T21:21:13.849326+0000","last_unstale":"2024-04-20T21:21:16.914500+0000","last_undegraded":"2024-04-20T21:21:16.914500+0000","last_fullsized":"2024-04-20T21:21:16.914500+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917493+0000","last_change":"2024-04-20T21:21:14.844280+0000","last_active":"2024-04-20T21:21:16.917493+0000","last_peered":"2024-04-20T21:21:16.917493+0000","last_clean":"2024-04-20T21:21:16.917493+0000","last_became_active":"2024-04-20T21:21:14.843920+0000","last_became_peered":"2024-04-20T21:21:14.843920+0000","last_unstale":"2024-04-20T21:21:16.917493+0000","last_undegraded":"2024-04-20T21:21:16.917493+0000","last_fullsized":"2024-04-20T21:21:16.917493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:38:16.941267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859203+0000","last_change":"2024-04-20T21:21:13.857369+0000","last_active":"2024-04-20T21:21:15.859203+0000","last_peered":"2024-04-20T21:21:15.859203+0000","last_clean":"2024-04-20T21:21:15.859203+0000","last_became_active":"2024-04-20T21:21:13.856231+0000","last_became_peered":"2024-04-20T21:21:13.856231+0000","last_unstale":"2024-04-20T21:21:15.859203+0000","last_undegraded":"2024-04-20T21:21:15.859203+0000","last_fullsized":"2024-04-20T21:21:15.859203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:21.218925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859673+0000","last_change":"2024-04-20T21:21:14.862052+0000","last_active":"2024-04-20T21:21:15.859673+0000","last_peered":"2024-04-20T21:21:15.859673+0000","last_clean":"2024-04-20T21:21:15.859673+0000","last_became_active":"2024-04-20T21:21:14.861071+0000","last_became_peered":"2024-04-20T21:21:14.861071+0000","last_unstale":"2024-04-20T21:21:15.859673+0000","last_undegraded":"2024-04-20T21:21:15.859673+0000","last_fullsized":"2024-04-20T21:21:15.859673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:15:19.755482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916259+0000","last_change":"2024-04-20T21:21:13.860489+0000","last_active":"2024-04-20T21:21:16.916259+0000","last_peered":"2024-04-20T21:21:16.916259+0000","last_clean":"2024-04-20T21:21:16.916259+0000","last_became_active":"2024-04-20T21:21:13.859676+0000","last_became_peered":"2024-04-20T21:21:13.859676+0000","last_unstale":"2024-04-20T21:21:16.916259+0000","last_undegraded":"2024-04-20T21:21:16.916259+0000","last_fullsized":"2024-04-20T21:21:16.916259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:09:15.823481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860186+0000","last_change":"2024-04-20T21:21:14.863015+0000","last_active":"2024-04-20T21:21:15.860186+0000","last_peered":"2024-04-20T21:21:15.860186+0000","last_clean":"2024-04-20T21:21:15.860186+0000","last_became_active":"2024-04-20T21:21:14.862733+0000","last_became_peered":"2024-04-20T21:21:14.862733+0000","last_unstale":"2024-04-20T21:21:15.860186+0000","last_undegraded":"2024-04-20T21:21:15.860186+0000","last_fullsized":"2024-04-20T21:21:15.860186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:17:18.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504152+0000","last_change":"2024-04-20T21:21:13.855388+0000","last_active":"2024-04-20T21:21:16.504152+0000","last_peered":"2024-04-20T21:21:16.504152+0000","last_clean":"2024-04-20T21:21:16.504152+0000","last_became_active":"2024-04-20T21:21:13.854344+0000","last_became_peered":"2024-04-20T21:21:13.854344+0000","last_unstale":"2024-04-20T21:21:16.504152+0000","last_undegraded":"2024-04-20T21:21:16.504152+0000","last_fullsized":"2024-04-20T21:21:16.504152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:51.996160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504191+0000","last_change":"2024-04-20T21:21:14.871059+0000","last_active":"2024-04-20T21:21:16.504191+0000","last_peered":"2024-04-20T21:21:16.504191+0000","last_clean":"2024-04-20T21:21:16.504191+0000","last_became_active":"2024-04-20T21:21:14.870705+0000","last_became_peered":"2024-04-20T21:21:14.870705+0000","last_unstale":"2024-04-20T21:21:16.504191+0000","last_undegraded":"2024-04-20T21:21:16.504191+0000","last_fullsized":"2024-04-20T21:21:16.504191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:26:03.453414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861562+0000","last_change":"2024-04-20T21:21:13.855754+0000","last_active":"2024-04-20T21:21:15.861562+0000","last_peered":"2024-04-20T21:21:15.861562+0000","last_clean":"2024-04-20T21:21:15.861562+0000","last_became_active":"2024-04-20T21:21:13.855416+0000","last_became_peered":"2024-04-20T21:21:13.855416+0000","last_unstale":"2024-04-20T21:21:15.861562+0000","last_undegraded":"2024-04-20T21:21:15.861562+0000","last_fullsized":"2024-04-20T21:21:15.861562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861349+0000","last_change":"2024-04-20T21:21:14.874492+0000","last_active":"2024-04-20T21:21:15.861349+0000","last_peered":"2024-04-20T21:21:15.861349+0000","last_clean":"2024-04-20T21:21:15.861349+0000","last_became_active":"2024-04-20T21:21:14.873871+0000","last_became_peered":"2024-04-20T21:21:14.873871+0000","last_unstale":"2024-04-20T21:21:15.861349+0000","last_undegraded":"2024-04-20T21:21:15.861349+0000","last_fullsized":"2024-04-20T21:21:15.861349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:53.668807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838936+0000","last_change":"2024-04-20T21:21:13.852987+0000","last_active":"2024-04-20T21:21:16.838936+0000","last_peered":"2024-04-20T21:21:16.838936+0000","last_clean":"2024-04-20T21:21:16.838936+0000","last_became_active":"2024-04-20T21:21:13.852708+0000","last_became_peered":"2024-04-20T21:21:13.852708+0000","last_unstale":"2024-04-20T21:21:16.838936+0000","last_undegraded":"2024-04-20T21:21:16.838936+0000","last_fullsized":"2024-04-20T21:21:16.838936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T01:58:55.889971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839441+0000","last_change":"2024-04-20T21:21:14.856563+0000","last_active":"2024-04-20T21:21:16.839441+0000","last_peered":"2024-04-20T21:21:16.839441+0000","last_clean":"2024-04-20T21:21:16.839441+0000","last_became_active":"2024-04-20T21:21:14.856248+0000","last_became_peered":"2024-04-20T21:21:14.856248+0000","last_unstale":"2024-04-20T21:21:16.839441+0000","last_undegraded":"2024-04-20T21:21:16.839441+0000","last_fullsized":"2024-04-20T21:21:16.839441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:23:43.018615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914745+0000","last_change":"2024-04-20T21:21:13.854000+0000","last_active":"2024-04-20T21:21:16.914745+0000","last_peered":"2024-04-20T21:21:16.914745+0000","last_clean":"2024-04-20T21:21:16.914745+0000","last_became_active":"2024-04-20T21:21:13.853604+0000","last_became_peered":"2024-04-20T21:21:13.853604+0000","last_unstale":"2024-04-20T21:21:16.914745+0000","last_undegraded":"2024-04-20T21:21:16.914745+0000","last_fullsized":"2024-04-20T21:21:16.914745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916862+0000","last_change":"2024-04-20T21:21:14.841984+0000","last_active":"2024-04-20T21:21:16.916862+0000","last_peered":"2024-04-20T21:21:16.916862+0000","last_clean":"2024-04-20T21:21:16.916862+0000","last_became_active":"2024-04-20T21:21:14.841641+0000","last_became_peered":"2024-04-20T21:21:14.841641+0000","last_unstale":"2024-04-20T21:21:16.916862+0000","last_undegraded":"2024-04-20T21:21:16.916862+0000","last_fullsized":"2024-04-20T21:21:16.916862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:35.242959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838605+0000","last_change":"2024-04-20T21:21:13.839573+0000","last_active":"2024-04-20T21:21:16.838605+0000","last_peered":"2024-04-20T21:21:16.838605+0000","last_clean":"2024-04-20T21:21:16.838605+0000","last_became_active":"2024-04-20T21:21:13.839221+0000","last_became_peered":"2024-04-20T21:21:13.839221+0000","last_unstale":"2024-04-20T21:21:16.838605+0000","last_undegraded":"2024-04-20T21:21:16.838605+0000","last_fullsized":"2024-04-20T21:21:16.838605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:06:13.391506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915084+0000","last_change":"2024-04-20T21:21:14.859655+0000","last_active":"2024-04-20T21:21:16.915084+0000","last_peered":"2024-04-20T21:21:16.915084+0000","last_clean":"2024-04-20T21:21:16.915084+0000","last_became_active":"2024-04-20T21:21:14.859340+0000","last_became_peered":"2024-04-20T21:21:14.859340+0000","last_unstale":"2024-04-20T21:21:16.915084+0000","last_undegraded":"2024-04-20T21:21:16.915084+0000","last_fullsized":"2024-04-20T21:21:16.915084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:05:28.909594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838594+0000","last_change":"2024-04-20T21:21:13.848527+0000","last_active":"2024-04-20T21:21:16.838594+0000","last_peered":"2024-04-20T21:21:16.838594+0000","last_clean":"2024-04-20T21:21:16.838594+0000","last_became_active":"2024-04-20T21:21:13.848170+0000","last_became_peered":"2024-04-20T21:21:13.848170+0000","last_unstale":"2024-04-20T21:21:16.838594+0000","last_undegraded":"2024-04-20T21:21:16.838594+0000","last_fullsized":"2024-04-20T21:21:16.838594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:55:51.845936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.503657+0000","last_change":"2024-04-20T21:21:14.858608+0000","last_active":"2024-04-20T21:21:16.503657+0000","last_peered":"2024-04-20T21:21:16.503657+0000","last_clean":"2024-04-20T21:21:16.503657+0000","last_became_active":"2024-04-20T21:21:14.858254+0000","last_became_peered":"2024-04-20T21:21:14.858254+0000","last_unstale":"2024-04-20T21:21:16.503657+0000","last_undegraded":"2024-04-20T21:21:16.503657+0000","last_fullsized":"2024-04-20T21:21:16.503657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:29:28.575895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916746+0000","last_change":"2024-04-20T21:21:13.861471+0000","last_active":"2024-04-20T21:21:16.916746+0000","last_peered":"2024-04-20T21:21:16.916746+0000","last_clean":"2024-04-20T21:21:16.916746+0000","last_became_active":"2024-04-20T21:21:13.861170+0000","last_became_peered":"2024-04-20T21:21:13.861170+0000","last_unstale":"2024-04-20T21:21:16.916746+0000","last_undegraded":"2024-04-20T21:21:16.916746+0000","last_fullsized":"2024-04-20T21:21:16.916746+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:04:37.310861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859507+0000","last_change":"2024-04-20T21:21:14.864561+0000","last_active":"2024-04-20T21:21:15.859507+0000","last_peered":"2024-04-20T21:21:15.859507+0000","last_clean":"2024-04-20T21:21:15.859507+0000","last_became_active":"2024-04-20T21:21:14.861444+0000","last_became_peered":"2024-04-20T21:21:14.861444+0000","last_unstale":"2024-04-20T21:21:15.859507+0000","last_undegraded":"2024-04-20T21:21:15.859507+0000","last_fullsized":"2024-04-20T21:21:15.859507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:49:06.104703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.838928+0000","last_change":"2024-04-20T21:21:13.838221+0000","last_active":"2024-04-20T21:21:16.838928+0000","last_peered":"2024-04-20T21:21:16.838928+0000","last_clean":"2024-04-20T21:21:16.838928+0000","last_became_active":"2024-04-20T21:21:13.837654+0000","last_became_peered":"2024-04-20T21:21:13.837654+0000","last_unstale":"2024-04-20T21:21:16.838928+0000","last_undegraded":"2024-04-20T21:21:16.838928+0000","last_fullsized":"2024-04-20T21:21:16.838928+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:23:34.226864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914778+0000","last_change":"2024-04-20T21:21:14.867009+0000","last_active":"2024-04-20T21:21:16.914778+0000","last_peered":"2024-04-20T21:21:16.914778+0000","last_clean":"2024-04-20T21:21:16.914778+0000","last_became_active":"2024-04-20T21:21:14.864737+0000","last_became_peered":"2024-04-20T21:21:14.864737+0000","last_unstale":"2024-04-20T21:21:16.914778+0000","last_undegraded":"2024-04-20T21:21:16.914778+0000","last_fullsized":"2024-04-20T21:21:16.914778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:12:03.170054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504416+0000","last_change":"2024-04-20T21:21:13.853633+0000","last_active":"2024-04-20T21:21:16.504416+0000","last_peered":"2024-04-20T21:21:16.504416+0000","last_clean":"2024-04-20T21:21:16.504416+0000","last_became_active":"2024-04-20T21:21:13.853333+0000","last_became_peered":"2024-04-20T21:21:13.853333+0000","last_unstale":"2024-04-20T21:21:16.504416+0000","last_undegraded":"2024-04-20T21:21:16.504416+0000","last_fullsized":"2024-04-20T21:21:16.504416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:54:34.947611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916949+0000","last_change":"2024-04-20T21:21:14.848001+0000","last_active":"2024-04-20T21:21:16.916949+0000","last_peered":"2024-04-20T21:21:16.916949+0000","last_clean":"2024-04-20T21:21:16.916949+0000","last_became_active":"2024-04-20T21:21:14.847002+0000","last_became_peered":"2024-04-20T21:21:14.847002+0000","last_unstale":"2024-04-20T21:21:16.916949+0000","last_undegraded":"2024-04-20T21:21:16.916949+0000","last_fullsized":"2024-04-20T21:21:16.916949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T08:26:59.360668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.839148+0000","last_change":"2024-04-20T21:21:13.856053+0000","last_active":"2024-04-20T21:21:16.839148+0000","last_peered":"2024-04-20T21:21:16.839148+0000","last_clean":"2024-04-20T21:21:16.839148+0000","last_became_active":"2024-04-20T21:21:13.855739+0000","last_became_peered":"2024-04-20T21:21:13.855739+0000","last_unstale":"2024-04-20T21:21:16.839148+0000","last_undegraded":"2024-04-20T21:21:16.839148+0000","last_fullsized":"2024-04-20T21:21:16.839148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:50:02.925021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860241+0000","last_change":"2024-04-20T21:21:14.875179+0000","last_active":"2024-04-20T21:21:15.860241+0000","last_peered":"2024-04-20T21:21:15.860241+0000","last_clean":"2024-04-20T21:21:15.860241+0000","last_became_active":"2024-04-20T21:21:14.874815+0000","last_became_peered":"2024-04-20T21:21:14.874815+0000","last_unstale":"2024-04-20T21:21:15.860241+0000","last_undegraded":"2024-04-20T21:21:15.860241+0000","last_fullsized":"2024-04-20T21:21:15.860241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T04:44:49.884018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915471+0000","last_change":"2024-04-20T21:21:13.850690+0000","last_active":"2024-04-20T21:21:16.915471+0000","last_peered":"2024-04-20T21:21:16.915471+0000","last_clean":"2024-04-20T21:21:16.915471+0000","last_became_active":"2024-04-20T21:21:13.850378+0000","last_became_peered":"2024-04-20T21:21:13.850378+0000","last_unstale":"2024-04-20T21:21:16.915471+0000","last_undegraded":"2024-04-20T21:21:16.915471+0000","last_fullsized":"2024-04-20T21:21:16.915471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914702+0000","last_change":"2024-04-20T21:21:14.857308+0000","last_active":"2024-04-20T21:21:16.914702+0000","last_peered":"2024-04-20T21:21:16.914702+0000","last_clean":"2024-04-20T21:21:16.914702+0000","last_became_active":"2024-04-20T21:21:14.856877+0000","last_became_peered":"2024-04-20T21:21:14.856877+0000","last_unstale":"2024-04-20T21:21:16.914702+0000","last_undegraded":"2024-04-20T21:21:16.914702+0000","last_fullsized":"2024-04-20T21:21:16.914702+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:31:33.191036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.915163+0000","last_change":"2024-04-20T21:21:13.857813+0000","last_active":"2024-04-20T21:21:16.915163+0000","last_peered":"2024-04-20T21:21:16.915163+0000","last_clean":"2024-04-20T21:21:16.915163+0000","last_became_active":"2024-04-20T21:21:13.857492+0000","last_became_peered":"2024-04-20T21:21:13.857492+0000","last_unstale":"2024-04-20T21:21:16.915163+0000","last_undegraded":"2024-04-20T21:21:16.915163+0000","last_fullsized":"2024-04-20T21:21:16.915163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:50:42.917712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.914401+0000","last_change":"2024-04-20T21:21:14.860886+0000","last_active":"2024-04-20T21:21:16.914401+0000","last_peered":"2024-04-20T21:21:16.914401+0000","last_clean":"2024-04-20T21:21:16.914401+0000","last_became_active":"2024-04-20T21:21:14.852943+0000","last_became_peered":"2024-04-20T21:21:14.852943+0000","last_unstale":"2024-04-20T21:21:16.914401+0000","last_undegraded":"2024-04-20T21:21:16.914401+0000","last_fullsized":"2024-04-20T21:21:16.914401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T03:41:58.001860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859185+0000","last_change":"2024-04-20T21:21:13.853508+0000","last_active":"2024-04-20T21:21:15.859185+0000","last_peered":"2024-04-20T21:21:15.859185+0000","last_clean":"2024-04-20T21:21:15.859185+0000","last_became_active":"2024-04-20T21:21:13.852602+0000","last_became_peered":"2024-04-20T21:21:13.852602+0000","last_unstale":"2024-04-20T21:21:15.859185+0000","last_undegraded":"2024-04-20T21:21:15.859185+0000","last_fullsized":"2024-04-20T21:21:15.859185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:23:42.004403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.861282+0000","last_change":"2024-04-20T21:21:14.872005+0000","last_active":"2024-04-20T21:21:15.861282+0000","last_peered":"2024-04-20T21:21:15.861282+0000","last_clean":"2024-04-20T21:21:15.861282+0000","last_became_active":"2024-04-20T21:21:14.871673+0000","last_became_peered":"2024-04-20T21:21:14.871673+0000","last_unstale":"2024-04-20T21:21:15.861282+0000","last_undegraded":"2024-04-20T21:21:15.861282+0000","last_fullsized":"2024-04-20T21:21:15.861282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:49:59.837058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.860843+0000","last_change":"2024-04-20T21:21:13.850262+0000","last_active":"2024-04-20T21:21:15.860843+0000","last_peered":"2024-04-20T21:21:15.860843+0000","last_clean":"2024-04-20T21:21:15.860843+0000","last_became_active":"2024-04-20T21:21:13.848714+0000","last_became_peered":"2024-04-20T21:21:13.848714+0000","last_unstale":"2024-04-20T21:21:15.860843+0000","last_undegraded":"2024-04-20T21:21:15.860843+0000","last_fullsized":"2024-04-20T21:21:15.860843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917482+0000","last_change":"2024-04-20T21:21:14.842928+0000","last_active":"2024-04-20T21:21:16.917482+0000","last_peered":"2024-04-20T21:21:16.917482+0000","last_clean":"2024-04-20T21:21:16.917482+0000","last_became_active":"2024-04-20T21:21:14.842611+0000","last_became_peered":"2024-04-20T21:21:14.842611+0000","last_unstale":"2024-04-20T21:21:16.917482+0000","last_undegraded":"2024-04-20T21:21:16.917482+0000","last_fullsized":"2024-04-20T21:21:16.917482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T06:36:40.817426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:15.859213+0000","last_change":"2024-04-20T21:21:13.844580+0000","last_active":"2024-04-20T21:21:15.859213+0000","last_peered":"2024-04-20T21:21:15.859213+0000","last_clean":"2024-04-20T21:21:15.859213+0000","last_became_active":"2024-04-20T21:21:13.844220+0000","last_became_peered":"2024-04-20T21:21:13.844220+0000","last_unstale":"2024-04-20T21:21:15.859213+0000","last_undegraded":"2024-04-20T21:21:15.859213+0000","last_fullsized":"2024-04-20T21:21:15.859213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:40:52.654595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.504067+0000","last_change":"2024-04-20T21:21:14.860837+0000","last_active":"2024-04-20T21:21:16.504067+0000","last_peered":"2024-04-20T21:21:16.504067+0000","last_clean":"2024-04-20T21:21:16.504067+0000","last_became_active":"2024-04-20T21:21:14.860448+0000","last_became_peered":"2024-04-20T21:21:14.860448+0000","last_unstale":"2024-04-20T21:21:16.504067+0000","last_undegraded":"2024-04-20T21:21:16.504067+0000","last_fullsized":"2024-04-20T21:21:16.504067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:13.803368+0000","last_clean_scrub_stamp":"2024-04-20T21:21:13.803368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:49:06.104703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.917495+0000","last_change":"2024-04-20T21:21:13.860626+0000","last_active":"2024-04-20T21:21:16.917495+0000","last_peered":"2024-04-20T21:21:16.917495+0000","last_clean":"2024-04-20T21:21:16.917495+0000","last_became_active":"2024-04-20T21:21:13.860108+0000","last_became_peered":"2024-04-20T21:21:13.860108+0000","last_unstale":"2024-04-20T21:21:16.917495+0000","last_undegraded":"2024-04-20T21:21:16.917495+0000","last_fullsized":"2024-04-20T21:21:16.917495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:21:12.789156+0000","last_clean_scrub_stamp":"2024-04-20T21:21:12.789156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T05:01:22.559529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-20T21:21:16.916736+0000","last_change":"2024-04-20T21:19:19.292405+0000","last_active":"2024-04-20T21:21:16.916736+0000","last_peered":"2024-04-20T21:21:16.916736+0000","last_clean":"2024-04-20T21:21:16.916736+0000","last_became_active":"2024-04-20T21:19:19.290107+0000","last_became_peered":"2024-04-20T21:19:19.290107+0000","last_unstale":"2024-04-20T21:21:16.916736+0000","last_undegraded":"2024-04-20T21:21:16.916736+0000","last_fullsized":"2024-04-20T21:21:16.916736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:19:18.230829+0000","last_clean_scrub_stamp":"2024-04-20T21:19:18.230829+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T02:48:44.146278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":197439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":787729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T21:21:24.673 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-20T21:21:24.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-20T21:21:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.927+0000 7f3870c00640 1 Processor -- start 2024-04-20T21:21:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.927+0000 7f3870c00640 1 -- start start 2024-04-20T21:21:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.929+0000 7f3870c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c072190 0x7f386c0735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.929+0000 7f3870c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386c15cc90 con 0x7f386c15a1f0 2024-04-20T21:21:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.929+0000 7f3870c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386c15cf70 con 0x7f386c159e10 2024-04-20T21:21:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.929+0000 7f3870c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f386c072900 con 0x7f386c072190 2024-04-20T21:21:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.929+0000 7f386aa00640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f386c15a1f0 0x7f386c072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56190/0 (socket says 172.21.15.71:56190) 2024-04-20T21:21:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.929+0000 7f386aa00640 1 -- 172.21.15.71:0/3791913759 learned_addr learned my addr 172.21.15.71:0/3791913759 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.929+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620976476 0 0) 0x7f386c15cc90 con 0x7f386c15a1f0 2024-04-20T21:21:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.929+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3850003520 con 0x7f386c15a1f0 2024-04-20T21:21:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.929+0000 7f386be00640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c072190 0x7f386c0735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 317794483 0 0) 0x7f3850003520 con 0x7f386c15a1f0 2024-04-20T21:21:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c072190 msgr2=0x7f386c0735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c072190 0x7f386c0735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 >> v1:172.21.15.137:6789/0 conn(0x7f386c159e10 legacy=0x7f386c071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c15d250 con 0x7f386c15a1f0 2024-04-20T21:21:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f3858001670 con 0x7f386c15a1f0 2024-04-20T21:21:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386be00640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c072190 0x7f386c0735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:21:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 >> v1:172.21.15.71:6789/0 conn(0x7f386c15a1f0 legacy=0x7f386c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 0x7f3850003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c072190 0x7f3850004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3850004d40 0x7f38500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f385000baa0 con 0x7f38500039e0 2024-04-20T21:21:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f385000bc50 con 0x7f3850004d40 2024-04-20T21:21:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f385000be50 con 0x7f386c072190 2024-04-20T21:21:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.930+0000 7f386b400640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 0x7f3850003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.931+0000 7f386aa00640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c072190 0x7f3850004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.931+0000 7f386be00640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3850004d40 0x7f38500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.931+0000 7f386b400640 1 -- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c072190 msgr2=0x7f3850004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.931+0000 7f386b400640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c072190 0x7f3850004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.931+0000 7f386b400640 1 -- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3850004d40 msgr2=0x7f38500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.931+0000 7f386b400640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3850004d40 0x7f38500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.931+0000 7f386b400640 1 -- 172.21.15.71:0/3791913759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3850003520 con 0x7f38500039e0 2024-04-20T21:21:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.931+0000 7f386aa00640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c072190 0x7f3850004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.931+0000 7f386be00640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3850004d40 0x7f38500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:24.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.932+0000 7f386b400640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 0x7f3850003e00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f385c001720 tx=0x7f3850005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d599f1a6052b3793 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.932+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c001370 con 0x7f38500039e0 2024-04-20T21:21:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.932+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c0052d0 con 0x7f38500039e0 2024-04-20T21:21:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.932+0000 7f386a000640 1 -- 172.21.15.71:0/3791913759 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c003830 con 0x7f38500039e0 2024-04-20T21:21:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.933+0000 7f3870c00640 1 -- 172.21.15.71:0/3791913759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 msgr2=0x7f3850003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.933+0000 7f3870c00640 1 --2- 172.21.15.71:0/3791913759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 0x7f3850003e00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f385c001720 tx=0x7f3850005830 comp rx=0 tx=0).stop 2024-04-20T21:21:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.933+0000 7f386be00640 1 -- 172.21.15.71:0/3791913759 reap_dead start 2024-04-20T21:21:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.933+0000 7f3870c00640 1 -- 172.21.15.71:0/3791913759 shutdown_connections 2024-04-20T21:21:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.933+0000 7f3870c00640 1 -- 172.21.15.71:0/3791913759 >> 172.21.15.71:0/3791913759 conn(0x7f386c0d0040 msgr2=0x7f386c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.933+0000 7f3870c00640 1 -- 172.21.15.71:0/3791913759 shutdown_connections 2024-04-20T21:21:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.933+0000 7f3870c00640 1 -- 172.21.15.71:0/3791913759 wait complete. 2024-04-20T21:21:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.935+0000 7f3870c00640 1 Processor -- start 2024-04-20T21:21:24.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.935+0000 7f3870c00640 1 -- start start 2024-04-20T21:21:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.936+0000 7f3870c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 0x7f386c157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.936+0000 7f3870c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f386c151f80 0x7f386c151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.936+0000 7f3870c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c0cafb0 0x7f386c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.936+0000 7f3870c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f386c15d810 con 0x7f38500039e0 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.936+0000 7f3870c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f386c15ca40 con 0x7f386c151f80 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.936+0000 7f3870c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f386c06da90 con 0x7f386c0cafb0 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.936+0000 7f386b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 0x7f386c157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.936+0000 7f386b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 0x7f386c157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36492/0 (socket says 172.21.15.71:36492) 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.936+0000 7f386b400640 1 -- 172.21.15.71:0/678040738 learned_addr learned my addr 172.21.15.71:0/678040738 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.937+0000 7f386b400640 1 -- 172.21.15.71:0/678040738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c0cafb0 msgr2=0x7f386c15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.937+0000 7f386b400640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c0cafb0 0x7f386c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.937+0000 7f386b400640 1 -- 172.21.15.71:0/678040738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f386c151f80 msgr2=0x7f386c151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.937+0000 7f386b400640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f386c151f80 0x7f386c151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.937+0000 7f386b400640 1 -- 172.21.15.71:0/678040738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c15a770 con 0x7f38500039e0 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.937+0000 7f386b400640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 0x7f386c157a00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f385c008fd0 tx=0x7f385c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.937+0000 7f3863400640 1 -- 172.21.15.71:0/678040738 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c041070 con 0x7f38500039e0 2024-04-20T21:21:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.937+0000 7f3863400640 1 -- 172.21.15.71:0/678040738 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c005480 con 0x7f38500039e0 2024-04-20T21:21:24.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.937+0000 7f3870c00640 1 -- 172.21.15.71:0/678040738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c15aa50 con 0x7f38500039e0 2024-04-20T21:21:24.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.937+0000 7f3863400640 1 -- 172.21.15.71:0/678040738 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c001370 con 0x7f38500039e0 2024-04-20T21:21:24.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.937+0000 7f3870c00640 1 -- 172.21.15.71:0/678040738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c15b010 con 0x7f38500039e0 2024-04-20T21:21:24.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.939+0000 7f3870c00640 1 -- 172.21.15.71:0/678040738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386c075b60 con 0x7f38500039e0 2024-04-20T21:21:24.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.939+0000 7f3863400640 1 -- 172.21.15.71:0/678040738 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f385c044070 con 0x7f38500039e0 2024-04-20T21:21:24.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.940+0000 7f3863400640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384c06c8f0 0x7f384c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:24.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.940+0000 7f3863400640 1 -- 172.21.15.71:0/678040738 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f385c0ad980 con 0x7f38500039e0 2024-04-20T21:21:24.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.941+0000 7f386aa00640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384c06c8f0 0x7f384c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:24.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.941+0000 7f386aa00640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384c06c8f0 0x7f384c06edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f38580017e0 tx=0x7f3858009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:24.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:24.945+0000 7f3863400640 1 -- 172.21.15.71:0/678040738 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f385c07bc10 con 0x7f38500039e0 2024-04-20T21:21:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.221+0000 7f3870c00640 1 -- 172.21.15.71:0/678040738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f386c06d200 con 0x7f38500039e0 2024-04-20T21:21:25.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.226+0000 7f3863400640 1 -- 172.21.15.71:0/678040738 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f385c07b510 con 0x7f38500039e0 2024-04-20T21:21:25.225 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-04-20T21:21:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAiMSRmBYIpKBAAXd3vf56ttxfmvMK2YXpHOg== 2024-04-20T21:21:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: caps mds = "allow" 2024-04-20T21:21:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: caps mon = "allow r" 2024-04-20T21:21:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-20T21:21:25.225 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2024-04-20T21:21:25.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 -- 172.21.15.71:0/678040738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384c06c8f0 msgr2=0x7f384c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:25.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384c06c8f0 0x7f384c06edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f38580017e0 tx=0x7f3858009040 comp rx=0 tx=0).stop 2024-04-20T21:21:25.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 -- 172.21.15.71:0/678040738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 msgr2=0x7f386c157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:25.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 0x7f386c157a00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f385c008fd0 tx=0x7f385c001120 comp rx=0 tx=0).stop 2024-04-20T21:21:25.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 -- 172.21.15.71:0/678040738 shutdown_connections 2024-04-20T21:21:25.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f384c06c8f0 0x7f384c06edb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f386c0cafb0 0x7f386c15b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f386c151f80 0x7f386c151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 --2- 172.21.15.71:0/678040738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38500039e0 0x7f386c157a00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 -- 172.21.15.71:0/678040738 >> 172.21.15.71:0/678040738 conn(0x7f386c0d0040 msgr2=0x7f386c0d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:25.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 -- 172.21.15.71:0/678040738 shutdown_connections 2024-04-20T21:21:25.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.229+0000 7f3870c00640 1 -- 172.21.15.71:0/678040738 wait complete. 2024-04-20T21:21:25.246 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:21:25.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.443+0000 7f6063200640 1 Processor -- start 2024-04-20T21:21:25.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.443+0000 7f6063200640 1 -- start start 2024-04-20T21:21:25.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.444+0000 7f6063200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 0x7f606415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:25.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.445+0000 7f6063200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f606415c190 0x7f606406ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:25.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.445+0000 7f6063200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f606406ccc0 con 0x7f606415b400 2024-04-20T21:21:25.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.445+0000 7f6063200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f606406d280 con 0x7f606415c190 2024-04-20T21:21:25.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.445+0000 7f6063200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f606406cfa0 con 0x7f606415b7e0 2024-04-20T21:21:25.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.446+0000 7f6059400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 0x7f606415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:25.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.446+0000 7f6059400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 0x7f606415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.71:34122/0 (socket says 172.21.15.71:34122) 2024-04-20T21:21:25.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.446+0000 7f6059400640 1 -- 172.21.15.71:0/467179274 learned_addr learned my addr 172.21.15.71:0/467179274 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:25.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.446+0000 7f6062800640 1 --2- 172.21.15.71:0/467179274 >> v2:172.21.15.137:3300/0 conn(0x7f606415c190 0x7f606406ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:25.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.447+0000 7f6059400640 1 -- 172.21.15.71:0/467179274 >> v2:172.21.15.137:3300/0 conn(0x7f606415c190 msgr2=0x7f606406ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:25.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.447+0000 7f6059400640 1 --2- 172.21.15.71:0/467179274 >> v2:172.21.15.137:3300/0 conn(0x7f606415c190 0x7f606406ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.447+0000 7f6059400640 1 -- 172.21.15.71:0/467179274 >> v1:172.21.15.137:6789/0 conn(0x7f606415b400 legacy=0x7f6064072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:25.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.447+0000 7f6059400640 1 -- 172.21.15.71:0/467179274 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606406e440 con 0x7f606415b7e0 2024-04-20T21:21:25.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.448+0000 7f6059400640 1 --2- 172.21.15.71:0/467179274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 0x7f606415bc50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f604c009870 tx=0x7f604c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b282ce188948e0e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:25.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.448+0000 7f6061400640 1 -- 172.21.15.71:0/467179274 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c034070 con 0x7f606415b7e0 2024-04-20T21:21:25.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.448+0000 7f6061400640 1 -- 172.21.15.71:0/467179274 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604c030840 con 0x7f606415b7e0 2024-04-20T21:21:25.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.448+0000 7f6061400640 1 -- 172.21.15.71:0/467179274 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c030c10 con 0x7f606415b7e0 2024-04-20T21:21:25.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.449+0000 7f6063200640 1 -- 172.21.15.71:0/467179274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 msgr2=0x7f606415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:25.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.449+0000 7f6063200640 1 --2- 172.21.15.71:0/467179274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 0x7f606415bc50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f604c009870 tx=0x7f604c02b980 comp rx=0 tx=0).stop 2024-04-20T21:21:25.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.449+0000 7f6063200640 1 -- 172.21.15.71:0/467179274 shutdown_connections 2024-04-20T21:21:25.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.449+0000 7f6063200640 1 --2- 172.21.15.71:0/467179274 >> v2:172.21.15.137:3300/0 conn(0x7f606415c190 0x7f606406ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.449+0000 7f6063200640 1 --2- 172.21.15.71:0/467179274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 0x7f606415bc50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.449+0000 7f6063200640 1 -- 172.21.15.71:0/467179274 >> 172.21.15.71:0/467179274 conn(0x7f60640d0040 msgr2=0x7f60640d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:25.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.449+0000 7f6063200640 1 -- 172.21.15.71:0/467179274 shutdown_connections 2024-04-20T21:21:25.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.449+0000 7f6063200640 1 -- 172.21.15.71:0/467179274 wait complete. 2024-04-20T21:21:25.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.451+0000 7f6063200640 1 Processor -- start 2024-04-20T21:21:25.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.451+0000 7f6063200640 1 -- start start 2024-04-20T21:21:25.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.452+0000 7f6063200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f606415b400 0x7f606414fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:25.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.452+0000 7f6063200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 0x7f606415e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:25.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.452+0000 7f6063200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606415c190 0x7f606415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.452+0000 7f6063200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f606415c730 con 0x7f606415b400 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.452+0000 7f6063200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f606415c5b0 con 0x7f606415c190 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.452+0000 7f6063200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f606406f180 con 0x7f606415b7e0 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.452+0000 7f6061e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f606415b400 0x7f606414fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.452+0000 7f6061e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f606415b400 0x7f606414fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36506/0 (socket says 172.21.15.71:36506) 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.452+0000 7f6061e00640 1 -- 172.21.15.71:0/2357950768 learned_addr learned my addr 172.21.15.71:0/2357950768 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.453+0000 7f6059400640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 0x7f606415e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.453+0000 7f6062800640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606415c190 0x7f606415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.453+0000 7f6061e00640 1 -- 172.21.15.71:0/2357950768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 msgr2=0x7f606415e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.453+0000 7f6061e00640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 0x7f606415e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.453+0000 7f6061e00640 1 -- 172.21.15.71:0/2357950768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606415c190 msgr2=0x7f606415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.453+0000 7f6061e00640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606415c190 0x7f606415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.453+0000 7f6061e00640 1 -- 172.21.15.71:0/2357950768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606415f190 con 0x7f606415b400 2024-04-20T21:21:25.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.453+0000 7f6062800640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606415c190 0x7f606415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:25.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.453+0000 7f6061e00640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f606415b400 0x7f606414fbc0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f605400c7c0 tx=0x7f605400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:25.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.453+0000 7f605aa00640 1 -- 172.21.15.71:0/2357950768 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054016020 con 0x7f606415b400 2024-04-20T21:21:25.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.454+0000 7f605aa00640 1 -- 172.21.15.71:0/2357950768 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6054006d50 con 0x7f606415b400 2024-04-20T21:21:25.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.454+0000 7f605aa00640 1 -- 172.21.15.71:0/2357950768 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054003bb0 con 0x7f606415b400 2024-04-20T21:21:25.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.454+0000 7f6063200640 1 -- 172.21.15.71:0/2357950768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606415f470 con 0x7f606415b400 2024-04-20T21:21:25.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.454+0000 7f6063200640 1 -- 172.21.15.71:0/2357950768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f606415fa30 con 0x7f606415b400 2024-04-20T21:21:25.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.455+0000 7f6063200640 1 -- 172.21.15.71:0/2357950768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6064075b60 con 0x7f606415b400 2024-04-20T21:21:25.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.456+0000 7f605aa00640 1 -- 172.21.15.71:0/2357950768 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f605400a850 con 0x7f606415b400 2024-04-20T21:21:25.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.458+0000 7f605aa00640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f604006c8f0 0x7f604006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:25.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.458+0000 7f605aa00640 1 -- 172.21.15.71:0/2357950768 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f605408ba40 con 0x7f606415b400 2024-04-20T21:21:25.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.458+0000 7f6059400640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f604006c8f0 0x7f604006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:25.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.459+0000 7f6059400640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f604006c8f0 0x7f604006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f604c036000 tx=0x7f604c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:25.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.462+0000 7f605aa00640 1 -- 172.21.15.71:0/2357950768 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6054020020 con 0x7f606415b400 2024-04-20T21:21:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.703+0000 7f6063200640 1 -- 172.21.15.71:0/2357950768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60640b5220 con 0x7f606415b400 2024-04-20T21:21:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.705+0000 7f605aa00640 1 -- 172.21.15.71:0/2357950768 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5202 (secure 0 0 0) 0x7f6054019310 con 0x7f606415b400 2024-04-20T21:21:25.705 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:25.705 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1486343753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1486343753},{"type":"v1","addr":"172.21.15.137:6834","nonce":1486343753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/861651173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":861651173},{"type":"v1","addr":"172.21.15.71:6835","nonce":861651173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5493,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1972589403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1972589403},{"type":"v1","addr":"172.21.15.71:6837","nonce":1972589403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:21:14.294863+0000","modified":"2024-04-20T21:21:17.341978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5505":{"gid":5505,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6835/3032319028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3032319028},{"type":"v1","addr":"172.21.15.137:6835","nonce":3032319028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5505,"qdb_cluster":[5505]},"id":2}]} 2024-04-20T21:21:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 17 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 -- 172.21.15.71:0/2357950768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f604006c8f0 msgr2=0x7f604006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f604006c8f0 0x7f604006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f604c036000 tx=0x7f604c03b040 comp rx=0 tx=0).stop 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 -- 172.21.15.71:0/2357950768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f606415b400 msgr2=0x7f606414fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f606415b400 0x7f606414fbc0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f605400c7c0 tx=0x7f605400cc80 comp rx=0 tx=0).stop 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 -- 172.21.15.71:0/2357950768 shutdown_connections 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f604006c8f0 0x7f604006edb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606415c190 0x7f606415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f606415b7e0 0x7f606415e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 --2- 172.21.15.71:0/2357950768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f606415b400 0x7f606414fbc0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 -- 172.21.15.71:0/2357950768 >> 172.21.15.71:0/2357950768 conn(0x7f60640d0040 msgr2=0x7f60640b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 -- 172.21.15.71:0/2357950768 shutdown_connections 2024-04-20T21:21:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:25.708+0000 7f6063200640 1 -- 172.21.15.71:0/2357950768 wait complete. 2024-04-20T21:21:26.129 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-20T21:21:14.294863+0000', 'modified': '2024-04-20T21:21:17.341978+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5505}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5505': {'gid': 5505, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.137:6835/3032319028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6833', 'nonce': 3032319028}, {'type': 'v1', 'addr': '172.21.15.137:6835', 'nonce': 3032319028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5505, 'qdb_cluster': [5505]} 2024-04-20T21:21:26.129 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-20T21:21:26.129 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-20T21:21:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.338+0000 7f0e21600640 1 Processor -- start 2024-04-20T21:21:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.339+0000 7f0e21600640 1 -- start start 2024-04-20T21:21:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.340+0000 7f0e21600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0e1c159e10 0x7f0e1c071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.340+0000 7f0e21600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c06da90 0x7f0e1c071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.340+0000 7f0e21600640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c15cc90 con 0x7f0e1c15a1f0 2024-04-20T21:21:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.340+0000 7f0e21600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1c072900 con 0x7f0e1c159e10 2024-04-20T21:21:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.340+0000 7f0e21600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c15ca40 con 0x7f0e1c06da90 2024-04-20T21:21:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.341+0000 7f0e13400640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0e1c15a1f0 0x7f0e1c160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56204/0 (socket says 172.21.15.71:56204) 2024-04-20T21:21:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.341+0000 7f0e13400640 1 -- 172.21.15.71:0/3694098694 learned_addr learned my addr 172.21.15.71:0/3694098694 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.341+0000 7f0e20c00640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c06da90 0x7f0e1c071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.341+0000 7f0e1be00640 1 --2- 172.21.15.71:0/3694098694 >> v2:172.21.15.137:3300/0 conn(0x7f0e1c159e10 0x7f0e1c071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.341+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593690157 0 0) 0x7f0e1c15cc90 con 0x7f0e1c15a1f0 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.341+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e00003520 con 0x7f0e1c15a1f0 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1170056144 0 0) 0x7f0e00003520 con 0x7f0e1c15a1f0 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c06da90 msgr2=0x7f0e1c071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c06da90 0x7f0e1c071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 >> v2:172.21.15.137:3300/0 conn(0x7f0e1c159e10 msgr2=0x7f0e1c071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 --2- 172.21.15.71:0/3694098694 >> v2:172.21.15.137:3300/0 conn(0x7f0e1c159e10 0x7f0e1c071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c15cf70 con 0x7f0e1c15a1f0 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f0e04001690 con 0x7f0e1c15a1f0 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 >> v1:172.21.15.71:6789/0 conn(0x7f0e1c15a1f0 legacy=0x7f0e1c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e000039b0 0x7f0e00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c06da90 0x7f0e00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e00004d40 0x7f0e000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c15ca40 con 0x7f0e000039b0 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0000fe80 con 0x7f0e00004d40 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0e00010080 con 0x7f0e1c06da90 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e1be00640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e000039b0 0x7f0e00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.342+0000 7f0e13400640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c06da90 0x7f0e00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.343+0000 7f0e20c00640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e00004d40 0x7f0e000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.343+0000 7f0e1be00640 1 -- 172.21.15.71:0/3694098694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c06da90 msgr2=0x7f0e00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.343+0000 7f0e1be00640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c06da90 0x7f0e00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.343+0000 7f0e1be00640 1 -- 172.21.15.71:0/3694098694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e00004d40 msgr2=0x7f0e000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.343+0000 7f0e1be00640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e00004d40 0x7f0e000051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.343+0000 7f0e1be00640 1 -- 172.21.15.71:0/3694098694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e00003520 con 0x7f0e000039b0 2024-04-20T21:21:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.344+0000 7f0e1be00640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e000039b0 0x7f0e00003dd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00ba30 tx=0x7f0e00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856ed76bca489bfc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.344+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c036020 con 0x7f0e000039b0 2024-04-20T21:21:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.344+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0c032680 con 0x7f0e000039b0 2024-04-20T21:21:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.344+0000 7f0e1b400640 1 -- 172.21.15.71:0/3694098694 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c00b600 con 0x7f0e000039b0 2024-04-20T21:21:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.345+0000 7f0e21600640 1 -- 172.21.15.71:0/3694098694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e000039b0 msgr2=0x7f0e00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.345+0000 7f0e21600640 1 --2- 172.21.15.71:0/3694098694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e000039b0 0x7f0e00003dd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00ba30 tx=0x7f0e00005830 comp rx=0 tx=0).stop 2024-04-20T21:21:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.345+0000 7f0e20c00640 1 -- 172.21.15.71:0/3694098694 reap_dead start 2024-04-20T21:21:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.345+0000 7f0e21600640 1 -- 172.21.15.71:0/3694098694 shutdown_connections 2024-04-20T21:21:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.345+0000 7f0e21600640 1 -- 172.21.15.71:0/3694098694 >> 172.21.15.71:0/3694098694 conn(0x7f0e1c0d0040 msgr2=0x7f0e1c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.345+0000 7f0e21600640 1 -- 172.21.15.71:0/3694098694 shutdown_connections 2024-04-20T21:21:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.345+0000 7f0e21600640 1 -- 172.21.15.71:0/3694098694 wait complete. 2024-04-20T21:21:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.347+0000 7f0e21600640 1 Processor -- start 2024-04-20T21:21:26.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.347+0000 7f0e21600640 1 -- start start 2024-04-20T21:21:26.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.348+0000 7f0e21600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1c14bd30 0x7f0e1c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.348+0000 7f0e21600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c0b3070 0x7f0e1c15af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.348+0000 7f0e21600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e1c15b490 0x7f0e1c1f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.348+0000 7f0e21600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c15d810 con 0x7f0e1c15b490 2024-04-20T21:21:26.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.348+0000 7f0e21600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c15d530 con 0x7f0e1c14bd30 2024-04-20T21:21:26.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.348+0000 7f0e21600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c06b900 con 0x7f0e1c0b3070 2024-04-20T21:21:26.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.348+0000 7f0e20c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e1c15b490 0x7f0e1c1f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.348+0000 7f0e20c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e1c15b490 0x7f0e1c1f36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36524/0 (socket says 172.21.15.71:36524) 2024-04-20T21:21:26.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.348+0000 7f0e20c00640 1 -- 172.21.15.71:0/3459347498 learned_addr learned my addr 172.21.15.71:0/3459347498 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.349+0000 7f0e20c00640 1 -- 172.21.15.71:0/3459347498 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c0b3070 msgr2=0x7f0e1c15af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.349+0000 7f0e13400640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c0b3070 0x7f0e1c15af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.349+0000 7f0e1be00640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1c14bd30 0x7f0e1c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.349+0000 7f0e20c00640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c0b3070 0x7f0e1c15af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.349+0000 7f0e20c00640 1 -- 172.21.15.71:0/3459347498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1c14bd30 msgr2=0x7f0e1c15f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.349+0000 7f0e20c00640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1c14bd30 0x7f0e1c15f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.349+0000 7f0e20c00640 1 -- 172.21.15.71:0/3459347498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c14c110 con 0x7f0e1c15b490 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.349+0000 7f0e13400640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c0b3070 0x7f0e1c15af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.349+0000 7f0e20c00640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e1c15b490 0x7f0e1c1f36e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c050340 tx=0x7f0e14009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.349+0000 7f0e18c00640 1 -- 172.21.15.71:0/3459347498 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14019070 con 0x7f0e1c15b490 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.349+0000 7f0e18c00640 1 -- 172.21.15.71:0/3459347498 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e14007ce0 con 0x7f0e1c15b490 2024-04-20T21:21:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.350+0000 7f0e21600640 1 -- 172.21.15.71:0/3459347498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1c0b3830 con 0x7f0e1c15b490 2024-04-20T21:21:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.350+0000 7f0e18c00640 1 -- 172.21.15.71:0/3459347498 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14009e60 con 0x7f0e1c15b490 2024-04-20T21:21:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.350+0000 7f0e21600640 1 -- 172.21.15.71:0/3459347498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1c0b3df0 con 0x7f0e1c15b490 2024-04-20T21:21:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.352+0000 7f0e18c00640 1 -- 172.21.15.71:0/3459347498 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e1401c070 con 0x7f0e1c15b490 2024-04-20T21:21:26.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.353+0000 7f0e18c00640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0df806c920 0x7f0df806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.353+0000 7f0e18c00640 1 -- 172.21.15.71:0/3459347498 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0e1408b750 con 0x7f0e1c15b490 2024-04-20T21:21:26.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.353+0000 7f0e1be00640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0df806c920 0x7f0df806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.353+0000 7f0e25973740 1 Processor -- start 2024-04-20T21:21:26.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.354+0000 7f0e25973740 1 -- start start 2024-04-20T21:21:26.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.354+0000 7f0e1be00640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0df806c920 0x7f0df806ede0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00ba00 tx=0x7f0e0c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:26.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.354+0000 7f0e25973740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd80577670 0x55cd8052eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.354+0000 7f0e25973740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8052d6f0 0x55cd8052f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.354+0000 7f0e25973740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80529b90 0x55cd80559980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.354+0000 7f0e25973740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cd804959d0 con 0x55cd8052d6f0 2024-04-20T21:21:26.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.354+0000 7f0e25973740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cd8043c270 con 0x55cd80529b90 2024-04-20T21:21:26.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.354+0000 7f0e25973740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55cd80491990 con 0x55cd80577670 2024-04-20T21:21:26.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e13400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8052d6f0 0x55cd8052f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e13400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8052d6f0 0x55cd8052f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36528/0 (socket says 172.21.15.71:36528) 2024-04-20T21:21:26.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e13400640 1 -- 172.21.15.71:0/558648506 learned_addr learned my addr 172.21.15.71:0/558648506 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:26.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e1be00640 1 --2- 172.21.15.71:0/558648506 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd80577670 0x55cd8052eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e20c00640 1 --2- 172.21.15.71:0/558648506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80529b90 0x55cd80559980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e13400640 1 -- 172.21.15.71:0/558648506 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd80577670 msgr2=0x55cd8052eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e13400640 1 --2- 172.21.15.71:0/558648506 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd80577670 0x55cd8052eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e13400640 1 -- 172.21.15.71:0/558648506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80529b90 msgr2=0x55cd80559980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e13400640 1 --2- 172.21.15.71:0/558648506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80529b90 0x55cd80559980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e13400640 1 -- 172.21.15.71:0/558648506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd801a82d0 con 0x55cd8052d6f0 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e1be00640 1 --2- 172.21.15.71:0/558648506 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd80577670 0x55cd8052eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.355+0000 7f0e13400640 1 --2- 172.21.15.71:0/558648506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8052d6f0 0x55cd8052f1e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0e04001220 tx=0x7f0e0400f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fea28de4c9a70ad server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.356+0000 7f0e0be00640 1 -- 172.21.15.71:0/558648506 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04019070 con 0x55cd8052d6f0 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.356+0000 7f0e0be00640 1 -- 172.21.15.71:0/558648506 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0400fc20 con 0x55cd8052d6f0 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.356+0000 7f0e0be00640 1 -- 172.21.15.71:0/558648506 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04010040 con 0x55cd8052d6f0 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.356+0000 7f0e25973740 1 -- 172.21.15.71:0/558648506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8052d6f0 msgr2=0x55cd8052f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.356+0000 7f0e25973740 1 --2- 172.21.15.71:0/558648506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8052d6f0 0x55cd8052f1e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0e04001220 tx=0x7f0e0400f540 comp rx=0 tx=0).stop 2024-04-20T21:21:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.356+0000 7f0e25973740 1 -- 172.21.15.71:0/558648506 shutdown_connections 2024-04-20T21:21:26.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.356+0000 7f0e25973740 1 --2- 172.21.15.71:0/558648506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80529b90 0x55cd80559980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.356+0000 7f0e25973740 1 --2- 172.21.15.71:0/558648506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8052d6f0 0x55cd8052f1e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.356+0000 7f0e25973740 1 --2- 172.21.15.71:0/558648506 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd80577670 0x55cd8052eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.356+0000 7f0e25973740 1 -- 172.21.15.71:0/558648506 >> 172.21.15.71:0/558648506 conn(0x55cd8052be00 msgr2=0x55cd80574980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:26.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.357+0000 7f0e25973740 1 -- 172.21.15.71:0/558648506 shutdown_connections 2024-04-20T21:21:26.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.357+0000 7f0e25973740 1 -- 172.21.15.71:0/558648506 wait complete. 2024-04-20T21:21:26.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.357+0000 7f0e25973740 1 -- start start 2024-04-20T21:21:26.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.357+0000 7f0e25973740 1 Processor -- start 2024-04-20T21:21:26.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.358+0000 7f0e25973740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8052d6f0 0x55cd80573f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.358+0000 7f0e25973740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80577670 0x55cd8053e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.358+0000 7f0e25973740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8057c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.358+0000 7f0e25973740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cd8052dc00 con 0x55cd8053b9e0 2024-04-20T21:21:26.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.358+0000 7f0e25973740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cd8044f5e0 con 0x55cd80577670 2024-04-20T21:21:26.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.358+0000 7f0e25973740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55cd8052dee0 con 0x55cd8052d6f0 2024-04-20T21:21:26.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.358+0000 7f0e25973740 10 client.0 _ll_register_callbacks cb 0x55cd801a7ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T21:21:26.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e20c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8057c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e20c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8057c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36544/0 (socket says 172.21.15.71:36544) 2024-04-20T21:21:26.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e20c00640 1 -- 172.21.15.71:0/3636309168 learned_addr learned my addr 172.21.15.71:0/3636309168 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:26.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e1be00640 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8052d6f0 0x55cd80573f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e13400640 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80577670 0x55cd8053e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e20c00640 1 -- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8052d6f0 msgr2=0x55cd80573f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e20c00640 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8052d6f0 0x55cd80573f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e20c00640 1 -- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80577670 msgr2=0x55cd8053e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e20c00640 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80577670 0x55cd8053e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e20c00640 1 -- 172.21.15.71:0/3636309168 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd802726b0 con 0x55cd8053b9e0 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e13400640 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80577670 0x55cd8053e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e20c00640 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8057c550 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0e140899f0 tx=0x7f0e14059310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed365305de33d731 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.359+0000 7f0e08c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e08c00640 1 -- 172.21.15.71:0/3636309168 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14061ba0 con 0x55cd8053b9e0 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e08c00640 1 -- 172.21.15.71:0/3636309168 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0e1405d0d0 con 0x55cd8053b9e0 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e25973740 1 -- 172.21.15.71:0/3636309168 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e0400fc20 con 0x55cd8053b9e0 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e08c00640 1 -- 172.21.15.71:0/3636309168 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f0e1405d2d0 con 0x55cd8053b9e0 2024-04-20T21:21:26.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e25973740 10 client.5688 fetch_fsmap learned FSMap version 17 2024-04-20T21:21:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e25973740 1 -- 172.21.15.71:0/3636309168 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55cd8057ba70 con 0x55cd8053b9e0 2024-04-20T21:21:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e08c00640 1 -- 172.21.15.71:0/3636309168 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0400fc20 con 0x55cd8053b9e0 2024-04-20T21:21:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e08c00640 1 -- 172.21.15.71:0/3636309168 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 17) ==== 3495+0+0 (secure 0 0 0) 0x7f0e140586a0 con 0x55cd8053b9e0 2024-04-20T21:21:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e25973740 10 client.5688 fetch_fsmap finished waiting for FSMap version 17 2024-04-20T21:21:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e25973740 10 client.5688 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-20T21:21:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e25973740 20 client.5688 populate_metadata read hostname 'smithi071' 2024-04-20T21:21:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e25973740 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:6833/3032319028,v1:172.21.15.137:6835/3032319028] conn(0x55cd80551d70 0x55cd805940b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e25973740 4 client.5688 mds_command: new command op to 5505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T21:21:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.360+0000 7f0e25973740 1 -- 172.21.15.71:0/3636309168 --> [v2:172.21.15.137:6833/3032319028,v1:172.21.15.137:6835/3032319028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd804a33f0 con 0x55cd80551d70 2024-04-20T21:21:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.361+0000 7f0e1be00640 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:6833/3032319028,v1:172.21.15.137:6835/3032319028] conn(0x55cd80551d70 0x55cd805940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.362+0000 7f0e1be00640 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:6833/3032319028,v1:172.21.15.137:6835/3032319028] conn(0x55cd80551d70 0x55cd805940b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58decb4f3271d53d server_cookie=e1e7c545e6f55072 in_seq=0 out_seq=0 2024-04-20T21:21:26.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.362+0000 7f0e08c00640 10 client.5688 ms_handle_connect on v2:172.21.15.137:6833/3032319028 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e08c00640 1 -- 172.21.15.71:0/3636309168 <== mds.0 v2:172.21.15.137:6833/3032319028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cd804a33f0 con 0x55cd80551d70 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e08c00640 10 client.5688 handle_command_reply: tid=0 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e25973740 1 client.5688 shutdown 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e25973740 1 -- 172.21.15.71:0/3636309168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 msgr2=0x55cd8057c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e25973740 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8057c550 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0e140899f0 tx=0x7f0e14059310 comp rx=0 tx=0).stop 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e25973740 1 -- 172.21.15.71:0/3636309168 shutdown_connections 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e25973740 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:6833/3032319028,v1:172.21.15.137:6835/3032319028] conn(0x55cd80551d70 0x55cd805940b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e25973740 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8057c550 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e25973740 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80577670 0x55cd8053e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e08c00640 0 client.5688 ms_handle_reset on v2:172.21.15.137:6833/3032319028 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e25973740 1 --2- 172.21.15.71:0/3636309168 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8052d6f0 0x55cd80573f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.364+0000 7f0e25973740 1 -- 172.21.15.71:0/3636309168 >> 172.21.15.71:0/3636309168 conn(0x55cd80529b90 msgr2=0x55cd8052ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.365+0000 7f0e25973740 1 -- 172.21.15.71:0/3636309168 shutdown_connections 2024-04-20T21:21:26.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.365+0000 7f0e25973740 1 -- 172.21.15.71:0/3636309168 wait complete. 2024-04-20T21:21:26.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.365+0000 7f0e25973740 20 client.5688 trim_cache size 0 max 16384 2024-04-20T21:21:26.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.384+0000 7f0e25973740 1 Processor -- start 2024-04-20T21:21:26.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.384+0000 7f0e25973740 1 -- start start 2024-04-20T21:21:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.385+0000 7f0e25973740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8052d6f0 0x55cd8052de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.385+0000 7f0e25973740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8053e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.385+0000 7f0e25973740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80577670 0x55cd8052a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.385+0000 7f0e25973740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c1fc780 con 0x55cd8053b9e0 2024-04-20T21:21:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.385+0000 7f0e25973740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c1fbb20 con 0x55cd80577670 2024-04-20T21:21:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.385+0000 7f0e25973740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c1fc110 con 0x55cd8052d6f0 2024-04-20T21:21:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.385+0000 7f0e13400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8053e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.385+0000 7f0e13400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8053e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36546/0 (socket says 172.21.15.71:36546) 2024-04-20T21:21:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.385+0000 7f0e13400640 1 -- 172.21.15.71:0/4190736860 learned_addr learned my addr 172.21.15.71:0/4190736860 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.386+0000 7f0e1be00640 1 --2- 172.21.15.71:0/4190736860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8052d6f0 0x55cd8052de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.386+0000 7f0e13400640 1 -- 172.21.15.71:0/4190736860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8052d6f0 msgr2=0x55cd8052de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.386+0000 7f0e13400640 1 --2- 172.21.15.71:0/4190736860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8052d6f0 0x55cd8052de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.386+0000 7f0e13400640 1 -- 172.21.15.71:0/4190736860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80577670 msgr2=0x55cd8052a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.386+0000 7f0e13400640 1 --2- 172.21.15.71:0/4190736860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80577670 0x55cd8052a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.386+0000 7f0e13400640 1 -- 172.21.15.71:0/4190736860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd8057a7f0 con 0x55cd8053b9e0 2024-04-20T21:21:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.386+0000 7f0e13400640 1 --2- 172.21.15.71:0/4190736860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8053e140 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400f580 tx=0x7f0e04007070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf9e6bf0d53d0e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.386+0000 7f0e0b400640 1 -- 172.21.15.71:0/4190736860 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04019040 con 0x55cd8053b9e0 2024-04-20T21:21:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.386+0000 7f0e0b400640 1 -- 172.21.15.71:0/4190736860 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e04023070 con 0x55cd8053b9e0 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.386+0000 7f0e0b400640 1 -- 172.21.15.71:0/4190736860 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0401e850 con 0x55cd8053b9e0 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.387+0000 7f0e25973740 1 -- 172.21.15.71:0/4190736860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 msgr2=0x55cd8053e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.387+0000 7f0e25973740 1 --2- 172.21.15.71:0/4190736860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8053e140 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400f580 tx=0x7f0e04007070 comp rx=0 tx=0).stop 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.387+0000 7f0e25973740 1 -- 172.21.15.71:0/4190736860 shutdown_connections 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.387+0000 7f0e25973740 1 --2- 172.21.15.71:0/4190736860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd80577670 0x55cd8052a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.387+0000 7f0e25973740 1 --2- 172.21.15.71:0/4190736860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd8053b9e0 0x55cd8053e140 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.387+0000 7f0e25973740 1 --2- 172.21.15.71:0/4190736860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8052d6f0 0x55cd8052de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.387+0000 7f0e25973740 1 -- 172.21.15.71:0/4190736860 >> 172.21.15.71:0/4190736860 conn(0x55cd80529b90 msgr2=0x55cd80525280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.387+0000 7f0e25973740 1 -- 172.21.15.71:0/4190736860 shutdown_connections 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.387+0000 7f0e25973740 1 -- 172.21.15.71:0/4190736860 wait complete. 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.388+0000 7f0e25973740 1 -- start start 2024-04-20T21:21:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.388+0000 7f0e25973740 1 Processor -- start 2024-04-20T21:21:26.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.389+0000 7f0e25973740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd8052d6f0 0x55cd8058e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.389+0000 7f0e25973740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8053b9e0 0x55cd8052a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.389+0000 7f0e25973740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd80577670 0x55cd8052ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.389+0000 7f0e25973740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cd8053c130 con 0x55cd80577670 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.389+0000 7f0e25973740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cd8057bd50 con 0x55cd8052d6f0 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.389+0000 7f0e25973740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55cd80578610 con 0x55cd8053b9e0 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.389+0000 7f0e25973740 10 client.0 _ll_register_callbacks cb 0x7f0e140554f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.389+0000 7f0e20c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd80577670 0x55cd8052ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.389+0000 7f0e20c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd80577670 0x55cd8052ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36552/0 (socket says 172.21.15.71:36552) 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.389+0000 7f0e20c00640 1 -- 172.21.15.71:0/1057591934 learned_addr learned my addr 172.21.15.71:0/1057591934 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e13400640 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8053b9e0 0x55cd8052a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e20c00640 1 -- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8053b9e0 msgr2=0x55cd8052a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e20c00640 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8053b9e0 0x55cd8052a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e1be00640 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd8052d6f0 0x55cd8058e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e20c00640 1 -- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd8052d6f0 msgr2=0x55cd8058e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e20c00640 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd8052d6f0 0x55cd8058e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e20c00640 1 -- 172.21.15.71:0/1057591934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd8058ec10 con 0x55cd80577670 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e20c00640 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd80577670 0x55cd8052ea20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0e14058f50 tx=0x7f0e1400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c399f39a525208f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e08c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e08c00640 1 -- 172.21.15.71:0/1057591934 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14059020 con 0x55cd80577670 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e08c00640 1 -- 172.21.15.71:0/1057591934 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0e140551b0 con 0x55cd80577670 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e25973740 1 -- 172.21.15.71:0/1057591934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e04023070 con 0x55cd80577670 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e08c00640 1 -- 172.21.15.71:0/1057591934 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f0e1405d600 con 0x55cd80577670 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e25973740 10 client.5694 fetch_fsmap learned FSMap version 17 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.390+0000 7f0e25973740 1 -- 172.21.15.71:0/1057591934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55cd8058ee20 con 0x55cd80577670 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.391+0000 7f0e08c00640 1 -- 172.21.15.71:0/1057591934 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e04023070 con 0x55cd80577670 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.391+0000 7f0e08c00640 1 -- 172.21.15.71:0/1057591934 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 17) ==== 3495+0+0 (secure 0 0 0) 0x7f0e14078b70 con 0x55cd80577670 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.391+0000 7f0e25973740 10 client.5694 fetch_fsmap finished waiting for FSMap version 17 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.391+0000 7f0e25973740 10 client.5694 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.391+0000 7f0e25973740 20 client.5694 populate_metadata read hostname 'smithi071' 2024-04-20T21:21:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.391+0000 7f0e25973740 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:6833/3032319028,v1:172.21.15.137:6835/3032319028] conn(0x55cd80587b00 0x55cd805fb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.391+0000 7f0e25973740 4 client.5694 mds_command: new command op to 5505 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T21:21:26.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.391+0000 7f0e25973740 1 -- 172.21.15.71:0/1057591934 --> [v2:172.21.15.137:6833/3032319028,v1:172.21.15.137:6835/3032319028] -- command(tid 0: {"prefix": "status"}) -- 0x55cd8049d260 con 0x55cd80587b00 2024-04-20T21:21:26.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.391+0000 7f0e1be00640 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:6833/3032319028,v1:172.21.15.137:6835/3032319028] conn(0x55cd80587b00 0x55cd805fb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.392+0000 7f0e1be00640 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:6833/3032319028,v1:172.21.15.137:6835/3032319028] conn(0x55cd80587b00 0x55cd805fb3d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e46ce2923f6df0a5 server_cookie=c9539ef07c846205 in_seq=0 out_seq=0 2024-04-20T21:21:26.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.392+0000 7f0e08c00640 10 client.5694 ms_handle_connect on v2:172.21.15.137:6833/3032319028 2024-04-20T21:21:26.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e08c00640 1 -- 172.21.15.71:0/1057591934 <== mds.0 v2:172.21.15.137:6833/3032319028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55cd8049d260 con 0x55cd80587b00 2024-04-20T21:21:26.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e08c00640 10 client.5694 handle_command_reply: tid=0 2024-04-20T21:21:26.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e25973740 1 client.5694 shutdown 2024-04-20T21:21:26.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e25973740 1 -- 172.21.15.71:0/1057591934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd80577670 msgr2=0x55cd8052ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e25973740 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd80577670 0x55cd8052ea20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0e14058f50 tx=0x7f0e1400c000 comp rx=0 tx=0).stop 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e25973740 1 -- 172.21.15.71:0/1057591934 shutdown_connections 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e25973740 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:6833/3032319028,v1:172.21.15.137:6835/3032319028] conn(0x55cd80587b00 0x55cd805fb3d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e25973740 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cd80577670 0x55cd8052ea20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e25973740 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55cd8053b9e0 0x55cd8052a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e25973740 1 --2- 172.21.15.71:0/1057591934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd8052d6f0 0x55cd8058e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e08c00640 0 client.5694 ms_handle_reset on v2:172.21.15.137:6833/3032319028 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.393+0000 7f0e25973740 1 -- 172.21.15.71:0/1057591934 >> 172.21.15.71:0/1057591934 conn(0x55cd80529b90 msgr2=0x55cd80525280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e25973740 1 -- 172.21.15.71:0/1057591934 shutdown_connections 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e25973740 1 -- 172.21.15.71:0/1057591934 wait complete. 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e25973740 20 client.5694 trim_cache size 0 max 16384 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "da776687-7be6-4259-b098-1ebb1c5bd96b", 2024-04-20T21:21:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2024-04-20T21:21:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5505, 2024-04-20T21:21:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2024-04-20T21:21:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2024-04-20T21:21:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2024-04-20T21:21:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 11.568530908, 2024-04-20T21:21:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 17, 2024-04-20T21:21:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 39, 2024-04-20T21:21:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 39, 2024-04-20T21:21:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 20.412169767999998 2024-04-20T21:21:26.396 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-20T21:21:26.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e21600640 1 -- 172.21.15.71:0/3459347498 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0df806c920 msgr2=0x7f0df806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e21600640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0df806c920 0x7f0df806ede0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00ba00 tx=0x7f0e0c030000 comp rx=0 tx=0).stop 2024-04-20T21:21:26.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e21600640 1 -- 172.21.15.71:0/3459347498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e1c15b490 msgr2=0x7f0e1c1f36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e21600640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e1c15b490 0x7f0e1c1f36e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c050340 tx=0x7f0e14009c10 comp rx=0 tx=0).stop 2024-04-20T21:21:26.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e21600640 1 -- 172.21.15.71:0/3459347498 shutdown_connections 2024-04-20T21:21:26.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e21600640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f0df806c920 0x7f0df806ede0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e21600640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e1c15b490 0x7f0e1c1f36e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e21600640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e1c0b3070 0x7f0e1c15af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e21600640 1 --2- 172.21.15.71:0/3459347498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1c14bd30 0x7f0e1c15f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.394+0000 7f0e21600640 1 -- 172.21.15.71:0/3459347498 >> 172.21.15.71:0/3459347498 conn(0x7f0e1c0d0040 msgr2=0x7f0e1c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:26.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.395+0000 7f0e21600640 1 -- 172.21.15.71:0/3459347498 shutdown_connections 2024-04-20T21:21:26.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.395+0000 7f0e21600640 1 -- 172.21.15.71:0/3459347498 wait complete. 2024-04-20T21:21:26.409 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-20T21:21:26.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.591+0000 7f8951400640 1 Processor -- start 2024-04-20T21:21:26.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.591+0000 7f8951400640 1 -- start start 2024-04-20T21:21:26.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.592+0000 7f8951400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f894c06dcb0 0x7f894c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.592+0000 7f8951400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f894c072090 0x7f894c0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.592+0000 7f8951400640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f894c0ade40 con 0x7f894c15b3b0 2024-04-20T21:21:26.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.592+0000 7f8951400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f894c06f1b0 con 0x7f894c072090 2024-04-20T21:21:26.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.592+0000 7f8951400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f894c0ae0e0 con 0x7f894c06dcb0 2024-04-20T21:21:26.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.593+0000 7f894a800640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f894c15b3b0 0x7f894c06eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56208/0 (socket says 172.21.15.71:56208) 2024-04-20T21:21:26.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.593+0000 7f894a800640 1 -- 172.21.15.71:0/1251281696 learned_addr learned my addr 172.21.15.71:0/1251281696 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:21:26.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.593+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262003247 0 0) 0x7f894c0ade40 con 0x7f894c15b3b0 2024-04-20T21:21:26.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.593+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8930005730 con 0x7f894c15b3b0 2024-04-20T21:21:26.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.593+0000 7f8943e00640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f894c06dcb0 0x7f894c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.593+0000 7f894b200640 1 --2- 172.21.15.71:0/1251281696 >> v2:172.21.15.137:3300/0 conn(0x7f894c072090 0x7f894c0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.593+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2187833307 0 0) 0x7f8930005730 con 0x7f894c15b3b0 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.593+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f894c06dcb0 msgr2=0x7f894c071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.593+0000 7f8949e00640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f894c06dcb0 0x7f894c071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 >> v2:172.21.15.137:3300/0 conn(0x7f894c072090 msgr2=0x7f894c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8949e00640 1 --2- 172.21.15.71:0/1251281696 >> v2:172.21.15.137:3300/0 conn(0x7f894c072090 0x7f894c0d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894c15b790 con 0x7f894c15b3b0 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7f893c001690 con 0x7f894c15b3b0 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 >> v1:172.21.15.71:6789/0 conn(0x7f894c15b3b0 legacy=0x7f894c06eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8949e00640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8930005bc0 0x7f8930005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8949e00640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f894c06dcb0 0x7f8930006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8949e00640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8930006f50 0x7f89300073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f894c06f1b0 con 0x7f8930006f50 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f894c0ae0e0 con 0x7f8930005bc0 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f893000dd00 con 0x7f894c06dcb0 2024-04-20T21:21:26.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f894b200640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8930006f50 0x7f89300073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f8943e00640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f894c06dcb0 0x7f8930006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f894a800640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8930005bc0 0x7f8930005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f894b200640 1 -- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f894c06dcb0 msgr2=0x7f8930006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f894b200640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f894c06dcb0 0x7f8930006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f894b200640 1 -- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8930005bc0 msgr2=0x7f8930005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f894b200640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8930005bc0 0x7f8930005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f894b200640 1 -- 172.21.15.71:0/1251281696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8930005730 con 0x7f8930006f50 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.594+0000 7f894a800640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8930005bc0 0x7f8930005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.595+0000 7f894b200640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8930006f50 0x7f89300073d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8944007330 tx=0x7f8930007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136cd9b7d0e06cc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.596+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944039070 con 0x7f8930006f50 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.596+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894402ccd0 con 0x7f8930006f50 2024-04-20T21:21:26.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.596+0000 7f8949e00640 1 -- 172.21.15.71:0/1251281696 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944009be0 con 0x7f8930006f50 2024-04-20T21:21:26.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.596+0000 7f8951400640 1 -- 172.21.15.71:0/1251281696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8930006f50 msgr2=0x7f89300073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.596+0000 7f8951400640 1 --2- 172.21.15.71:0/1251281696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8930006f50 0x7f89300073d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8944007330 tx=0x7f8930007a40 comp rx=0 tx=0).stop 2024-04-20T21:21:26.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.596+0000 7f894b200640 1 -- 172.21.15.71:0/1251281696 reap_dead start 2024-04-20T21:21:26.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.596+0000 7f8951400640 1 -- 172.21.15.71:0/1251281696 shutdown_connections 2024-04-20T21:21:26.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.596+0000 7f8951400640 1 -- 172.21.15.71:0/1251281696 >> 172.21.15.71:0/1251281696 conn(0x7f894c0b3350 msgr2=0x7f894c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:26.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.596+0000 7f8951400640 1 -- 172.21.15.71:0/1251281696 shutdown_connections 2024-04-20T21:21:26.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.597+0000 7f8951400640 1 -- 172.21.15.71:0/1251281696 wait complete. 2024-04-20T21:21:26.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.598+0000 7f8951400640 1 Processor -- start 2024-04-20T21:21:26.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.598+0000 7f8951400640 1 -- start start 2024-04-20T21:21:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.599+0000 7f8951400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8930006f50 0x7f894c154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.599+0000 7f8951400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f894c152ef0 0x7f894c15e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.599+0000 7f8951400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f894c13f180 0x7f894c13f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.599+0000 7f8951400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f894c0ae940 con 0x7f894c152ef0 2024-04-20T21:21:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.599+0000 7f8951400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f894c0ae6a0 con 0x7f894c13f180 2024-04-20T21:21:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.599+0000 7f8951400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f894c0aec20 con 0x7f8930006f50 2024-04-20T21:21:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.600+0000 7f8943e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f894c152ef0 0x7f894c15e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.600+0000 7f8943e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f894c152ef0 0x7f894c15e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36562/0 (socket says 172.21.15.71:36562) 2024-04-20T21:21:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.600+0000 7f8943e00640 1 -- 172.21.15.71:0/1661272670 learned_addr learned my addr 172.21.15.71:0/1661272670 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:21:26.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.600+0000 7f8943e00640 1 -- 172.21.15.71:0/1661272670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8930006f50 msgr2=0x7f894c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.600+0000 7f8943e00640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8930006f50 0x7f894c154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.600+0000 7f8943e00640 1 -- 172.21.15.71:0/1661272670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f894c13f180 msgr2=0x7f894c13f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.600+0000 7f8943e00640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f894c13f180 0x7f894c13f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.600+0000 7f8943e00640 1 -- 172.21.15.71:0/1661272670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894c15e8f0 con 0x7f894c152ef0 2024-04-20T21:21:26.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.600+0000 7f8943e00640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f894c152ef0 0x7f894c15e3b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f893400f5a0 tx=0x7f893400fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:26.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.600+0000 7f8942a00640 1 -- 172.21.15.71:0/1661272670 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934019030 con 0x7f894c152ef0 2024-04-20T21:21:26.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.601+0000 7f8942a00640 1 -- 172.21.15.71:0/1661272670 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8934004020 con 0x7f894c152ef0 2024-04-20T21:21:26.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.601+0000 7f8942a00640 1 -- 172.21.15.71:0/1661272670 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934004410 con 0x7f894c152ef0 2024-04-20T21:21:26.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.601+0000 7f8951400640 1 -- 172.21.15.71:0/1661272670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f894c1533b0 con 0x7f894c152ef0 2024-04-20T21:21:26.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.601+0000 7f8951400640 1 -- 172.21.15.71:0/1661272670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f894c153970 con 0x7f894c152ef0 2024-04-20T21:21:26.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.602+0000 7f8951400640 1 -- 172.21.15.71:0/1661272670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f894c157430 con 0x7f894c152ef0 2024-04-20T21:21:26.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.603+0000 7f8942a00640 1 -- 172.21.15.71:0/1661272670 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f893401c070 con 0x7f894c152ef0 2024-04-20T21:21:26.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.604+0000 7f8942a00640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f892806c860 0x7f892806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:21:26.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.604+0000 7f8942a00640 1 -- 172.21.15.71:0/1661272670 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f893408c0b0 con 0x7f894c152ef0 2024-04-20T21:21:26.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.604+0000 7f894a800640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f892806c860 0x7f892806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:21:26.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.604+0000 7f894a800640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f892806c860 0x7f892806ed20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f894c0ae010 tx=0x7f893c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:21:26.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.608+0000 7f8942a00640 1 -- 172.21.15.71:0/1661272670 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f894c157430 con 0x7f894c152ef0 2024-04-20T21:21:26.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.851+0000 7f8951400640 1 -- 172.21.15.71:0/1661272670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f894c15fc70 con 0x7f894c152ef0 2024-04-20T21:21:26.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.852+0000 7f8942a00640 1 -- 172.21.15.71:0/1661272670 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f893405a330 con 0x7f894c152ef0 2024-04-20T21:21:26.851 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-20T21:21:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.854+0000 7f8951400640 1 -- 172.21.15.71:0/1661272670 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f892806c860 msgr2=0x7f892806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.854+0000 7f8951400640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f892806c860 0x7f892806ed20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f894c0ae010 tx=0x7f893c009040 comp rx=0 tx=0).stop 2024-04-20T21:21:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.854+0000 7f8951400640 1 -- 172.21.15.71:0/1661272670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f894c152ef0 msgr2=0x7f894c15e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:21:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.854+0000 7f8951400640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f894c152ef0 0x7f894c15e3b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f893400f5a0 tx=0x7f893400fa60 comp rx=0 tx=0).stop 2024-04-20T21:21:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.854+0000 7f8951400640 1 -- 172.21.15.71:0/1661272670 shutdown_connections 2024-04-20T21:21:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.854+0000 7f8951400640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7f892806c860 0x7f892806ed20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.854+0000 7f8951400640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f894c13f180 0x7f894c13f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.854+0000 7f8951400640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f894c152ef0 0x7f894c15e3b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.854+0000 7f8951400640 1 --2- 172.21.15.71:0/1661272670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8930006f50 0x7f894c154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:21:26.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.854+0000 7f8951400640 1 -- 172.21.15.71:0/1661272670 >> 172.21.15.71:0/1661272670 conn(0x7f894c0b3350 msgr2=0x7f894c072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:21:26.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.854+0000 7f8951400640 1 -- 172.21.15.71:0/1661272670 shutdown_connections 2024-04-20T21:21:26.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:26.855+0000 7f8951400640 1 -- 172.21.15.71:0/1661272670 wait complete. 2024-04-20T21:21:26.871 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-20T21:21:26.871 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T21:21:26.872 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-04-20T21:21:26.872 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-20T21:21:26.872 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-20T21:21:26.872 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-20T21:21:26.872 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T21:21:26.872 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T21:21:26.872 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-20T21:21:26.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:26.872 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-04-20T21:21:26.922 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:21:26.923 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42499sec preferred_lft 42499sec 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 1e:98:41:14:ed:dd brd ff:ff:ff:ff:ff:ff 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::3047:a7ff:fe3a:dca4/64 scope link 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 1e:98:41:14:ed:dd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::1c98:41ff:fe14:eddd/64 scope link 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:21:26.924 INFO:teuthology.orchestra.run.smithi071.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-20T21:21:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ee:2b:32:c9:79:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-20T21:21:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec2b:32ff:fec9:79a2/64 scope link 2024-04-20T21:21:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:21:26.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:26.926 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T21:21:27.004 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-04-20T21:21:27.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:27.009 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-04-20T21:21:27.062 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-04-20T21:21:27.062 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T21:21:27.063 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T21:21:27.063 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T21:21:27.063 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T21:21:27.063 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:21:27.063 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-04-20T21:21:27.063 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T21:21:27.063 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T21:21:27.063 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T21:21:27.063 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-04-20T21:21:27.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:21:27.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:21:27.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:27.267 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-04-20T21:21:27.310 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-20T21:21:27.310 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-20T21:21:27.313 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-20T21:21:27.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:27.313 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2024-04-20T21:21:27.433 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-20T21:21:27.433 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:21:27.433 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-20T21:21:27.486 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-20T21:21:27.486 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:21:27.487 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-20T21:21:27.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2024-04-20T21:21:27.623 DEBUG:teuthology.orchestra.run.smithi071:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:21:27.680 INFO:teuthology.orchestra.run.smithi071.stdout:/proc 2024-04-20T21:21:27.680 INFO:teuthology.orchestra.run.smithi071.stdout:/sys 2024-04-20T21:21:27.680 INFO:teuthology.orchestra.run.smithi071.stdout:/dev 2024-04-20T21:21:27.680 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/security 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/shm 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/pts 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/run 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/cgroup 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/pstore 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/bpf 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/ 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/selinux 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/mqueue 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/hugepages 2024-04-20T21:21:27.681 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/debug 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/tracing 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/fuse/connections 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/config 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/1000 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-0 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-1 2024-04-20T21:21:27.682 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-2 2024-04-20T21:21:27.683 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-3 2024-04-20T21:21:27.683 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns 2024-04-20T21:21:27.683 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:21:27.683 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:21:27.683 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-20T21:21:27.683 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-20T21:21:27.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:27.684 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2024-04-20T21:21:27.733 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-20T21:21:27.733 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-20T21:21:27.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2024-04-20T21:21:27.803 DEBUG:teuthology.orchestra.run.smithi071:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:21:27.845 INFO:teuthology.orchestra.run.smithi071.stdout:/proc 2024-04-20T21:21:27.845 INFO:teuthology.orchestra.run.smithi071.stdout:/sys 2024-04-20T21:21:27.845 INFO:teuthology.orchestra.run.smithi071.stdout:/dev 2024-04-20T21:21:27.845 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/security 2024-04-20T21:21:27.845 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/shm 2024-04-20T21:21:27.845 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/pts 2024-04-20T21:21:27.845 INFO:teuthology.orchestra.run.smithi071.stdout:/run 2024-04-20T21:21:27.845 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/cgroup 2024-04-20T21:21:27.845 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/pstore 2024-04-20T21:21:27.845 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/bpf 2024-04-20T21:21:27.845 INFO:teuthology.orchestra.run.smithi071.stdout:/ 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/selinux 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/mqueue 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/hugepages 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/debug 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/tracing 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/fuse/connections 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/config 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:21:27.846 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/1000 2024-04-20T21:21:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph 2024-04-20T21:21:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-0 2024-04-20T21:21:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-1 2024-04-20T21:21:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-2 2024-04-20T21:21:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph/osd/ceph-3 2024-04-20T21:21:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns 2024-04-20T21:21:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:21:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:21:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-20T21:21:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-20T21:21:27.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:27.848 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2024-04-20T21:21:27.907 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2024-04-20T21:21:27.907+0000 7fbde723a480 -1 init, newargv = 0x561d6cde5f90 newargc=15 2024-04-20T21:21:27.907 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[39695]: starting ceph client 2024-04-20T21:21:27.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[39695]: starting fuse 2024-04-20T21:21:27.934 INFO:teuthology.orchestra.run.smithi071.stdout:42 2024-04-20T21:21:27.934 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-20T21:21:27.934 DEBUG:teuthology.orchestra.run.smithi071:> sudo stdin-killer -- python3 -c ' 2024-04-20T21:21:27.935 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2024-04-20T21:21:27.935 DEBUG:teuthology.orchestra.run.smithi071:> import re 2024-04-20T21:21:27.935 DEBUG:teuthology.orchestra.run.smithi071:> import os 2024-04-20T21:21:27.935 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2024-04-20T21:21:27.935 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:21:27.935 DEBUG:teuthology.orchestra.run.smithi071:> def _find_admin_socket(client_name): 2024-04-20T21:21:27.935 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-20T21:21:27.935 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2024-04-20T21:21:27.935 DEBUG:teuthology.orchestra.run.smithi071:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-20T21:21:27.935 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:21:27.935 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> contents = proc_f.read() 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> if mountpoint in contents: 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> return f 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> 2024-04-20T21:21:27.936 DEBUG:teuthology.orchestra.run.smithi071:> print(_find_admin_socket("client.0")) 2024-04-20T21:21:27.937 DEBUG:teuthology.orchestra.run.smithi071:> ' 2024-04-20T21:21:28.120 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.39695.asok 2024-04-20T21:21:28.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:21:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:21:28.137 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39695.asok 2024-04-20T21:21:28.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:28.137 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39695.asok status 2024-04-20T21:21:28.366 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-20T21:21:28.366 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2024-04-20T21:21:28.366 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-20T21:21:28.366 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "39695", 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5706, 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 5706 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-20T21:21:28.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2819570292 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2819570292 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.5706 192.168.0.1:0/2819570292", 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "192.168.0.1:0/2819570292", 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 17, 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 39, 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklisted": false, 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2024-04-20T21:21:28.368 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-20T21:21:28.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:28.381 DEBUG:teuthology.orchestra.run.smithi071:> stat --file-system '--printf=%T 2024-04-20T21:21:28.381 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-20T21:21:28.430 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2024-04-20T21:21:28.430 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-20T21:21:28.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:28.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-20T21:21:28.513 DEBUG:teuthology.orchestra.run.smithi071:> mktemp -d --suffix=xfstests-dev 2024-04-20T21:21:28.564 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.fxhob2prpHxfstests-dev 2024-04-20T21:21:28.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:28.564 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.fxhob2prpHxfstests-dev) 2024-04-20T21:21:28.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:28.650 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.fxhob2prpHxfstests-dev) 2024-04-20T21:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:Cloning into '/tmp/tmp.fxhob2prpHxfstests-dev'... 2024-04-20T21:21:29.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:29.860 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-04-20T21:21:29.931 DEBUG:teuthology.orchestra.run.smithi071:> mktemp -d --suffix=test 2024-04-20T21:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.8yh8DCdvNntest 2024-04-20T21:21:29.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:21:29.979 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-04-20T21:21:30.078 DEBUG:teuthology.orchestra.run.smithi071:> mktemp -d --suffix=scratch 2024-04-20T21:21:30.117 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.CIj1YWiHS0scratch 2024-04-20T21:21:30.117 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-04-20T21:21:30.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-04-20T21:21:30.969 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:06:46 ago on Sat 20 Apr 2024 09:14:44 PM UTC. 2024-04-20T21:21:31.060 INFO:teuthology.orchestra.run.smithi071.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-04-20T21:21:31.061 INFO:teuthology.orchestra.run.smithi071.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-04-20T21:21:31.062 INFO:teuthology.orchestra.run.smithi071.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-04-20T21:21:31.062 INFO:teuthology.orchestra.run.smithi071.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-04-20T21:21:31.063 INFO:teuthology.orchestra.run.smithi071.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-04-20T21:21:31.065 INFO:teuthology.orchestra.run.smithi071.stdout:Package e2fsprogs-1.46.5-5.el9.x86_64 is already installed. 2024-04-20T21:21:31.067 INFO:teuthology.orchestra.run.smithi071.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-04-20T21:21:31.067 INFO:teuthology.orchestra.run.smithi071.stdout:Package gcc-11.4.1-3.el9.x86_64 is already installed. 2024-04-20T21:21:31.069 INFO:teuthology.orchestra.run.smithi071.stdout:Package git-2.43.0-1.el9.x86_64 is already installed. 2024-04-20T21:21:31.071 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-20T21:21:31.072 INFO:teuthology.orchestra.run.smithi071.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-04-20T21:21:31.074 INFO:teuthology.orchestra.run.smithi071.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-04-20T21:21:31.075 INFO:teuthology.orchestra.run.smithi071.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-04-20T21:21:31.076 INFO:teuthology.orchestra.run.smithi071.stdout:Package lvm2-9:2.03.23-2.el9.x86_64 is already installed. 2024-04-20T21:21:31.077 INFO:teuthology.orchestra.run.smithi071.stdout:Package make-1:4.3-8.el9.x86_64 is already installed. 2024-04-20T21:21:31.078 INFO:teuthology.orchestra.run.smithi071.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-04-20T21:21:31.078 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-3.9.18-3.el9.x86_64 is already installed. 2024-04-20T21:21:31.079 INFO:teuthology.orchestra.run.smithi071.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-04-20T21:21:31.080 INFO:teuthology.orchestra.run.smithi071.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-04-20T21:21:31.082 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-20T21:21:31.128 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-04-20T21:21:31.130 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-04-20T21:21:31.130 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-04-20T21:21:31.130 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-04-20T21:21:31.130 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-04-20T21:21:31.130 INFO:teuthology.orchestra.run.smithi071.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-04-20T21:21:31.130 INFO:teuthology.orchestra.run.smithi071.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2024-04-20T21:21:31.130 INFO:teuthology.orchestra.run.smithi071.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-04-20T21:21:31.131 INFO:teuthology.orchestra.run.smithi071.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-04-20T21:21:31.131 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-devel x86_64 5.14.0-437.el9 appstream 16 M 2024-04-20T21:21:31.131 INFO:teuthology.orchestra.run.smithi071.stdout: libcap-devel x86_64 2.48-9.el9 appstream 41 k 2024-04-20T21:21:31.131 INFO:teuthology.orchestra.run.smithi071.stdout: sqlite x86_64 3.34.1-7.el9 appstream 748 k 2024-04-20T21:21:31.131 INFO:teuthology.orchestra.run.smithi071.stdout: udftools x86_64 2.2-5.el9 appstream 149 k 2024-04-20T21:21:31.131 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-04-20T21:21:31.131 INFO:teuthology.orchestra.run.smithi071.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-04-20T21:21:31.131 INFO:teuthology.orchestra.run.smithi071.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-04-20T21:21:31.131 INFO:teuthology.orchestra.run.smithi071.stdout: rmt x86_64 2:1.6-6.el9 baseos 46 k 2024-04-20T21:21:31.131 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-04-20T21:21:31.131 INFO:teuthology.orchestra.run.smithi071.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2024-04-20T21:21:31.132 INFO:teuthology.orchestra.run.smithi071.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2024-04-20T21:21:31.132 INFO:teuthology.orchestra.run.smithi071.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2024-04-20T21:21:31.132 INFO:teuthology.orchestra.run.smithi071.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2024-04-20T21:21:31.132 INFO:teuthology.orchestra.run.smithi071.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2024-04-20T21:21:31.132 INFO:teuthology.orchestra.run.smithi071.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2024-04-20T21:21:31.132 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:31.132 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-04-20T21:21:31.132 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-04-20T21:21:31.132 INFO:teuthology.orchestra.run.smithi071.stdout:Install 17 Packages 2024-04-20T21:21:31.132 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:21:31.133 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 24 M 2024-04-20T21:21:31.133 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 78 M 2024-04-20T21:21:31.133 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-04-20T21:21:31.989 INFO:teuthology.orchestra.run.smithi071.stdout:(1/17): rmt-1.6-6.el9.x86_64.rpm 241 kB/s | 46 kB 00:00 2024-04-20T21:21:32.031 INFO:teuthology.orchestra.run.smithi071.stdout:(2/17): fio-engine-http-3.35-1.el9.x86_64.rpm 78 kB/s | 18 kB 00:00 2024-04-20T21:21:32.081 INFO:teuthology.orchestra.run.smithi071.stdout:(3/17): fio-engine-nbd-3.35-1.el9.x86_64.rpm 297 kB/s | 15 kB 00:00 2024-04-20T21:21:32.107 INFO:teuthology.orchestra.run.smithi071.stdout:(4/17): fio-engine-libaio-3.35-1.el9.x86_64.rpm 134 kB/s | 16 kB 00:00 2024-04-20T21:21:32.132 INFO:teuthology.orchestra.run.smithi071.stdout:(5/17): fio-engine-rados-3.35-1.el9.x86_64.rpm 317 kB/s | 16 kB 00:00 2024-04-20T21:21:32.182 INFO:teuthology.orchestra.run.smithi071.stdout:(6/17): fio-engine-rbd-3.35-1.el9.x86_64.rpm 218 kB/s | 16 kB 00:00 2024-04-20T21:21:32.207 INFO:teuthology.orchestra.run.smithi071.stdout:(7/17): fio-engine-rdma-3.35-1.el9.x86_64.rpm 276 kB/s | 21 kB 00:00 2024-04-20T21:21:32.300 INFO:teuthology.orchestra.run.smithi071.stdout:(8/17): libcap-devel-2.48-9.el9.x86_64.rpm 446 kB/s | 41 kB 00:00 2024-04-20T21:21:32.400 INFO:teuthology.orchestra.run.smithi071.stdout:(9/17): libnbd-1.18.1-3.el9.x86_64.rpm 1.6 MB/s | 166 kB 00:00 2024-04-20T21:21:32.634 INFO:teuthology.orchestra.run.smithi071.stdout:(10/17): sqlite-3.34.1-7.el9.x86_64.rpm 3.1 MB/s | 748 kB 00:00 2024-04-20T21:21:32.826 INFO:teuthology.orchestra.run.smithi071.stdout:(11/17): udftools-2.2-5.el9.x86_64.rpm 781 kB/s | 149 kB 00:00 2024-04-20T21:21:33.026 INFO:teuthology.orchestra.run.smithi071.stdout:(12/17): fio-3.35-1.el9.x86_64.rpm 5.1 MB/s | 6.2 MB 00:01 2024-04-20T21:21:33.151 INFO:teuthology.orchestra.run.smithi071.stdout:(13/17): gdbm-1.19-4.el9.x86_64.rpm 408 kB/s | 132 kB 00:00 2024-04-20T21:21:33.193 INFO:teuthology.orchestra.run.smithi071.stdout:(14/17): gdbm-devel-1.19-4.el9.x86_64.rpm 354 kB/s | 59 kB 00:00 2024-04-20T21:21:33.377 INFO:teuthology.orchestra.run.smithi071.stdout:(15/17): dump-0.4-0.51.b47.el9.x86_64.rpm 392 kB/s | 88 kB 00:00 2024-04-20T21:21:33.444 INFO:teuthology.orchestra.run.smithi071.stdout:(16/17): indent-2.2.13-5.el9.x86_64.rpm 720 kB/s | 179 kB 00:00 2024-04-20T21:21:34.236 INFO:teuthology.orchestra.run.smithi071.stdout:(17/17): kernel-devel-5.14.0-437.el9.x86_64.rpm 7.7 MB/s | 16 MB 00:02 2024-04-20T21:21:34.236 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:21:34.237 INFO:teuthology.orchestra.run.smithi071.stdout:Total 7.6 MB/s | 24 MB 00:03 2024-04-20T21:21:34.939 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-04-20T21:21:35.062 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-04-20T21:21:35.062 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-04-20T21:21:35.872 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-04-20T21:21:35.873 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-04-20T21:21:37.042 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-04-20T21:21:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 1/17 2024-04-20T21:21:37.209 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 2/17 2024-04-20T21:21:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 3/17 2024-04-20T21:21:37.277 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 4/17 2024-04-20T21:21:37.319 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 5/17 2024-04-20T21:21:37.353 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 6/17 2024-04-20T21:21:37.386 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 7/17 2024-04-20T21:21:37.635 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 8/17 2024-04-20T21:21:37.691 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fio-3.35-1.el9.x86_64 9/17 2024-04-20T21:21:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rmt-2:1.6-6.el9.x86_64 10/17 2024-04-20T21:21:37.778 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 11/17 2024-04-20T21:21:37.863 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 12/17 2024-04-20T21:21:37.925 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : indent-2.2.13-5.el9.x86_64 13/17 2024-04-20T21:21:37.977 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : udftools-2.2-5.el9.x86_64 14/17 2024-04-20T21:21:38.066 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 15/17 2024-04-20T21:21:49.484 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 16/17 2024-04-20T21:21:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-devel-5.14.0-437.el9.x86_64 17/17 2024-04-20T21:21:53.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:21:53.090 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:22:23.231 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:22:23.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:22:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-devel-5.14.0-437.el9.x86_64 17/17 2024-04-20T21:22:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 1/17 2024-04-20T21:22:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fio-3.35-1.el9.x86_64 2/17 2024-04-20T21:22:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 3/17 2024-04-20T21:22:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 4/17 2024-04-20T21:22:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 5/17 2024-04-20T21:22:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 6/17 2024-04-20T21:22:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 7/17 2024-04-20T21:22:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 8/17 2024-04-20T21:22:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-devel-5.14.0-437.el9.x86_64 9/17 2024-04-20T21:22:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/17 2024-04-20T21:22:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 11/17 2024-04-20T21:22:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 12/17 2024-04-20T21:22:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : udftools-2.2-5.el9.x86_64 13/17 2024-04-20T21:22:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/17 2024-04-20T21:22:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/17 2024-04-20T21:22:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/17 2024-04-20T21:22:40.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/17 2024-04-20T21:22:40.512 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:22:40.512 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-04-20T21:22:40.512 INFO:teuthology.orchestra.run.smithi071.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-04-20T21:22:40.513 INFO:teuthology.orchestra.run.smithi071.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-04-20T21:22:40.513 INFO:teuthology.orchestra.run.smithi071.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-04-20T21:22:40.513 INFO:teuthology.orchestra.run.smithi071.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-04-20T21:22:40.513 INFO:teuthology.orchestra.run.smithi071.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-04-20T21:22:40.513 INFO:teuthology.orchestra.run.smithi071.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-437.el9.x86_64 2024-04-20T21:22:40.513 INFO:teuthology.orchestra.run.smithi071.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-04-20T21:22:40.513 INFO:teuthology.orchestra.run.smithi071.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-04-20T21:22:40.513 INFO:teuthology.orchestra.run.smithi071.stdout: udftools-2.2-5.el9.x86_64 2024-04-20T21:22:40.513 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:22:40.513 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-04-20T21:22:40.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo useradd -m fsgqa 2024-04-20T21:22:41.020 INFO:teuthology.orchestra.run.smithi071.stderr:useradd: user 'fsgqa' already exists 2024-04-20T21:22:41.023 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-04-20T21:22:41.024 DEBUG:teuthology.orchestra.run.smithi071:> sudo groupadd fsgqa 2024-04-20T21:22:41.083 INFO:teuthology.orchestra.run.smithi071.stderr:groupadd: group 'fsgqa' already exists 2024-04-20T21:22:41.085 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-04-20T21:22:41.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo useradd fsgqa2 2024-04-20T21:22:41.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo useradd 123456-fsgqa 2024-04-20T21:22:42.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-04-20T21:22:42.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.544+0000 7fa086c00640 1 Processor -- start 2024-04-20T21:22:42.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.545+0000 7fa086c00640 1 -- start start 2024-04-20T21:22:42.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.546+0000 7fa086c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa080159e10 0x7fa080071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:42.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.546+0000 7fa086c00640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa080160e50 con 0x7fa08006da90 2024-04-20T21:22:42.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.546+0000 7fa086c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa08015cc90 con 0x7fa08015a1f0 2024-04-20T21:22:42.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.546+0000 7fa086c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa080072900 con 0x7fa080159e10 2024-04-20T21:22:42.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.546+0000 7fa086200640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa08006da90 0x7fa080160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33128/0 (socket says 172.21.15.71:33128) 2024-04-20T21:22:42.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.546+0000 7fa086200640 1 -- 172.21.15.71:0/2663807504 learned_addr learned my addr 172.21.15.71:0/2663807504 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-04-20T21:22:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.547+0000 7fa085800640 1 --2- 172.21.15.71:0/2663807504 >> v2:172.21.15.137:3300/0 conn(0x7fa080159e10 0x7fa080071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.547+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 108496002 0 0) 0x7fa080160e50 con 0x7fa08006da90 2024-04-20T21:22:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.547+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa068003520 con 0x7fa08006da90 2024-04-20T21:22:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.547+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1013611546 0 0) 0x7fa068003520 con 0x7fa08006da90 2024-04-20T21:22:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.547+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 >> v2:172.21.15.137:3300/0 conn(0x7fa080159e10 msgr2=0x7fa080071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:22:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.547+0000 7fa07fe00640 1 --2- 172.21.15.71:0/2663807504 >> v2:172.21.15.137:3300/0 conn(0x7fa080159e10 0x7fa080071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.547+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 >> v1:172.21.15.137:6789/0 conn(0x7fa08015a1f0 legacy=0x7fa080160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.547+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08015cf70 con 0x7fa08006da90 2024-04-20T21:22:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.547+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2762474782 0 0) 0x7fa0780019f0 con 0x7fa08006da90 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.547+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 >> v1:172.21.15.71:6789/0 conn(0x7fa08006da90 legacy=0x7fa080160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa07fe00640 1 --2- 172.21.15.71:0/2663807504 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0680039b0 0x7fa068003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa07fe00640 1 --2- 172.21.15.71:0/2663807504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa068004800 0x7fa068004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa07fe00640 1 --2- 172.21.15.71:0/2663807504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 0x7fa06800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa06800c030 con 0x7fa0680051c0 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa06800c1e0 con 0x7fa068004800 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa06800c3e0 con 0x7fa0680039b0 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa086200640 1 --2- 172.21.15.71:0/2663807504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 0x7fa06800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa085800640 1 --2- 172.21.15.71:0/2663807504 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0680039b0 0x7fa068003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa086200640 1 -- 172.21.15.71:0/2663807504 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0680039b0 msgr2=0x7fa068003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa086200640 1 --2- 172.21.15.71:0/2663807504 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0680039b0 0x7fa068003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa086200640 1 -- 172.21.15.71:0/2663807504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa068004800 msgr2=0x7fa068004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa086200640 1 --2- 172.21.15.71:0/2663807504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa068004800 0x7fa068004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa086200640 1 -- 172.21.15.71:0/2663807504 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa068003520 con 0x7fa0680051c0 2024-04-20T21:22:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.548+0000 7fa085800640 1 --2- 172.21.15.71:0/2663807504 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0680039b0 0x7fa068003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:22:42.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.549+0000 7fa086200640 1 -- 172.21.15.71:0/2663807504 reap_dead start 2024-04-20T21:22:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.549+0000 7fa086200640 1 --2- 172.21.15.71:0/2663807504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 0x7fa06800b9c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa07800a860 tx=0x7fa068005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44728d2667940b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:22:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.550+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07800a480 con 0x7fa0680051c0 2024-04-20T21:22:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.550+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa078034630 con 0x7fa0680051c0 2024-04-20T21:22:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.550+0000 7fa07fe00640 1 -- 172.21.15.71:0/2663807504 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078034a00 con 0x7fa0680051c0 2024-04-20T21:22:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.550+0000 7fa086c00640 1 -- 172.21.15.71:0/2663807504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 msgr2=0x7fa06800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.550+0000 7fa086c00640 1 --2- 172.21.15.71:0/2663807504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 0x7fa06800b9c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa07800a860 tx=0x7fa068005830 comp rx=0 tx=0).stop 2024-04-20T21:22:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.550+0000 7fa086c00640 1 -- 172.21.15.71:0/2663807504 shutdown_connections 2024-04-20T21:22:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.550+0000 7fa086c00640 1 --2- 172.21.15.71:0/2663807504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 0x7fa06800b9c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.550+0000 7fa086c00640 1 -- 172.21.15.71:0/2663807504 >> 172.21.15.71:0/2663807504 conn(0x7fa0800d0040 msgr2=0x7fa0800d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:22:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.551+0000 7fa086c00640 1 -- 172.21.15.71:0/2663807504 shutdown_connections 2024-04-20T21:22:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.551+0000 7fa086c00640 1 -- 172.21.15.71:0/2663807504 wait complete. 2024-04-20T21:22:42.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.552+0000 7fa086c00640 1 Processor -- start 2024-04-20T21:22:42.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.553+0000 7fa086c00640 1 -- start start 2024-04-20T21:22:42.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa086c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 0x7fa08015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:42.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa086c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0800b40c0 0x7fa0800b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:42.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa086c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08015b4f0 0x7fa08015b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:42.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa086c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa08015d530 con 0x7fa0680051c0 2024-04-20T21:22:42.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa086c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa08015ca40 con 0x7fa0800b40c0 2024-04-20T21:22:42.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa086c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa08015d810 con 0x7fa08015b4f0 2024-04-20T21:22:42.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa085800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 0x7fa08015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:42.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa085800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 0x7fa08015f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55702/0 (socket says 172.21.15.71:55702) 2024-04-20T21:22:42.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa085800640 1 -- 172.21.15.71:0/1518877578 learned_addr learned my addr 172.21.15.71:0/1518877578 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:22:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa084e00640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0800b40c0 0x7fa0800b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa086200640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08015b4f0 0x7fa08015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa085800640 1 -- 172.21.15.71:0/1518877578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08015b4f0 msgr2=0x7fa08015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa085800640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08015b4f0 0x7fa08015b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa085800640 1 -- 172.21.15.71:0/1518877578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0800b40c0 msgr2=0x7fa0800b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa085800640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0800b40c0 0x7fa0800b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa085800640 1 -- 172.21.15.71:0/1518877578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa080149660 con 0x7fa0680051c0 2024-04-20T21:22:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa086200640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08015b4f0 0x7fa08015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:22:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.554+0000 7fa084e00640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0800b40c0 0x7fa0800b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:22:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.555+0000 7fa085800640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 0x7fa08015f6d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa0740108b0 tx=0x7fa074010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:22:42.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.555+0000 7fa07d600640 1 -- 172.21.15.71:0/1518877578 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07400f040 con 0x7fa0680051c0 2024-04-20T21:22:42.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.555+0000 7fa07d600640 1 -- 172.21.15.71:0/1518877578 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07400eb60 con 0x7fa0680051c0 2024-04-20T21:22:42.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.555+0000 7fa07d600640 1 -- 172.21.15.71:0/1518877578 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07401c400 con 0x7fa0680051c0 2024-04-20T21:22:42.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.555+0000 7fa086c00640 1 -- 172.21.15.71:0/1518877578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa080149940 con 0x7fa0680051c0 2024-04-20T21:22:42.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.555+0000 7fa086c00640 1 -- 172.21.15.71:0/1518877578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08015fc10 con 0x7fa0680051c0 2024-04-20T21:22:42.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.557+0000 7fa086c00640 1 -- 172.21.15.71:0/1518877578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa080075b60 con 0x7fa0680051c0 2024-04-20T21:22:42.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.557+0000 7fa07d600640 1 -- 172.21.15.71:0/1518877578 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa07401c5a0 con 0x7fa0680051c0 2024-04-20T21:22:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.559+0000 7fa07d600640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa06006c8f0 0x7fa06006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.559+0000 7fa07d600640 1 -- 172.21.15.71:0/1518877578 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fa07408c420 con 0x7fa0680051c0 2024-04-20T21:22:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.559+0000 7fa084e00640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa06006c8f0 0x7fa06006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:42.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.560+0000 7fa084e00640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa06006c8f0 0x7fa06006edb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa080068cb0 tx=0x7fa06c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:22:42.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.564+0000 7fa07d600640 1 -- 172.21.15.71:0/1518877578 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa074018030 con 0x7fa0680051c0 2024-04-20T21:22:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.864+0000 7fa086c00640 1 -- 172.21.15.71:0/1518877578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa08015c1b0 con 0x7fa0680051c0 2024-04-20T21:22:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.865+0000 7fa07d600640 1 -- 172.21.15.71:0/1518877578 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1285 (secure 0 0 0) 0x7fa07405a690 con 0x7fa0680051c0 2024-04-20T21:22:42.865 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:22:42.865 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":1,"fsid":"da776687-7be6-4259-b098-1ebb1c5bd96b","modified":"2024-04-20T21:18:24.417180Z","created":"2024-04-20T21:18:24.417180Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3301","nonce":0},{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-04-20T21:22:42.865 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 1 2024-04-20T21:22:42.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 -- 172.21.15.71:0/1518877578 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa06006c8f0 msgr2=0x7fa06006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:42.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa06006c8f0 0x7fa06006edb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa080068cb0 tx=0x7fa06c009040 comp rx=0 tx=0).stop 2024-04-20T21:22:42.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 -- 172.21.15.71:0/1518877578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 msgr2=0x7fa08015f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:42.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 0x7fa08015f6d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa0740108b0 tx=0x7fa074010d70 comp rx=0 tx=0).stop 2024-04-20T21:22:42.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 -- 172.21.15.71:0/1518877578 shutdown_connections 2024-04-20T21:22:42.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fa06006c8f0 0x7fa06006edb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:42.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08015b4f0 0x7fa08015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:42.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0800b40c0 0x7fa0800b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:42.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 --2- 172.21.15.71:0/1518877578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0680051c0 0x7fa08015f6d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:42.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 -- 172.21.15.71:0/1518877578 >> 172.21.15.71:0/1518877578 conn(0x7fa0800d0040 msgr2=0x7fa0800afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:22:42.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 -- 172.21.15.71:0/1518877578 shutdown_connections 2024-04-20T21:22:42.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:42.868+0000 7fa086c00640 1 -- 172.21.15.71:0/1518877578 wait complete. 2024-04-20T21:22:42.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2024-04-20T21:22:43.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.085+0000 7fc076400640 1 Processor -- start 2024-04-20T21:22:43.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.085+0000 7fc076400640 1 -- start start 2024-04-20T21:22:43.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.086+0000 7fc076400640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc07006dcb0 0x7fc070071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:43.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.087+0000 7fc076400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc070072090 0x7fc0700d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:43.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.087+0000 7fc076400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0700ade40 con 0x7fc07015b3b0 2024-04-20T21:22:43.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.087+0000 7fc076400640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc07006f1b0 con 0x7fc07006dcb0 2024-04-20T21:22:43.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.087+0000 7fc076400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc0700ae0e0 con 0x7fc070072090 2024-04-20T21:22:43.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.087+0000 7fc067e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc07006dcb0 0x7fc070071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:43.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.087+0000 7fc067e00640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc07006dcb0 0x7fc070071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38966/0 (socket says 172.21.15.71:38966) 2024-04-20T21:22:43.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.087+0000 7fc067e00640 1 -- 172.21.15.71:0/986507172 learned_addr learned my addr 172.21.15.71:0/986507172 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:22:43.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.087+0000 7fc067e00640 1 -- 172.21.15.71:0/986507172 >> v2:172.21.15.137:3300/0 conn(0x7fc070072090 msgr2=0x7fc0700d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:22:43.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.087+0000 7fc067e00640 1 --2- 172.21.15.71:0/986507172 >> v2:172.21.15.137:3300/0 conn(0x7fc070072090 0x7fc0700d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:43.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.087+0000 7fc067e00640 1 -- 172.21.15.71:0/986507172 >> v1:172.21.15.137:6789/0 conn(0x7fc07015b3b0 legacy=0x7fc07006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T21:22:43.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.087+0000 7fc067e00640 1 -- 172.21.15.71:0/986507172 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07015b790 con 0x7fc07006dcb0 2024-04-20T21:22:43.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.089+0000 7fc067e00640 1 --2- 172.21.15.71:0/986507172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc07006dcb0 0x7fc070071b50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc070073c80 tx=0x7fc05802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47a9e5dea7fae15 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:22:43.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.089+0000 7fc06ea00640 1 -- 172.21.15.71:0/986507172 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05803b070 con 0x7fc07006dcb0 2024-04-20T21:22:43.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.089+0000 7fc06ea00640 1 -- 172.21.15.71:0/986507172 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058036440 con 0x7fc07006dcb0 2024-04-20T21:22:43.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.089+0000 7fc06ea00640 1 -- 172.21.15.71:0/986507172 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058036810 con 0x7fc07006dcb0 2024-04-20T21:22:43.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.090+0000 7fc076400640 1 -- 172.21.15.71:0/986507172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc07006dcb0 msgr2=0x7fc070071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:43.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.090+0000 7fc076400640 1 --2- 172.21.15.71:0/986507172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc07006dcb0 0x7fc070071b50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc070073c80 tx=0x7fc05802e0e0 comp rx=0 tx=0).stop 2024-04-20T21:22:43.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.090+0000 7fc076400640 1 -- 172.21.15.71:0/986507172 shutdown_connections 2024-04-20T21:22:43.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.090+0000 7fc076400640 1 --2- 172.21.15.71:0/986507172 >> v2:172.21.15.137:3300/0 conn(0x7fc070072090 0x7fc0700d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:43.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.090+0000 7fc076400640 1 --2- 172.21.15.71:0/986507172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc07006dcb0 0x7fc070071b50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:43.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.090+0000 7fc076400640 1 -- 172.21.15.71:0/986507172 >> 172.21.15.71:0/986507172 conn(0x7fc0700b3350 msgr2=0x7fc0700b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:22:43.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.090+0000 7fc076400640 1 -- 172.21.15.71:0/986507172 shutdown_connections 2024-04-20T21:22:43.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.090+0000 7fc076400640 1 -- 172.21.15.71:0/986507172 wait complete. 2024-04-20T21:22:43.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.092+0000 7fc076400640 1 Processor -- start 2024-04-20T21:22:43.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.092+0000 7fc076400640 1 -- start start 2024-04-20T21:22:43.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc076400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc07006dcb0 0x7fc07014ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:43.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc076400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc07015b3b0 0x7fc07015b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:43.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc076400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc07015d3a0 0x7fc07015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:43.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc076400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc0700aec20 con 0x7fc07015d3a0 2024-04-20T21:22:43.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc076400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0700ae940 con 0x7fc07015b3b0 2024-04-20T21:22:43.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc076400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc0700d08a0 con 0x7fc07006dcb0 2024-04-20T21:22:43.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc06fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc07015d3a0 0x7fc07015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc06fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc07015d3a0 0x7fc07015bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38968/0 (socket says 172.21.15.71:38968) 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc06fe00640 1 -- 172.21.15.71:0/2652383940 learned_addr learned my addr 172.21.15.71:0/2652383940 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc067e00640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc07015b3b0 0x7fc07015b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc06fe00640 1 -- 172.21.15.71:0/2652383940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc07006dcb0 msgr2=0x7fc07014ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.093+0000 7fc06f400640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc07006dcb0 0x7fc07014ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.094+0000 7fc06fe00640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc07006dcb0 0x7fc07014ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.094+0000 7fc06fe00640 1 -- 172.21.15.71:0/2652383940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc07015b3b0 msgr2=0x7fc07015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.094+0000 7fc06fe00640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc07015b3b0 0x7fc07015b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.094+0000 7fc06fe00640 1 -- 172.21.15.71:0/2652383940 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07015d820 con 0x7fc07015d3a0 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.094+0000 7fc06f400640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc07006dcb0 0x7fc07014ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.094+0000 7fc06fe00640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc07015d3a0 0x7fc07015bef0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc06800b9e0 tx=0x7fc06800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:22:43.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.094+0000 7fc067400640 1 -- 172.21.15.71:0/2652383940 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc068019070 con 0x7fc07015d3a0 2024-04-20T21:22:43.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.094+0000 7fc067400640 1 -- 172.21.15.71:0/2652383940 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06800cac0 con 0x7fc07015d3a0 2024-04-20T21:22:43.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.094+0000 7fc076400640 1 -- 172.21.15.71:0/2652383940 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0700af5c0 con 0x7fc07015d3a0 2024-04-20T21:22:43.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.094+0000 7fc067400640 1 -- 172.21.15.71:0/2652383940 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc068014440 con 0x7fc07015d3a0 2024-04-20T21:22:43.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.094+0000 7fc076400640 1 -- 172.21.15.71:0/2652383940 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0700afb80 con 0x7fc07015d3a0 2024-04-20T21:22:43.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.096+0000 7fc076400640 1 -- 172.21.15.71:0/2652383940 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc070068980 con 0x7fc07015d3a0 2024-04-20T21:22:43.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.097+0000 7fc067400640 1 -- 172.21.15.71:0/2652383940 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc06801c070 con 0x7fc07015d3a0 2024-04-20T21:22:43.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.098+0000 7fc067400640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc04c06c8f0 0x7fc04c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:22:43.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.098+0000 7fc067400640 1 -- 172.21.15.71:0/2652383940 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fc06808ba70 con 0x7fc07015d3a0 2024-04-20T21:22:43.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.099+0000 7fc06f400640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc04c06c8f0 0x7fc04c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:22:43.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.099+0000 7fc06f400640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc04c06c8f0 0x7fc04c06edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc06000a810 tx=0x7fc060008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:22:43.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.104+0000 7fc067400640 1 -- 172.21.15.71:0/2652383940 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc068059c50 con 0x7fc07015d3a0 2024-04-20T21:22:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.379+0000 7fc076400640 1 -- 172.21.15.71:0/2652383940 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) -- 0x7fc070074dd0 con 0x7fc07015d3a0 2024-04-20T21:22:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.379+0000 7fc067400640 1 -- 172.21.15.71:0/2652383940 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v11) ==== 82+0+151 (secure 0 0 0) 0x7fc068059550 con 0x7fc07015d3a0 2024-04-20T21:22:43.379 INFO:teuthology.orchestra.run.smithi071.stdout:[client.admin] 2024-04-20T21:22:43.379 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAgMSRmQNyGLhAAqg4+CRXLLBsixKav3co0AQ== 2024-04-20T21:22:43.379 INFO:teuthology.orchestra.run.smithi071.stdout: caps mds = "allow *" 2024-04-20T21:22:43.379 INFO:teuthology.orchestra.run.smithi071.stdout: caps mgr = "allow *" 2024-04-20T21:22:43.379 INFO:teuthology.orchestra.run.smithi071.stdout: caps mon = "allow *" 2024-04-20T21:22:43.379 INFO:teuthology.orchestra.run.smithi071.stdout: caps osd = "allow *" 2024-04-20T21:22:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 -- 172.21.15.71:0/2652383940 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc04c06c8f0 msgr2=0x7fc04c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc04c06c8f0 0x7fc04c06edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc06000a810 tx=0x7fc060008040 comp rx=0 tx=0).stop 2024-04-20T21:22:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 -- 172.21.15.71:0/2652383940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc07015d3a0 msgr2=0x7fc07015bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:22:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc07015d3a0 0x7fc07015bef0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc06800b9e0 tx=0x7fc06800bea0 comp rx=0 tx=0).stop 2024-04-20T21:22:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 -- 172.21.15.71:0/2652383940 shutdown_connections 2024-04-20T21:22:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.71:6832/1511456036,v1:172.21.15.71:6833/1511456036] conn(0x7fc04c06c8f0 0x7fc04c06edb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc07015d3a0 0x7fc07015bef0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc07015b3b0 0x7fc07015b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 --2- 172.21.15.71:0/2652383940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc07006dcb0 0x7fc07014ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:22:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 -- 172.21.15.71:0/2652383940 >> 172.21.15.71:0/2652383940 conn(0x7fc0700b3350 msgr2=0x7fc0700b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:22:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 -- 172.21.15.71:0/2652383940 shutdown_connections 2024-04-20T21:22:43.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-20T21:22:43.382+0000 7fc076400640 1 -- 172.21.15.71:0/2652383940 wait complete. 2024-04-20T21:22:43.399 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-04-20T21:22:43.441 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.E5fJCRW46t 2024-04-20T21:22:43.441 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:22:43.441 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/tmp/tmp.E5fJCRW46t 2024-04-20T21:22:43.521 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:22:43.521 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/tmp/tmp.fxhob2prpHxfstests-dev/local.config 2024-04-20T21:22:43.621 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.8yh8DCdvNntest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.CIj1YWiHS0scratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.71:6789 -k /tmp/tmp.E5fJCRW46t --client_mountpoint /test" 2024-04-20T21:22:43.621 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-20T21:22:43.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/tmp/tmp.fxhob2prpHxfstests-dev/ceph.exclude 2024-04-20T21:22:43.725 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo make) 2024-04-20T21:22:43.843 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize -cfi 2024-04-20T21:22:44.377 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: putting auxiliary files in '.'. 2024-04-20T21:22:44.377 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: copying file './config.guess' 2024-04-20T21:22:44.387 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: copying file './config.sub' 2024-04-20T21:22:44.396 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: copying file './install-sh' 2024-04-20T21:22:44.407 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: copying file './ltmain.sh' 2024-04-20T21:22:44.480 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-04-20T21:22:44.481 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-04-20T21:22:44.494 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-04-20T21:22:44.508 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-04-20T21:22:44.521 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-04-20T21:22:44.535 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-04-20T21:22:44.553 INFO:teuthology.orchestra.run.smithi071.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-04-20T21:22:44.557 INFO:teuthology.orchestra.run.smithi071.stdout:cp include/install-sh . 2024-04-20T21:22:44.559 INFO:teuthology.orchestra.run.smithi071.stdout:aclocal -I m4 2024-04-20T21:22:46.205 INFO:teuthology.orchestra.run.smithi071.stdout:autoheader 2024-04-20T21:22:46.620 INFO:teuthology.orchestra.run.smithi071.stdout:autoconf 2024-04-20T21:22:46.880 INFO:teuthology.orchestra.run.smithi071.stdout:./configure \ 2024-04-20T21:22:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: --libexecdir=/usr/lib \ 2024-04-20T21:22:46.880 INFO:teuthology.orchestra.run.smithi071.stdout: --exec_prefix=/var/lib 2024-04-20T21:22:47.568 INFO:teuthology.orchestra.run.smithi071.stdout:checking build system type... x86_64-pc-linux-gnu 2024-04-20T21:22:47.568 INFO:teuthology.orchestra.run.smithi071.stdout:checking host system type... x86_64-pc-linux-gnu 2024-04-20T21:22:47.573 INFO:teuthology.orchestra.run.smithi071.stdout:checking how to print strings... printf 2024-04-20T21:22:47.573 INFO:teuthology.orchestra.run.smithi071.stdout:checking for gcc... gcc 2024-04-20T21:22:47.759 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether the C compiler works... yes 2024-04-20T21:22:47.759 INFO:teuthology.orchestra.run.smithi071.stdout:checking for C compiler default output file name... a.out 2024-04-20T21:22:47.829 INFO:teuthology.orchestra.run.smithi071.stdout:checking for suffix of executables... 2024-04-20T21:22:47.957 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether we are cross compiling... no 2024-04-20T21:22:48.006 INFO:teuthology.orchestra.run.smithi071.stdout:checking for suffix of object files... o 2024-04-20T21:22:48.047 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether we are using the GNU C compiler... yes 2024-04-20T21:22:48.092 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether gcc accepts -g... yes 2024-04-20T21:22:48.191 INFO:teuthology.orchestra.run.smithi071.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-20T21:22:48.200 INFO:teuthology.orchestra.run.smithi071.stdout:checking for a sed that does not truncate output... /bin/sed 2024-04-20T21:22:48.207 INFO:teuthology.orchestra.run.smithi071.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-04-20T21:22:48.211 INFO:teuthology.orchestra.run.smithi071.stdout:checking for egrep... /bin/grep -E 2024-04-20T21:22:48.215 INFO:teuthology.orchestra.run.smithi071.stdout:checking for fgrep... /bin/grep -F 2024-04-20T21:22:48.227 INFO:teuthology.orchestra.run.smithi071.stdout:checking for ld used by gcc... /bin/ld 2024-04-20T21:22:48.233 INFO:teuthology.orchestra.run.smithi071.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-04-20T21:22:48.246 INFO:teuthology.orchestra.run.smithi071.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-04-20T21:22:49.309 INFO:teuthology.orchestra.run.smithi071.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-04-20T21:22:49.309 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether ln -s works... yes 2024-04-20T21:22:49.342 INFO:teuthology.orchestra.run.smithi071.stdout:checking the maximum length of command line arguments... 1572864 2024-04-20T21:22:49.352 INFO:teuthology.orchestra.run.smithi071.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-04-20T21:22:49.353 INFO:teuthology.orchestra.run.smithi071.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-04-20T21:22:49.353 INFO:teuthology.orchestra.run.smithi071.stdout:checking for /bin/ld option to reload object files... -r 2024-04-20T21:22:49.354 INFO:teuthology.orchestra.run.smithi071.stdout:checking for objdump... objdump 2024-04-20T21:22:49.355 INFO:teuthology.orchestra.run.smithi071.stdout:checking how to recognize dependent libraries... pass_all 2024-04-20T21:22:49.356 INFO:teuthology.orchestra.run.smithi071.stdout:checking for dlltool... no 2024-04-20T21:22:49.356 INFO:teuthology.orchestra.run.smithi071.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-04-20T21:22:49.357 INFO:teuthology.orchestra.run.smithi071.stdout:checking for ar... ar 2024-04-20T21:22:49.463 INFO:teuthology.orchestra.run.smithi071.stdout:checking for archiver @FILE support... @ 2024-04-20T21:22:49.463 INFO:teuthology.orchestra.run.smithi071.stdout:checking for strip... strip 2024-04-20T21:22:49.464 INFO:teuthology.orchestra.run.smithi071.stdout:checking for ranlib... ranlib 2024-04-20T21:22:49.465 INFO:teuthology.orchestra.run.smithi071.stdout:checking for gawk... gawk 2024-04-20T21:22:49.641 INFO:teuthology.orchestra.run.smithi071.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-04-20T21:22:49.645 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sysroot... no 2024-04-20T21:22:49.655 INFO:teuthology.orchestra.run.smithi071.stdout:checking for a working dd... /bin/dd 2024-04-20T21:22:49.665 INFO:teuthology.orchestra.run.smithi071.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-04-20T21:22:49.706 INFO:teuthology.orchestra.run.smithi071.stdout:checking for mt... no 2024-04-20T21:22:49.716 INFO:teuthology.orchestra.run.smithi071.stdout:checking if : is a manifest tool... no 2024-04-20T21:22:49.836 INFO:teuthology.orchestra.run.smithi071.stdout:checking how to run the C preprocessor... gcc -E 2024-04-20T21:22:50.162 INFO:teuthology.orchestra.run.smithi071.stdout:checking for ANSI C header files... yes 2024-04-20T21:22:50.219 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/types.h... yes 2024-04-20T21:22:50.289 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/stat.h... yes 2024-04-20T21:22:50.359 INFO:teuthology.orchestra.run.smithi071.stdout:checking for stdlib.h... yes 2024-04-20T21:22:50.428 INFO:teuthology.orchestra.run.smithi071.stdout:checking for string.h... yes 2024-04-20T21:22:50.501 INFO:teuthology.orchestra.run.smithi071.stdout:checking for memory.h... yes 2024-04-20T21:22:50.572 INFO:teuthology.orchestra.run.smithi071.stdout:checking for strings.h... yes 2024-04-20T21:22:50.646 INFO:teuthology.orchestra.run.smithi071.stdout:checking for inttypes.h... yes 2024-04-20T21:22:50.717 INFO:teuthology.orchestra.run.smithi071.stdout:checking for stdint.h... yes 2024-04-20T21:22:50.801 INFO:teuthology.orchestra.run.smithi071.stdout:checking for unistd.h... yes 2024-04-20T21:22:50.872 INFO:teuthology.orchestra.run.smithi071.stdout:checking for dlfcn.h... yes 2024-04-20T21:22:50.883 INFO:teuthology.orchestra.run.smithi071.stdout:checking for objdir... .libs 2024-04-20T21:22:51.057 INFO:teuthology.orchestra.run.smithi071.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-04-20T21:22:51.057 INFO:teuthology.orchestra.run.smithi071.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-04-20T21:22:51.114 INFO:teuthology.orchestra.run.smithi071.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-04-20T21:22:51.184 INFO:teuthology.orchestra.run.smithi071.stdout:checking if gcc static flag -static works... no 2024-04-20T21:22:51.264 INFO:teuthology.orchestra.run.smithi071.stdout:checking if gcc supports -c -o file.o... yes 2024-04-20T21:22:51.265 INFO:teuthology.orchestra.run.smithi071.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-04-20T21:22:51.289 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-04-20T21:22:51.368 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether -lc should be explicitly linked in... no 2024-04-20T21:22:51.511 INFO:teuthology.orchestra.run.smithi071.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-04-20T21:22:51.511 INFO:teuthology.orchestra.run.smithi071.stdout:checking how to hardcode library paths into programs... immediate 2024-04-20T21:22:51.515 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether stripping libraries is possible... yes 2024-04-20T21:22:51.515 INFO:teuthology.orchestra.run.smithi071.stdout:checking if libtool supports shared libraries... yes 2024-04-20T21:22:51.515 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether to build shared libraries... yes 2024-04-20T21:22:51.516 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether to build static libraries... yes 2024-04-20T21:22:51.531 INFO:teuthology.orchestra.run.smithi071.stdout:checking for gcc... (cached) gcc 2024-04-20T21:22:51.581 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-20T21:22:51.581 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-20T21:22:51.582 INFO:teuthology.orchestra.run.smithi071.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-20T21:22:51.582 INFO:teuthology.orchestra.run.smithi071.stdout:checking for gmake... /usr/bin/gmake 2024-04-20T21:22:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-04-20T21:22:51.583 INFO:teuthology.orchestra.run.smithi071.stdout:checking for tar... /bin/tar 2024-04-20T21:22:51.584 INFO:teuthology.orchestra.run.smithi071.stdout:checking for gzip... /bin/gzip 2024-04-20T21:22:51.634 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether gcc -MM is supported... yes 2024-04-20T21:22:51.635 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sort... /bin/sort 2024-04-20T21:22:51.635 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether ln -s works... yes 2024-04-20T21:22:51.636 INFO:teuthology.orchestra.run.smithi071.stdout:checking for rpm... /bin/rpm 2024-04-20T21:22:51.648 INFO:teuthology.orchestra.run.smithi071.stdout:checking for rpmbuild... no 2024-04-20T21:22:51.715 INFO:teuthology.orchestra.run.smithi071.stdout:checking assert.h usability... yes 2024-04-20T21:22:51.742 INFO:teuthology.orchestra.run.smithi071.stdout:checking assert.h presence... yes 2024-04-20T21:22:51.742 INFO:teuthology.orchestra.run.smithi071.stdout:checking for assert.h... yes 2024-04-20T21:22:51.822 INFO:teuthology.orchestra.run.smithi071.stdout:checking bstring.h usability... no 2024-04-20T21:22:51.856 INFO:teuthology.orchestra.run.smithi071.stdout:checking bstring.h presence... no 2024-04-20T21:22:51.857 INFO:teuthology.orchestra.run.smithi071.stdout:checking for bstring.h... no 2024-04-20T21:22:51.922 INFO:teuthology.orchestra.run.smithi071.stdout:checking libgen.h usability... yes 2024-04-20T21:22:51.950 INFO:teuthology.orchestra.run.smithi071.stdout:checking libgen.h presence... yes 2024-04-20T21:22:51.951 INFO:teuthology.orchestra.run.smithi071.stdout:checking for libgen.h... yes 2024-04-20T21:22:52.066 INFO:teuthology.orchestra.run.smithi071.stdout:checking dirent.h usability... yes 2024-04-20T21:22:52.096 INFO:teuthology.orchestra.run.smithi071.stdout:checking dirent.h presence... yes 2024-04-20T21:22:52.096 INFO:teuthology.orchestra.run.smithi071.stdout:checking for dirent.h... yes 2024-04-20T21:22:52.210 INFO:teuthology.orchestra.run.smithi071.stdout:checking errno.h usability... yes 2024-04-20T21:22:52.239 INFO:teuthology.orchestra.run.smithi071.stdout:checking errno.h presence... yes 2024-04-20T21:22:52.239 INFO:teuthology.orchestra.run.smithi071.stdout:checking for errno.h... yes 2024-04-20T21:22:52.316 INFO:teuthology.orchestra.run.smithi071.stdout:checking malloc.h usability... yes 2024-04-20T21:22:52.345 INFO:teuthology.orchestra.run.smithi071.stdout:checking malloc.h presence... yes 2024-04-20T21:22:52.345 INFO:teuthology.orchestra.run.smithi071.stdout:checking for malloc.h... yes 2024-04-20T21:22:52.427 INFO:teuthology.orchestra.run.smithi071.stdout:checking uuid.h usability... no 2024-04-20T21:22:52.469 INFO:teuthology.orchestra.run.smithi071.stdout:checking uuid.h presence... no 2024-04-20T21:22:52.470 INFO:teuthology.orchestra.run.smithi071.stdout:checking for uuid.h... no 2024-04-20T21:22:52.541 INFO:teuthology.orchestra.run.smithi071.stdout:checking uuid/uuid.h usability... yes 2024-04-20T21:22:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:checking uuid/uuid.h presence... yes 2024-04-20T21:22:52.573 INFO:teuthology.orchestra.run.smithi071.stdout:checking for uuid/uuid.h... yes 2024-04-20T21:22:52.653 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/uuid.h usability... no 2024-04-20T21:22:52.695 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/uuid.h presence... no 2024-04-20T21:22:52.695 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/uuid.h... no 2024-04-20T21:22:52.766 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/file.h usability... yes 2024-04-20T21:22:52.792 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/file.h presence... yes 2024-04-20T21:22:52.792 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/file.h... yes 2024-04-20T21:22:52.878 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/fcntl.h usability... yes 2024-04-20T21:22:52.905 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/fcntl.h presence... yes 2024-04-20T21:22:52.905 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/fcntl.h... yes 2024-04-20T21:22:52.980 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/syssgi.h usability... no 2024-04-20T21:22:53.022 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/syssgi.h presence... no 2024-04-20T21:22:53.022 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/syssgi.h... no 2024-04-20T21:22:53.111 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/param.h usability... yes 2024-04-20T21:22:53.146 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/param.h presence... yes 2024-04-20T21:22:53.146 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/param.h... yes 2024-04-20T21:22:53.165 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/stat.h... (cached) yes 2024-04-20T21:22:53.238 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/statvfs.h usability... yes 2024-04-20T21:22:53.269 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/statvfs.h presence... yes 2024-04-20T21:22:54.151 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/statvfs.h... yes 2024-04-20T21:22:54.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:22:54.157 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/time.h usability... yes 2024-04-20T21:22:54.157 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/time.h presence... yes 2024-04-20T21:22:54.157 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/time.h... yes 2024-04-20T21:22:54.158 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/ioctl.h usability... yes 2024-04-20T21:22:54.158 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/ioctl.h presence... yes 2024-04-20T21:22:54.158 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/ioctl.h... yes 2024-04-20T21:22:54.158 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/wait.h usability... yes 2024-04-20T21:22:54.158 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/wait.h presence... yes 2024-04-20T21:22:54.158 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/wait.h... yes 2024-04-20T21:22:54.158 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/types.h... (cached) yes 2024-04-20T21:22:54.158 INFO:teuthology.orchestra.run.smithi071.stdout:checking for strings.h... (cached) yes 2024-04-20T21:22:54.158 INFO:teuthology.orchestra.run.smithi071.stdout:checking err.h usability... yes 2024-04-20T21:22:54.158 INFO:teuthology.orchestra.run.smithi071.stdout:checking err.h presence... yes 2024-04-20T21:22:54.159 INFO:teuthology.orchestra.run.smithi071.stdout:checking for err.h... yes 2024-04-20T21:22:54.159 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/falloc.h usability... yes 2024-04-20T21:22:54.159 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/falloc.h presence... yes 2024-04-20T21:22:54.159 INFO:teuthology.orchestra.run.smithi071.stdout:checking for linux/falloc.h... yes 2024-04-20T21:22:54.159 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-04-20T21:22:54.159 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-04-20T21:22:54.159 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/fs/xfs_fsops.h... no 2024-04-20T21:22:54.159 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/fs/xfs_itable.h usability... no 2024-04-20T21:22:54.159 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/fs/xfs_itable.h presence... no 2024-04-20T21:22:54.159 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/fs/xfs_itable.h... no 2024-04-20T21:22:54.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:22:54.167 INFO:teuthology.orchestra.run.smithi071.stdout:checking xfs/platform_defs.h usability... no 2024-04-20T21:22:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:checking xfs/platform_defs.h presence... no 2024-04-20T21:22:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:checking for xfs/platform_defs.h... no 2024-04-20T21:22:54.265 INFO:teuthology.orchestra.run.smithi071.stdout:checking btrfs/ioctl.h usability... no 2024-04-20T21:22:54.298 INFO:teuthology.orchestra.run.smithi071.stdout:checking btrfs/ioctl.h presence... no 2024-04-20T21:22:54.298 INFO:teuthology.orchestra.run.smithi071.stdout:checking for btrfs/ioctl.h... no 2024-04-20T21:22:54.364 INFO:teuthology.orchestra.run.smithi071.stdout:checking cifs/ioctl.h usability... no 2024-04-20T21:22:54.406 INFO:teuthology.orchestra.run.smithi071.stdout:checking cifs/ioctl.h presence... no 2024-04-20T21:22:54.406 INFO:teuthology.orchestra.run.smithi071.stdout:checking for cifs/ioctl.h... no 2024-04-20T21:22:54.482 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/mman.h usability... yes 2024-04-20T21:22:54.510 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/mman.h presence... yes 2024-04-20T21:22:54.510 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/mman.h... yes 2024-04-20T21:22:54.587 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/ext4.h usability... no 2024-04-20T21:22:54.628 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/ext4.h presence... no 2024-04-20T21:22:54.628 INFO:teuthology.orchestra.run.smithi071.stdout:checking for linux/ext4.h... no 2024-04-20T21:22:54.675 INFO:teuthology.orchestra.run.smithi071.stdout:checking for xfs/xfs_log_format.h... no 2024-04-20T21:22:54.776 INFO:teuthology.orchestra.run.smithi071.stdout:checking for uuid_compare... no 2024-04-20T21:22:54.857 INFO:teuthology.orchestra.run.smithi071.stdout:checking for uuid_compare in -luuid... yes 2024-04-20T21:22:54.974 INFO:teuthology.orchestra.run.smithi071.stdout:checking for xfs/xfs.h... yes 2024-04-20T21:22:55.020 INFO:teuthology.orchestra.run.smithi071.stdout:checking for xfs/libxfs.h... no 2024-04-20T21:22:55.073 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether xlog_assign_lsn is declared... no 2024-04-20T21:22:55.144 INFO:teuthology.orchestra.run.smithi071.stdout:checking for xfs/xqm.h... yes 2024-04-20T21:22:55.253 INFO:teuthology.orchestra.run.smithi071.stdout:checking xfsctl from xfs/xfs.h... ok 2024-04-20T21:22:55.315 INFO:teuthology.orchestra.run.smithi071.stdout:checking xfs/handle.h usability... yes 2024-04-20T21:22:55.341 INFO:teuthology.orchestra.run.smithi071.stdout:checking xfs/handle.h presence... yes 2024-04-20T21:22:55.341 INFO:teuthology.orchestra.run.smithi071.stdout:checking for xfs/handle.h... yes 2024-04-20T21:22:55.442 INFO:teuthology.orchestra.run.smithi071.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-04-20T21:22:55.507 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/acl.h usability... yes 2024-04-20T21:22:55.536 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/acl.h presence... yes 2024-04-20T21:22:55.536 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/acl.h... yes 2024-04-20T21:22:55.608 INFO:teuthology.orchestra.run.smithi071.stdout:checking acl/libacl.h usability... yes 2024-04-20T21:22:55.635 INFO:teuthology.orchestra.run.smithi071.stdout:checking acl/libacl.h presence... yes 2024-04-20T21:22:55.635 INFO:teuthology.orchestra.run.smithi071.stdout:checking for acl/libacl.h... yes 2024-04-20T21:22:55.714 INFO:teuthology.orchestra.run.smithi071.stdout:checking for acl_init in -lacl... yes 2024-04-20T21:22:55.771 INFO:teuthology.orchestra.run.smithi071.stdout:checking gdbm-ndbm.h usability... no 2024-04-20T21:22:55.807 INFO:teuthology.orchestra.run.smithi071.stdout:checking gdbm-ndbm.h presence... no 2024-04-20T21:22:55.807 INFO:teuthology.orchestra.run.smithi071.stdout:checking for gdbm-ndbm.h... no 2024-04-20T21:22:55.868 INFO:teuthology.orchestra.run.smithi071.stdout:checking gdbm/ndbm.h usability... yes 2024-04-20T21:22:55.896 INFO:teuthology.orchestra.run.smithi071.stdout:checking gdbm/ndbm.h presence... yes 2024-04-20T21:22:55.896 INFO:teuthology.orchestra.run.smithi071.stdout:checking for gdbm/ndbm.h... yes 2024-04-20T21:22:55.986 INFO:teuthology.orchestra.run.smithi071.stdout:checking for dbm_open in -lgdbm... no 2024-04-20T21:22:56.063 INFO:teuthology.orchestra.run.smithi071.stdout:checking for dbm_fetch in -lgdbm... no 2024-04-20T21:22:56.145 INFO:teuthology.orchestra.run.smithi071.stdout:checking for dbm_store in -lgdbm... no 2024-04-20T21:22:56.225 INFO:teuthology.orchestra.run.smithi071.stdout:checking for dbm_close in -lgdbm... no 2024-04-20T21:22:56.316 INFO:teuthology.orchestra.run.smithi071.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-04-20T21:22:56.390 INFO:teuthology.orchestra.run.smithi071.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-04-20T21:22:56.470 INFO:teuthology.orchestra.run.smithi071.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-04-20T21:22:56.553 INFO:teuthology.orchestra.run.smithi071.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-04-20T21:22:56.609 INFO:teuthology.orchestra.run.smithi071.stdout:checking libaio.h usability... yes 2024-04-20T21:22:56.639 INFO:teuthology.orchestra.run.smithi071.stdout:checking libaio.h presence... yes 2024-04-20T21:22:56.639 INFO:teuthology.orchestra.run.smithi071.stdout:checking for libaio.h... yes 2024-04-20T21:22:56.698 INFO:teuthology.orchestra.run.smithi071.stdout:checking liburing.h usability... no 2024-04-20T21:22:56.732 INFO:teuthology.orchestra.run.smithi071.stdout:checking liburing.h presence... no 2024-04-20T21:22:56.732 INFO:teuthology.orchestra.run.smithi071.stdout:checking for liburing.h... no 2024-04-20T21:22:56.789 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/capability.h usability... yes 2024-04-20T21:22:56.815 INFO:teuthology.orchestra.run.smithi071.stdout:checking sys/capability.h presence... yes 2024-04-20T21:22:56.815 INFO:teuthology.orchestra.run.smithi071.stdout:checking for sys/capability.h... yes 2024-04-20T21:22:56.869 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/fiemap.h usability... yes 2024-04-20T21:22:56.894 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/fiemap.h presence... yes 2024-04-20T21:22:56.894 INFO:teuthology.orchestra.run.smithi071.stdout:checking for linux/fiemap.h... yes 2024-04-20T21:22:56.969 INFO:teuthology.orchestra.run.smithi071.stdout:checking for fallocate... yes 2024-04-20T21:22:57.051 INFO:teuthology.orchestra.run.smithi071.stdout:checking for open_by_handle_at... yes 2024-04-20T21:22:57.111 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/fs.h usability... yes 2024-04-20T21:22:57.132 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/fs.h presence... yes 2024-04-20T21:22:57.132 INFO:teuthology.orchestra.run.smithi071.stdout:checking for linux/fs.h... yes 2024-04-20T21:22:57.184 INFO:teuthology.orchestra.run.smithi071.stdout:checking btrfsutil.h usability... no 2024-04-20T21:22:57.218 INFO:teuthology.orchestra.run.smithi071.stdout:checking btrfsutil.h presence... no 2024-04-20T21:22:57.218 INFO:teuthology.orchestra.run.smithi071.stdout:checking for btrfsutil.h... no 2024-04-20T21:22:57.301 INFO:teuthology.orchestra.run.smithi071.stdout:checking for copy_file_range... yes 2024-04-20T21:22:57.381 INFO:teuthology.orchestra.run.smithi071.stdout:checking for SEEK_DATA... yes 2024-04-20T21:22:57.486 INFO:teuthology.orchestra.run.smithi071.stdout:checking for BMV_OF_SHARED... yes 2024-04-20T21:22:57.578 INFO:teuthology.orchestra.run.smithi071.stdout:checking for nftw... yes 2024-04-20T21:22:57.670 INFO:teuthology.orchestra.run.smithi071.stdout:checking for RLIMIT_NOFILE... yes 2024-04-20T21:22:57.751 INFO:teuthology.orchestra.run.smithi071.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-04-20T21:22:57.840 INFO:teuthology.orchestra.run.smithi071.stdout:checking for FICLONE... yes 2024-04-20T21:22:57.921 INFO:teuthology.orchestra.run.smithi071.stdout:checking for renameat2... yes 2024-04-20T21:22:58.004 INFO:teuthology.orchestra.run.smithi071.stdout:checking for reallocarray... yes 2024-04-20T21:22:58.100 INFO:teuthology.orchestra.run.smithi071.stdout:checking for struct mount_attr... yes 2024-04-20T21:22:58.209 INFO:teuthology.orchestra.run.smithi071.stdout:checking for struct btrfs_qgroup_limit... yes 2024-04-20T21:22:58.314 INFO:teuthology.orchestra.run.smithi071.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-04-20T21:22:58.421 INFO:teuthology.orchestra.run.smithi071.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-04-20T21:22:58.527 INFO:teuthology.orchestra.run.smithi071.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-04-20T21:22:58.635 INFO:teuthology.orchestra.run.smithi071.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-04-20T21:22:58.738 INFO:teuthology.orchestra.run.smithi071.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-04-20T21:22:58.840 INFO:teuthology.orchestra.run.smithi071.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-04-20T21:22:58.916 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/btrfs.h usability... yes 2024-04-20T21:22:58.943 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/btrfs.h presence... yes 2024-04-20T21:22:58.943 INFO:teuthology.orchestra.run.smithi071.stdout:checking for linux/btrfs.h... yes 2024-04-20T21:22:59.025 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/btrfs_tree.h usability... yes 2024-04-20T21:22:59.054 INFO:teuthology.orchestra.run.smithi071.stdout:checking linux/btrfs_tree.h presence... yes 2024-04-20T21:22:59.054 INFO:teuthology.orchestra.run.smithi071.stdout:checking for linux/btrfs_tree.h... yes 2024-04-20T21:22:59.117 INFO:teuthology.orchestra.run.smithi071.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-04-20T21:22:59.182 INFO:teuthology.orchestra.run.smithi071.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-04-20T21:22:59.217 INFO:teuthology.orchestra.run.smithi071.stdout:configure: creating ./config.status 2024-04-20T21:23:00.347 INFO:teuthology.orchestra.run.smithi071.stdout:config.status: creating include/builddefs 2024-04-20T21:23:00.385 INFO:teuthology.orchestra.run.smithi071.stdout:config.status: creating include/config.h 2024-04-20T21:23:00.415 INFO:teuthology.orchestra.run.smithi071.stdout:config.status: executing libtool commands 2024-04-20T21:23:00.513 INFO:teuthology.orchestra.run.smithi071.stdout:Building include 2024-04-20T21:23:00.521 INFO:teuthology.orchestra.run.smithi071.stdout:Building lib 2024-04-20T21:23:00.530 INFO:teuthology.orchestra.run.smithi071.stdout: [LTDEP] 2024-04-20T21:23:00.854 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] dataascii.lo 2024-04-20T21:23:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] databin.lo 2024-04-20T21:23:01.427 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] datapid.lo 2024-04-20T21:23:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] file_lock.lo 2024-04-20T21:23:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] forker.lo 2024-04-20T21:23:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] pattern.lo 2024-04-20T21:23:02.488 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] open_flags.lo 2024-04-20T21:23:02.764 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] random_range.lo 2024-04-20T21:23:03.131 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] string_to_tokens.lo 2024-04-20T21:23:03.371 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] str_to_bytes.lo 2024-04-20T21:23:03.658 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] tlibio.lo 2024-04-20T21:23:04.055 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] write_log.lo 2024-04-20T21:23:04.450 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] random.lo 2024-04-20T21:23:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: [LD] 2024-04-20T21:23:04.866 INFO:teuthology.orchestra.run.smithi071.stdout:Building ltp 2024-04-20T21:23:04.875 INFO:teuthology.orchestra.run.smithi071.stdout: [DEP] 2024-04-20T21:23:05.152 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] doio 2024-04-20T21:23:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fsstress 2024-04-20T21:23:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fsx 2024-04-20T21:23:08.600 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] growfiles 2024-04-20T21:23:09.293 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] iogen 2024-04-20T21:23:09.846 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-stress 2024-04-20T21:23:10.469 INFO:teuthology.orchestra.run.smithi071.stdout:Building src 2024-04-20T21:23:10.481 INFO:teuthology.orchestra.run.smithi071.stdout: [DEP] 2024-04-20T21:23:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: [DEP] 2024-04-20T21:23:14.427 INFO:teuthology.orchestra.run.smithi071.stdout: [DEP] 2024-04-20T21:23:14.450 INFO:teuthology.orchestra.run.smithi071.stdout: [DEP] 2024-04-20T21:23:14.951 INFO:teuthology.orchestra.run.smithi071.stdout: [DEP] 2024-04-20T21:23:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] dirstress 2024-04-20T21:23:15.424 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fill 2024-04-20T21:23:15.731 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fill2 2024-04-20T21:23:16.137 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] getpagesize 2024-04-20T21:23:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] holes 2024-04-20T21:23:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] lstat64 2024-04-20T21:23:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] nametest 2024-04-20T21:23:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] permname 2024-04-20T21:23:17.930 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] randholes 2024-04-20T21:23:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] runas 2024-04-20T21:23:18.700 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] truncfile 2024-04-20T21:23:19.037 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] usemem 2024-04-20T21:23:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] mmapcat 2024-04-20T21:23:19.688 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] append_reader 2024-04-20T21:23:20.017 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] append_writer 2024-04-20T21:23:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] dirperf 2024-04-20T21:23:20.761 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] metaperf 2024-04-20T21:23:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] devzero 2024-04-20T21:23:21.568 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] feature 2024-04-20T21:23:21.955 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] alloc 2024-04-20T21:23:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fault 2024-04-20T21:23:22.672 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fstest 2024-04-20T21:23:23.074 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_access_root 2024-04-20T21:23:23.404 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] godown 2024-04-20T21:23:23.724 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] resvtest 2024-04-20T21:23:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] writemod 2024-04-20T21:23:24.306 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:23:24.318 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:23:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] writev_on_pagefault 2024-04-20T21:23:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] makeextents 2024-04-20T21:23:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] itrash 2024-04-20T21:23:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] rename 2024-04-20T21:23:25.711 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] multi_open_unlink 2024-04-20T21:23:26.028 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] unwritten_sync 2024-04-20T21:23:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] genhashnames 2024-04-20T21:23:26.725 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_holes 2024-04-20T21:23:27.019 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_mmap_writev 2024-04-20T21:23:27.328 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_truncate_cmtime 2024-04-20T21:23:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] dirhash_collide 2024-04-20T21:23:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_rename_overwrite 2024-04-20T21:23:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] holetest 2024-04-20T21:23:28.715 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_truncate_self 2024-04-20T21:23:29.013 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] af_unix 2024-04-20T21:23:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_mmap_stale_pmd 2024-04-20T21:23:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_mmap_cow_race 2024-04-20T21:23:29.995 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_mmap_fallocate 2024-04-20T21:23:30.317 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fsync-err 2024-04-20T21:23:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_mmap_write_ro 2024-04-20T21:23:31.004 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_ext4_dax_journal_corruption 2024-04-20T21:23:31.316 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_ext4_dax_inline_corruption 2024-04-20T21:23:31.651 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_ofd_locks 2024-04-20T21:23:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_mmap_collision 2024-04-20T21:23:32.400 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] mmap-write-concurrent 2024-04-20T21:23:32.740 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_get_file_time 2024-04-20T21:23:33.068 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_create_short_dirs 2024-04-20T21:23:33.414 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_create_long_dirs 2024-04-20T21:23:33.764 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_enospc 2024-04-20T21:23:34.140 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_mmap_writev_overlap 2024-04-20T21:23:34.486 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] checkpoint_journal 2024-04-20T21:23:34.817 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] mmap-rw-fault 2024-04-20T21:23:35.158 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] allocstale 2024-04-20T21:23:35.508 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_mmap_cow_memory_failure 2024-04-20T21:23:35.824 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fake-dump-rootino 2024-04-20T21:23:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] dio-buf-fault 2024-04-20T21:23:36.478 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] rewinddir-test 2024-04-20T21:23:36.820 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] readdir-while-renames 2024-04-20T21:23:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] xfsctl 2024-04-20T21:23:37.543 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] bstat 2024-04-20T21:23:37.903 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_mtab 2024-04-20T21:23:38.261 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] getdevicesize 2024-04-20T21:23:38.567 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] preallo_rw_pattern_reader 2024-04-20T21:23:38.887 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] preallo_rw_pattern_writer 2024-04-20T21:23:39.217 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] ftrunc 2024-04-20T21:23:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] trunc 2024-04-20T21:23:39.863 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fs_perms 2024-04-20T21:23:40.201 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] testx 2024-04-20T21:23:40.503 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] looptest 2024-04-20T21:23:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] locktest 2024-04-20T21:23:41.374 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] unwritten_mmap 2024-04-20T21:23:41.726 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] bulkstat_unlink_test 2024-04-20T21:23:42.111 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] deduperace 2024-04-20T21:23:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] bulkstat_unlink_test_modified 2024-04-20T21:23:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_dir_offset 2024-04-20T21:23:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_futimens 2024-04-20T21:23:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_immutable 2024-04-20T21:23:44.280 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] stale_handle 2024-04-20T21:23:44.626 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] pwrite_mmap_blocked 2024-04-20T21:23:44.928 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_dir_offset2 2024-04-20T21:23:45.295 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] seek_sanity_test 2024-04-20T21:23:45.941 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] seek_copy_test 2024-04-20T21:23:46.286 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_readdir_1 2024-04-20T21:23:46.598 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_readdir_2 2024-04-20T21:23:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fsync-tester 2024-04-20T21:23:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] nsexec 2024-04-20T21:23:47.622 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] cloner 2024-04-20T21:23:47.984 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] renameat2 2024-04-20T21:23:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_getcwd 2024-04-20T21:23:48.665 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] e4compact 2024-04-20T21:23:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] test-nextquota 2024-04-20T21:23:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] punch-alternating 2024-04-20T21:23:49.739 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] attr-list-by-handle-cursor-test 2024-04-20T21:23:50.070 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] listxattr 2024-04-20T21:23:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] dio-interleaved 2024-04-20T21:23:50.683 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_dir_type 2024-04-20T21:23:51.015 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] dio-invalidate-cache 2024-04-20T21:23:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] stat_test 2024-04-20T21:23:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_encrypted_d_revalidate 2024-04-20T21:23:52.232 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] attr_replace_test 2024-04-20T21:23:52.558 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] swapon 2024-04-20T21:23:52.889 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] mkswap 2024-04-20T21:23:53.186 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_attr_corruption 2024-04-20T21:23:53.507 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_open_tmpfiles 2024-04-20T21:23:53.869 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fscrypt-crypt-util 2024-04-20T21:23:54.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:23:54.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:23:54.736 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] bulkstat_null_ocount 2024-04-20T21:23:55.046 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] splice-test 2024-04-20T21:23:55.404 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] chprojid_fail 2024-04-20T21:23:55.732 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] detached_mounts_propagation 2024-04-20T21:23:56.066 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] ext4_resize 2024-04-20T21:23:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_readdir_3 2024-04-20T21:23:56.736 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] splice2pipe 2024-04-20T21:23:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] uuid_ioctl 2024-04-20T21:23:57.400 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_snapshot_deleted_subvolume 2024-04-20T21:23:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fiemap-fault 2024-04-20T21:23:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fiemap-tester 2024-04-20T21:23:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_stripealign 2024-04-20T21:23:58.781 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] open_by_handle 2024-04-20T21:23:59.217 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] dbtest 2024-04-20T21:23:59.639 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_mmap_dio 2024-04-20T21:23:59.962 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] xfsfind 2024-04-20T21:24:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] t_reflink_read_race 2024-04-20T21:24:00.733 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] fssum 2024-04-20T21:24:01.363 INFO:teuthology.orchestra.run.smithi071.stdout:Building log-writes 2024-04-20T21:24:01.377 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] replay-log 2024-04-20T21:24:01.887 INFO:teuthology.orchestra.run.smithi071.stdout:Building perf 2024-04-20T21:24:01.897 INFO:teuthology.orchestra.run.smithi071.stdout:Building aio-dio-regress 2024-04-20T21:24:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aiocp 2024-04-20T21:24:02.313 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-append-write-fallocate-race 2024-04-20T21:24:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-append-write-read-race 2024-04-20T21:24:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-cow-race 2024-04-20T21:24:03.309 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-cycle-write 2024-04-20T21:24:03.647 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-eof-race 2024-04-20T21:24:04.014 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-extend-stat 2024-04-20T21:24:04.314 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-fcntl-race 2024-04-20T21:24:04.646 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-hole-filling-race 2024-04-20T21:24:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-invalidate-failure 2024-04-20T21:24:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-invalidate-readahead 2024-04-20T21:24:05.588 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aiodio_sparse2 2024-04-20T21:24:05.951 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-subblock-eof-read 2024-04-20T21:24:06.273 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-dio-write-verify 2024-04-20T21:24:06.641 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-04-20T21:24:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-04-20T21:24:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] aio-last-ref-held-by-io 2024-04-20T21:24:07.530 INFO:teuthology.orchestra.run.smithi071.stdout:Building vfs 2024-04-20T21:24:07.546 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] vfstest 2024-04-20T21:24:11.527 INFO:teuthology.orchestra.run.smithi071.stdout: [CC] mount-idmapped 2024-04-20T21:24:12.110 INFO:teuthology.orchestra.run.smithi071.stdout:Building m4 2024-04-20T21:24:12.123 INFO:teuthology.orchestra.run.smithi071.stdout:Building common 2024-04-20T21:24:12.134 INFO:teuthology.orchestra.run.smithi071.stdout:Building tests 2024-04-20T21:24:12.148 INFO:teuthology.orchestra.run.smithi071.stdout:Building btrfs 2024-04-20T21:24:12.164 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/btrfs/group.list 2024-04-20T21:24:12.377 INFO:teuthology.orchestra.run.smithi071.stdout:Building ceph 2024-04-20T21:24:12.391 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/ceph/group.list 2024-04-20T21:24:12.439 INFO:teuthology.orchestra.run.smithi071.stdout:Building cifs 2024-04-20T21:24:12.452 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/cifs/group.list 2024-04-20T21:24:12.493 INFO:teuthology.orchestra.run.smithi071.stdout:Building ext4 2024-04-20T21:24:12.508 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/ext4/group.list 2024-04-20T21:24:12.656 INFO:teuthology.orchestra.run.smithi071.stdout:Building f2fs 2024-04-20T21:24:12.671 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/f2fs/group.list 2024-04-20T21:24:12.737 INFO:teuthology.orchestra.run.smithi071.stdout:Building generic 2024-04-20T21:24:12.755 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/generic/group.list 2024-04-20T21:24:13.123 INFO:teuthology.orchestra.run.smithi071.stdout:Building nfs 2024-04-20T21:24:13.138 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/nfs/group.list 2024-04-20T21:24:13.191 INFO:teuthology.orchestra.run.smithi071.stdout:Building ocfs2 2024-04-20T21:24:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/ocfs2/group.list 2024-04-20T21:24:13.254 INFO:teuthology.orchestra.run.smithi071.stdout:Building overlay 2024-04-20T21:24:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/overlay/group.list 2024-04-20T21:24:13.417 INFO:teuthology.orchestra.run.smithi071.stdout:Building perf 2024-04-20T21:24:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/perf/group.list 2024-04-20T21:24:13.471 INFO:teuthology.orchestra.run.smithi071.stdout:Building selftest 2024-04-20T21:24:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/selftest/group.list 2024-04-20T21:24:13.529 INFO:teuthology.orchestra.run.smithi071.stdout:Building shared 2024-04-20T21:24:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/shared/group.list 2024-04-20T21:24:13.605 INFO:teuthology.orchestra.run.smithi071.stdout:Building tmpfs 2024-04-20T21:24:13.619 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/tmpfs/group.list 2024-04-20T21:24:13.661 INFO:teuthology.orchestra.run.smithi071.stdout:Building udf 2024-04-20T21:24:13.673 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/udf/group.list 2024-04-20T21:24:13.712 INFO:teuthology.orchestra.run.smithi071.stdout:Building xfs 2024-04-20T21:24:13.730 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/xfs/group.list 2024-04-20T21:24:14.093 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo make install) 2024-04-20T21:24:14.206 INFO:teuthology.orchestra.run.smithi071.stdout:Building include 2024-04-20T21:24:14.215 INFO:teuthology.orchestra.run.smithi071.stdout:Building lib 2024-04-20T21:24:14.225 INFO:teuthology.orchestra.run.smithi071.stdout:Building ltp 2024-04-20T21:24:14.236 INFO:teuthology.orchestra.run.smithi071.stdout:Building src 2024-04-20T21:24:14.320 INFO:teuthology.orchestra.run.smithi071.stdout:Building log-writes 2024-04-20T21:24:14.329 INFO:teuthology.orchestra.run.smithi071.stdout:Building perf 2024-04-20T21:24:14.339 INFO:teuthology.orchestra.run.smithi071.stdout:Building aio-dio-regress 2024-04-20T21:24:14.356 INFO:teuthology.orchestra.run.smithi071.stdout:Building vfs 2024-04-20T21:24:14.361 INFO:teuthology.orchestra.run.smithi071.stdout:Building m4 2024-04-20T21:24:14.373 INFO:teuthology.orchestra.run.smithi071.stdout:Building common 2024-04-20T21:24:14.384 INFO:teuthology.orchestra.run.smithi071.stdout:Building tests 2024-04-20T21:24:14.399 INFO:teuthology.orchestra.run.smithi071.stdout:Building btrfs 2024-04-20T21:24:14.416 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/btrfs/group.list 2024-04-20T21:24:14.617 INFO:teuthology.orchestra.run.smithi071.stdout:Building ceph 2024-04-20T21:24:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/ceph/group.list 2024-04-20T21:24:14.677 INFO:teuthology.orchestra.run.smithi071.stdout:Building cifs 2024-04-20T21:24:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/cifs/group.list 2024-04-20T21:24:14.731 INFO:teuthology.orchestra.run.smithi071.stdout:Building ext4 2024-04-20T21:24:14.744 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/ext4/group.list 2024-04-20T21:24:14.878 INFO:teuthology.orchestra.run.smithi071.stdout:Building f2fs 2024-04-20T21:24:14.892 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/f2fs/group.list 2024-04-20T21:24:14.953 INFO:teuthology.orchestra.run.smithi071.stdout:Building generic 2024-04-20T21:24:14.971 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/generic/group.list 2024-04-20T21:24:15.309 INFO:teuthology.orchestra.run.smithi071.stdout:Building nfs 2024-04-20T21:24:15.322 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/nfs/group.list 2024-04-20T21:24:15.375 INFO:teuthology.orchestra.run.smithi071.stdout:Building ocfs2 2024-04-20T21:24:15.389 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/ocfs2/group.list 2024-04-20T21:24:15.440 INFO:teuthology.orchestra.run.smithi071.stdout:Building overlay 2024-04-20T21:24:15.454 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/overlay/group.list 2024-04-20T21:24:15.604 INFO:teuthology.orchestra.run.smithi071.stdout:Building perf 2024-04-20T21:24:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/perf/group.list 2024-04-20T21:24:15.662 INFO:teuthology.orchestra.run.smithi071.stdout:Building selftest 2024-04-20T21:24:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/selftest/group.list 2024-04-20T21:24:15.720 INFO:teuthology.orchestra.run.smithi071.stdout:Building shared 2024-04-20T21:24:15.734 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/shared/group.list 2024-04-20T21:24:15.790 INFO:teuthology.orchestra.run.smithi071.stdout:Building tmpfs 2024-04-20T21:24:15.803 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/tmpfs/group.list 2024-04-20T21:24:15.848 INFO:teuthology.orchestra.run.smithi071.stdout:Building udf 2024-04-20T21:24:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/udf/group.list 2024-04-20T21:24:15.901 INFO:teuthology.orchestra.run.smithi071.stdout:Building xfs 2024-04-20T21:24:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/xfs/group.list 2024-04-20T21:24:16.220 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-04-20T21:24:16.224 INFO:teuthology.orchestra.run.smithi071.stdout:gmake[1]: Nothing to be done for 'install'. 2024-04-20T21:24:16.224 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-04-20T21:24:16.228 INFO:teuthology.orchestra.run.smithi071.stdout:gmake[1]: Nothing to be done for 'install'. 2024-04-20T21:24:16.228 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-04-20T21:24:16.234 INFO:teuthology.orchestra.run.smithi071.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-04-20T21:24:16.265 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-04-20T21:24:16.504 INFO:teuthology.orchestra.run.smithi071.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-04-20T21:24:16.537 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-04-20T21:24:16.582 INFO:teuthology.orchestra.run.smithi071.stdout:Building log-writes 2024-04-20T21:24:16.593 INFO:teuthology.orchestra.run.smithi071.stdout:Building perf 2024-04-20T21:24:16.603 INFO:teuthology.orchestra.run.smithi071.stdout:Building aio-dio-regress 2024-04-20T21:24:16.615 INFO:teuthology.orchestra.run.smithi071.stdout:Building vfs 2024-04-20T21:24:16.623 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake -C log-writes install 2024-04-20T21:24:16.626 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-04-20T21:24:16.658 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-04-20T21:24:16.691 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake -C perf install 2024-04-20T21:24:16.694 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-04-20T21:24:16.728 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-04-20T21:24:16.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-04-20T21:24:16.812 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-04-20T21:24:16.843 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-04-20T21:24:17.043 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake -C vfs install 2024-04-20T21:24:17.047 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-04-20T21:24:17.080 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-04-20T21:24:17.125 INFO:teuthology.orchestra.run.smithi071.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-04-20T21:24:17.157 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-04-20T21:24:21.520 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-04-20T21:24:21.844 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-04-20T21:24:21.914 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-04-20T21:24:21.917 INFO:teuthology.orchestra.run.smithi071.stdout:gmake[1]: Nothing to be done for 'install'. 2024-04-20T21:24:21.918 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-04-20T21:24:21.921 INFO:teuthology.orchestra.run.smithi071.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-04-20T21:24:21.954 INFO:teuthology.orchestra.run.smithi071.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-04-20T21:24:22.461 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-04-20T21:24:22.465 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/btrfs/ install 2024-04-20T21:24:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/btrfs/group.list 2024-04-20T21:24:22.685 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-04-20T21:24:22.717 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 320 330 /var/lib/xfstests/tests/btrfs 2024-04-20T21:24:24.616 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:24:24.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:24:26.015 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-04-20T21:24:26.047 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 320.out 330.out /var/lib/xfstests/tests/btrfs 2024-04-20T21:24:29.632 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/ceph/ install 2024-04-20T21:24:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/ceph/group.list 2024-04-20T21:24:29.690 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-04-20T21:24:29.723 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-04-20T21:24:29.795 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-04-20T21:24:29.828 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-04-20T21:24:29.902 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/cifs/ install 2024-04-20T21:24:29.908 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/cifs/group.list 2024-04-20T21:24:29.950 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-04-20T21:24:29.982 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-04-20T21:24:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-04-20T21:24:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-04-20T21:24:30.078 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/ext4/ install 2024-04-20T21:24:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/ext4/group.list 2024-04-20T21:24:30.223 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-04-20T21:24:30.257 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-04-20T21:24:30.958 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-04-20T21:24:30.990 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-04-20T21:24:31.822 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/f2fs/ install 2024-04-20T21:24:31.829 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/f2fs/group.list 2024-04-20T21:24:31.890 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-04-20T21:24:31.922 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-04-20T21:24:31.963 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-04-20T21:24:31.996 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-04-20T21:24:32.041 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/generic/ install 2024-04-20T21:24:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/generic/group.list 2024-04-20T21:24:32.384 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-04-20T21:24:32.415 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 741 742 743 /var/lib/xfstests/tests/generic 2024-04-20T21:24:40.672 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-04-20T21:24:40.705 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 741.out 742.out 743.out /var/lib/xfstests/tests/generic 2024-04-20T21:24:48.705 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/nfs/ install 2024-04-20T21:24:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/nfs/group.list 2024-04-20T21:24:48.762 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-04-20T21:24:48.792 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-04-20T21:24:48.822 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-04-20T21:24:48.853 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-04-20T21:24:48.883 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/ocfs2/ install 2024-04-20T21:24:48.889 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/ocfs2/group.list 2024-04-20T21:24:48.932 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-04-20T21:24:48.963 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-04-20T21:24:48.993 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-04-20T21:24:49.025 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-04-20T21:24:49.057 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/overlay/ install 2024-04-20T21:24:49.066 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/overlay/group.list 2024-04-20T21:24:49.212 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-04-20T21:24:49.244 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-04-20T21:24:50.406 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-04-20T21:24:50.438 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-04-20T21:24:51.532 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/perf/ install 2024-04-20T21:24:51.538 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/perf/group.list 2024-04-20T21:24:51.576 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-04-20T21:24:51.607 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-04-20T21:24:51.639 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-04-20T21:24:51.672 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-04-20T21:24:51.705 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/selftest/ install 2024-04-20T21:24:51.714 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/selftest/group.list 2024-04-20T21:24:51.756 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-04-20T21:24:51.788 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-04-20T21:24:51.867 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-04-20T21:24:51.900 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-04-20T21:24:51.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/shared/ install 2024-04-20T21:24:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/shared/group.list 2024-04-20T21:24:52.036 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-04-20T21:24:52.064 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-04-20T21:24:52.113 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-04-20T21:24:52.143 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-04-20T21:24:52.189 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/tmpfs/ install 2024-04-20T21:24:52.197 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/tmpfs/group.list 2024-04-20T21:24:52.243 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-04-20T21:24:52.272 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-04-20T21:24:52.301 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-04-20T21:24:52.332 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-04-20T21:24:52.364 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/udf/ install 2024-04-20T21:24:52.372 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/udf/group.list 2024-04-20T21:24:52.410 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-04-20T21:24:52.441 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-04-20T21:24:52.473 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-04-20T21:24:52.505 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-04-20T21:24:52.538 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fxhob2prpHxfstests-dev/tests/xfs/ install 2024-04-20T21:24:52.547 INFO:teuthology.orchestra.run.smithi071.stdout: [GROUP] /tmp/tmp.fxhob2prpHxfstests-dev/tests/xfs/group.list 2024-04-20T21:24:52.912 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-04-20T21:24:52.945 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-04-20T21:24:54.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:24:54.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:25:00.428 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-04-20T21:25:00.462 INFO:teuthology.orchestra.run.smithi071.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-04-20T21:25:08.268 INFO:teuthology.orchestra.run.smithi071.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-04-20T21:25:08.301 INFO:teuthology.orchestra.run.smithi071.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-04-20T21:25:08.333 INFO:teuthology.orchestra.run.smithi071.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-04-20T21:25:08.365 INFO:teuthology.orchestra.run.smithi071.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-04-20T21:25:08.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:25:08.402 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec ls tests/generic) 2024-04-20T21:25:08.456 INFO:teuthology.orchestra.run.smithi071.stdout:001 2024-04-20T21:25:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:001.out 2024-04-20T21:25:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:002 2024-04-20T21:25:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:002.out 2024-04-20T21:25:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:003 2024-04-20T21:25:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:003.out 2024-04-20T21:25:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:004 2024-04-20T21:25:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:004.out 2024-04-20T21:25:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:005 2024-04-20T21:25:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:005.out 2024-04-20T21:25:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:006 2024-04-20T21:25:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:006.out 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:007 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:007.out 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:008 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:008.out 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:009 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:009.out 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:010 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:010.out 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:011 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:011.out 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:012 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:012.out 2024-04-20T21:25:08.458 INFO:teuthology.orchestra.run.smithi071.stdout:013 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:013.out 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:014 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:014.out 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:015 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:015.out 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:016 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:016.out 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:017 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:017.out 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:018 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:018.out 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:019 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:019.out 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:020 2024-04-20T21:25:08.459 INFO:teuthology.orchestra.run.smithi071.stdout:020.out 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:021 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:021.out 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:022 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:022.out 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:023 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:023.out 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:024 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:024.out 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:025 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:025.out 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:026 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:026.out 2024-04-20T21:25:08.460 INFO:teuthology.orchestra.run.smithi071.stdout:027 2024-04-20T21:25:08.461 INFO:teuthology.orchestra.run.smithi071.stdout:027.out 2024-04-20T21:25:08.461 INFO:teuthology.orchestra.run.smithi071.stdout:028 2024-04-20T21:25:08.461 INFO:teuthology.orchestra.run.smithi071.stdout:028.out 2024-04-20T21:25:08.461 INFO:teuthology.orchestra.run.smithi071.stdout:029 2024-04-20T21:25:08.461 INFO:teuthology.orchestra.run.smithi071.stdout:029.out 2024-04-20T21:25:08.461 INFO:teuthology.orchestra.run.smithi071.stdout:030 2024-04-20T21:25:08.461 INFO:teuthology.orchestra.run.smithi071.stdout:030.out 2024-04-20T21:25:08.461 INFO:teuthology.orchestra.run.smithi071.stdout:031 2024-04-20T21:25:08.461 INFO:teuthology.orchestra.run.smithi071.stdout:031.out 2024-04-20T21:25:08.462 INFO:teuthology.orchestra.run.smithi071.stdout:032 2024-04-20T21:25:08.462 INFO:teuthology.orchestra.run.smithi071.stdout:032.out 2024-04-20T21:25:08.462 INFO:teuthology.orchestra.run.smithi071.stdout:033 2024-04-20T21:25:08.462 INFO:teuthology.orchestra.run.smithi071.stdout:033.out 2024-04-20T21:25:08.462 INFO:teuthology.orchestra.run.smithi071.stdout:034 2024-04-20T21:25:08.462 INFO:teuthology.orchestra.run.smithi071.stdout:034.out 2024-04-20T21:25:08.462 INFO:teuthology.orchestra.run.smithi071.stdout:035 2024-04-20T21:25:08.462 INFO:teuthology.orchestra.run.smithi071.stdout:035.cfg 2024-04-20T21:25:08.462 INFO:teuthology.orchestra.run.smithi071.stdout:035.out.default 2024-04-20T21:25:08.462 INFO:teuthology.orchestra.run.smithi071.stdout:035.out.nfs 2024-04-20T21:25:08.462 INFO:teuthology.orchestra.run.smithi071.stdout:036 2024-04-20T21:25:08.463 INFO:teuthology.orchestra.run.smithi071.stdout:036.out 2024-04-20T21:25:08.463 INFO:teuthology.orchestra.run.smithi071.stdout:037 2024-04-20T21:25:08.463 INFO:teuthology.orchestra.run.smithi071.stdout:037.out 2024-04-20T21:25:08.463 INFO:teuthology.orchestra.run.smithi071.stdout:038 2024-04-20T21:25:08.463 INFO:teuthology.orchestra.run.smithi071.stdout:038.out 2024-04-20T21:25:08.463 INFO:teuthology.orchestra.run.smithi071.stdout:039 2024-04-20T21:25:08.463 INFO:teuthology.orchestra.run.smithi071.stdout:039.out 2024-04-20T21:25:08.463 INFO:teuthology.orchestra.run.smithi071.stdout:040 2024-04-20T21:25:08.463 INFO:teuthology.orchestra.run.smithi071.stdout:040.out 2024-04-20T21:25:08.463 INFO:teuthology.orchestra.run.smithi071.stdout:041 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:041.out 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:042 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:042.out 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:043 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:043.out 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:044 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:044.out 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:045 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:045.out 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:046 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:046.out 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:047 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:047.out 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:048 2024-04-20T21:25:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:048.out 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:049 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:049.out 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:050 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:050.cfg 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:050.out.default 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:050.out.nojournal 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:050.out.xfsquota 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:051 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:051.out 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:052 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:052.out 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:053 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:053.out 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:054 2024-04-20T21:25:08.465 INFO:teuthology.orchestra.run.smithi071.stdout:054.out 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:055 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:055.out 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:056 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:056.out 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:057 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:057.out 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:058 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:058.out 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:059 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:059.out 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:060 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:060.out 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:061 2024-04-20T21:25:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:061.out 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:062 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:062.out 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:063 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:063.out 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:064 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:064.out 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:065 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:065.out 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:066 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:066.out 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:067 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:067.out 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:068 2024-04-20T21:25:08.467 INFO:teuthology.orchestra.run.smithi071.stdout:068.out 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:069 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:069.out 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:070 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:070.out 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:071 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:071.out 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:072 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:072.out 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:073 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:073.out 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:074 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:074.out 2024-04-20T21:25:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:075 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:075.out 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:076 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:076.out 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:077 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:077.out 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:078 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:078.out 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:079 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:079.out 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:080 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:080.out 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:081 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:081.out 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:082 2024-04-20T21:25:08.469 INFO:teuthology.orchestra.run.smithi071.stdout:082.out 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:083 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:083.out 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:084 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:084.out 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:085 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:085.out 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:086 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:086.out 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:087 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:087.out 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:088 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:088.out 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:089 2024-04-20T21:25:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:089.out 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:090 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:090.out 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:091 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:091.out 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:092 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:092.out 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:093 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:093.out 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:094 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:094.out 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:095 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:095.out 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:096 2024-04-20T21:25:08.471 INFO:teuthology.orchestra.run.smithi071.stdout:096.out 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:097 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:097.out 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:098 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:098.out 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:099 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:099.out 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:100 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:100.out 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:101 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:101.out 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:102 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:102.out 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:103 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:103.out 2024-04-20T21:25:08.472 INFO:teuthology.orchestra.run.smithi071.stdout:104 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:104.out 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:105 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:105.out 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:106 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:106.out 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:107 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:107.out 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:108 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:108.out 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:109 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:109.out 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:110 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:110.out 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:111 2024-04-20T21:25:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:111.out 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:112 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:112.out 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:113 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:113.out 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:114 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:114.out 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:115 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:115.out 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:116 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:116.out 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:117 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:117.out 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:118 2024-04-20T21:25:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:118.out 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:119 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:119.out 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:120 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:120.out 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:121 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:121.out 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:122 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:122.out 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:123 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:123.out 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:124 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:124.out 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:125 2024-04-20T21:25:08.475 INFO:teuthology.orchestra.run.smithi071.stdout:125.out 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:126 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:126.out 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:127 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:127.out 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:128 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:128.out 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:129 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:129.out 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:130 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:130.out 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:131 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:131.out 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:132 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:132.out 2024-04-20T21:25:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:133 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:133.out 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:134 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:134.out 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:135 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:135.out 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:136 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:136.out 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:137 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:137.out 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:138 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:138.out 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:139 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:139.out 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:140 2024-04-20T21:25:08.477 INFO:teuthology.orchestra.run.smithi071.stdout:140.out 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:141 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:141.out 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:142 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:142.out 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:143 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:143.out 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:144 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:144.out 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:145 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:145.out 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:146 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:146.out 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:147 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:147.out 2024-04-20T21:25:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:148 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:148.out 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:149 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:149.out 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:150 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:150.out 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:151 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:151.out 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:152 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:152.out 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:153 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:153.out 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:154 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:154.out 2024-04-20T21:25:08.479 INFO:teuthology.orchestra.run.smithi071.stdout:155 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:155.out 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:156 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:156.out 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:157 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:157.out 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:158 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:158.out 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:159 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:159.out 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:160 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:160.out 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:161 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:161.out 2024-04-20T21:25:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:162 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:162.out 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:163 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:163.out 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:164 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:164.out 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:165 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:165.out 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:166 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:166.out 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:167 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:167.out 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:168 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:168.out 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:169 2024-04-20T21:25:08.481 INFO:teuthology.orchestra.run.smithi071.stdout:169.out 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:170 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:170.out 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:171 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:171.out 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:172 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:172.out 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:173 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:173.out 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:174 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:174.out 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:175 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:175.out 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:176 2024-04-20T21:25:08.482 INFO:teuthology.orchestra.run.smithi071.stdout:176.out 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:177 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:177.out 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:178 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:178.out 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:179 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:179.out 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:180 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:180.out 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:181 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:181.out 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:182 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:182.out 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:183 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:183.out 2024-04-20T21:25:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:184 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:184.out 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:185 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:185.out 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:186 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:186.out 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:187 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:187.out 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:188 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:188.out 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:189 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:189.out 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:190 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:190.out 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:191 2024-04-20T21:25:08.484 INFO:teuthology.orchestra.run.smithi071.stdout:191.out 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:192 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:192.out 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:193 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:193.out 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:194 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:194.out 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:195 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:195.out 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:196 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:196.out 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:197 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:197.out 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:198 2024-04-20T21:25:08.485 INFO:teuthology.orchestra.run.smithi071.stdout:198.out 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:199 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:199.out 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:200 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:200.out 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:201 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:201.out 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:202 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:202.out 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:203 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:203.out 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:204 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:204.out 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:205 2024-04-20T21:25:08.486 INFO:teuthology.orchestra.run.smithi071.stdout:205.out 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:206 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:206.out 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:207 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:207.out 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:208 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:208.out 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:209 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:209.out 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:210 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:210.out 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:211 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:211.out 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:212 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:212.out 2024-04-20T21:25:08.487 INFO:teuthology.orchestra.run.smithi071.stdout:213 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:213.out 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:214 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:214.out 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:215 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:215.out 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:216 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:216.out 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:217 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:217.out 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:218 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:218.out 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:219 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:219.out 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:220 2024-04-20T21:25:08.488 INFO:teuthology.orchestra.run.smithi071.stdout:220.out 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:221 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:221.out 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:222 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:222.out 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:223 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:223.out 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:224 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:224.out 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:225 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:225.out 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:226 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:226.out 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:227 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:227.out 2024-04-20T21:25:08.489 INFO:teuthology.orchestra.run.smithi071.stdout:228 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:228.out 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:229 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:229.out 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:230 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:230.out 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:231 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:231.out 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:232 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:232.out 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:233 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:233.out 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:234 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:234.out 2024-04-20T21:25:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:235 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:235.out 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:236 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:236.out 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:237 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:237.out 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:238 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:238.out 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:239 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:239.out 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:240 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:240.out 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:241 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:241.out 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:242 2024-04-20T21:25:08.491 INFO:teuthology.orchestra.run.smithi071.stdout:242.out 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:243 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:243.out 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:244 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:244.out 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:245 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:245.out 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:246 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:246.out 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:247 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:247.out 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:248 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:248.out 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:249 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:249.out 2024-04-20T21:25:08.492 INFO:teuthology.orchestra.run.smithi071.stdout:250 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:250.out 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:251 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:251.out 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:252 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:252.out 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:253 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:253.out 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:254 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:254.out 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:255 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:255.out 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:256 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:256.out 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:257 2024-04-20T21:25:08.493 INFO:teuthology.orchestra.run.smithi071.stdout:257.out 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:258 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:258.out 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:259 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:259.out 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:260 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:260.out 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:261 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:261.out 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:262 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:262.out 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:263 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:263.out 2024-04-20T21:25:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:264 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:264.out 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:265 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:265.out 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:266 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:266.out 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:267 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:267.out 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:268 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:268.out 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:269 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:269.out 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:270 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:270.out 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:271 2024-04-20T21:25:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:271.out 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:272 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:272.out 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:273 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:273.out 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:274 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:274.out 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:275 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:275.out 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:276 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:276.out 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:277 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:277.out 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:278 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:278.out 2024-04-20T21:25:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:279 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:279.out 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:280 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:280.out 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:281 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:281.out 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:282 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:282.out 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:283 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:283.out 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:284 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:284.out 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:285 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:285.out 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:286 2024-04-20T21:25:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:286.out 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:287 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:287.out 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:288 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:288.out 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:289 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:289.out 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:290 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:290.out 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:291 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:291.out 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:292 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:292.out 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:293 2024-04-20T21:25:08.498 INFO:teuthology.orchestra.run.smithi071.stdout:293.out 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:294 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:294.out 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:295 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:295.out 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:296 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:296.out 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:297 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:297.out 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:298 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:298.out 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:299 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:299.out 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:300 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:300.out 2024-04-20T21:25:08.499 INFO:teuthology.orchestra.run.smithi071.stdout:301 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:301.out 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:302 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:302.out 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:303 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:303.out 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:304 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:304.out 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:305 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:305.out 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:306 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:306.out 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:307 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:307.out 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:308 2024-04-20T21:25:08.500 INFO:teuthology.orchestra.run.smithi071.stdout:308.out 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:309 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:309.out 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:310 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:310.out 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:311 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:311.out 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:312 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:312.out 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:313 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:313.out 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:314 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:314.out 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:315 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:315.out 2024-04-20T21:25:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:316 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:316.out 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:317 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:317.out 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:318 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:318.out 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:319 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:319.out 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:320 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:320.out 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:321 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:321.out 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:322 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:322.out 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:323 2024-04-20T21:25:08.502 INFO:teuthology.orchestra.run.smithi071.stdout:323.out 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:324 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:324.out 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:325 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:325.out 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:326 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:326.out 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:327 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:327.out 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:328 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:328.out 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:329 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:329.out 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:330 2024-04-20T21:25:08.503 INFO:teuthology.orchestra.run.smithi071.stdout:330.out 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:331 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:331.out 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:332 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:332.out 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:333 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:333.out 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:334 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:334.out 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:335 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:335.out 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:336 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:336.out 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:337 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:337.out 2024-04-20T21:25:08.504 INFO:teuthology.orchestra.run.smithi071.stdout:338 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:338.out 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:339 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:339.out 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:340 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:340.out 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:341 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:341.out 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:342 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:342.out 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:343 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:343.out 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:344 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:344.out 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:345 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:345.out 2024-04-20T21:25:08.505 INFO:teuthology.orchestra.run.smithi071.stdout:346 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:346.out 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:347 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:347.out 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:348 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:348.out 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:349 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:349.out 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:350 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:350.out 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:351 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:351.out 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:352 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:352.out 2024-04-20T21:25:08.506 INFO:teuthology.orchestra.run.smithi071.stdout:353 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:353.out 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:354 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:354.out 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:355 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:355.out 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:356 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:356.out 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:357 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:357.out 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:358 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:358.out 2024-04-20T21:25:08.507 INFO:teuthology.orchestra.run.smithi071.stdout:359 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:359.out 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:360 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:360.out 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:361 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:361.out 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:362 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:362.out 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:363 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:363.out 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:364 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:364.out 2024-04-20T21:25:08.508 INFO:teuthology.orchestra.run.smithi071.stdout:365 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:365.out 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:366 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:366.out 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:367 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:367.out 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:368 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:368.out 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:369 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:369.out 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:370 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:370.out 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:371 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:371.out 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:372 2024-04-20T21:25:08.509 INFO:teuthology.orchestra.run.smithi071.stdout:372.out 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:373 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:373.out 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:374 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:374.out 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:375 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:375.out 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:376 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:376.out 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:377 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:377.out 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:378 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:378.out 2024-04-20T21:25:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:379 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:379.out 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:380 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:380.out 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:381 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:381.out 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:382 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:382.out 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:383 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:383.out 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:384 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:384.out 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:385 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:385.out 2024-04-20T21:25:08.511 INFO:teuthology.orchestra.run.smithi071.stdout:386 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:386.out 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:387 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:387.out 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:388 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:388.out 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:389 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:389.out 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:390 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:390.out 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:391 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:391.out 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:392 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:392.out 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:393 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:393.out 2024-04-20T21:25:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:394 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:394.out 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:395 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:395.out 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:396 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:396.out 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:397 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:397.out 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:398 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:398.out 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:399 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:399.out 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:400 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:400.out 2024-04-20T21:25:08.513 INFO:teuthology.orchestra.run.smithi071.stdout:401 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:401.out 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:402 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:402.out 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:403 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:403.out 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:404 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:404.out 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:405 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:405.out 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:406 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:406.out 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:407 2024-04-20T21:25:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:407.out 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:408 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:408.out 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:409 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:409.out 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:410 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:410.out 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:411 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:411.out 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:412 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:412.out 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:413 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:413.out 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:414 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:414.out 2024-04-20T21:25:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:415 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:415.out 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:416 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:416.out 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:417 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:417.out 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:418 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:418.out 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:419 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:419.out 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:420 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:420.out 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:421 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:421.out 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:422 2024-04-20T21:25:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:422.out 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:423 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:423.out 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:424 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:424.out 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:425 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:425.out 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:426 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:426.out 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:427 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:427.out 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:428 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:428.out 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:429 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:429.out 2024-04-20T21:25:08.517 INFO:teuthology.orchestra.run.smithi071.stdout:430 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:430.out 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:431 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:431.out 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:432 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:432.out 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:433 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:433.out 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:434 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:434.out 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:435 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:435.out 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:436 2024-04-20T21:25:08.518 INFO:teuthology.orchestra.run.smithi071.stdout:436.out 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:437 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:437.out 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:438 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:438.out 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:439 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:439.out 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:440 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:440.out 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:441 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:441.out 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:442 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:442.out 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:443 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:443.out 2024-04-20T21:25:08.519 INFO:teuthology.orchestra.run.smithi071.stdout:444 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:444.out 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:445 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:445.out 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:446 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:446.out 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:447 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:447.out 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:448 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:448.out 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:449 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:449.out 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:450 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:450.out 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:451 2024-04-20T21:25:08.520 INFO:teuthology.orchestra.run.smithi071.stdout:451.out 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:452 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:452.out 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:453 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:453.out 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:454 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:454.out 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:455 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:455.out 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:456 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:456.out 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:457 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:457.out 2024-04-20T21:25:08.521 INFO:teuthology.orchestra.run.smithi071.stdout:458 2024-04-20T21:25:08.522 INFO:teuthology.orchestra.run.smithi071.stdout:458.out 2024-04-20T21:25:08.522 INFO:teuthology.orchestra.run.smithi071.stdout:459 2024-04-20T21:25:08.522 INFO:teuthology.orchestra.run.smithi071.stdout:459.out 2024-04-20T21:25:08.522 INFO:teuthology.orchestra.run.smithi071.stdout:460 2024-04-20T21:25:08.522 INFO:teuthology.orchestra.run.smithi071.stdout:460.out 2024-04-20T21:25:08.523 INFO:teuthology.orchestra.run.smithi071.stdout:461 2024-04-20T21:25:08.523 INFO:teuthology.orchestra.run.smithi071.stdout:461.out 2024-04-20T21:25:08.523 INFO:teuthology.orchestra.run.smithi071.stdout:462 2024-04-20T21:25:08.523 INFO:teuthology.orchestra.run.smithi071.stdout:462.out 2024-04-20T21:25:08.523 INFO:teuthology.orchestra.run.smithi071.stdout:463 2024-04-20T21:25:08.523 INFO:teuthology.orchestra.run.smithi071.stdout:463.out 2024-04-20T21:25:08.523 INFO:teuthology.orchestra.run.smithi071.stdout:464 2024-04-20T21:25:08.523 INFO:teuthology.orchestra.run.smithi071.stdout:464.out 2024-04-20T21:25:08.523 INFO:teuthology.orchestra.run.smithi071.stdout:465 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:465.out 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:466 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:466.out 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:467 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:467.out 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:468 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:468.out 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:469 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:469.out 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:470 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:470.out 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:471 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:471.out 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:472 2024-04-20T21:25:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:472.out 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:473 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:473.out 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:474 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:474.out 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:475 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:475.out 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:476 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:476.out 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:477 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:477.out 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:478 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:478.out 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:479 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:479.out 2024-04-20T21:25:08.525 INFO:teuthology.orchestra.run.smithi071.stdout:480 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:480.out 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:481 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:481.out 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:482 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:482.out 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:483 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:483.out 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:484 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:484.out 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:485 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:485.out 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:486 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:486.out 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:487 2024-04-20T21:25:08.526 INFO:teuthology.orchestra.run.smithi071.stdout:487.out 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:488 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:488.out 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:489 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:489.out 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:490 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:490.out 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:491 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:491.out 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:492 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:492.out 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:493 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:493.out 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:494 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:494.out 2024-04-20T21:25:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:495 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:495.out 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:496 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:496.out 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:497 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:497.out 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:498 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:498.out 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:499 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:499.out 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:500 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:500.out 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:501 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:501.out 2024-04-20T21:25:08.528 INFO:teuthology.orchestra.run.smithi071.stdout:502 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:502.out 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:503 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:503.out 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:504 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:504.out 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:505 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:505.out 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:506 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:506.out 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:507 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:507.out 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:508 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:508.out 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:509 2024-04-20T21:25:08.529 INFO:teuthology.orchestra.run.smithi071.stdout:509.out 2024-04-20T21:25:08.530 INFO:teuthology.orchestra.run.smithi071.stdout:510 2024-04-20T21:25:08.530 INFO:teuthology.orchestra.run.smithi071.stdout:510.out 2024-04-20T21:25:08.530 INFO:teuthology.orchestra.run.smithi071.stdout:511 2024-04-20T21:25:08.530 INFO:teuthology.orchestra.run.smithi071.stdout:511.out 2024-04-20T21:25:08.530 INFO:teuthology.orchestra.run.smithi071.stdout:512 2024-04-20T21:25:08.530 INFO:teuthology.orchestra.run.smithi071.stdout:512.out 2024-04-20T21:25:08.530 INFO:teuthology.orchestra.run.smithi071.stdout:513 2024-04-20T21:25:08.530 INFO:teuthology.orchestra.run.smithi071.stdout:513.out 2024-04-20T21:25:08.530 INFO:teuthology.orchestra.run.smithi071.stdout:514 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:514.out 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:515 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:515.out 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:516 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:516.out 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:517 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:517.out 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:518 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:518.out 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:519 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:519.out 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:520 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:520.out 2024-04-20T21:25:08.531 INFO:teuthology.orchestra.run.smithi071.stdout:521 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:521.out 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:522 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:522.out 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:523 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:523.out 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:524 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:524.out 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:525 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:525.out 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:526 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:526.out 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:527 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:527.out 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:528 2024-04-20T21:25:08.532 INFO:teuthology.orchestra.run.smithi071.stdout:528.out 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:529 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:529.out 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:530 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:530.out 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:531 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:531.out 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:532 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:532.out 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:533 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:533.out 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:534 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:534.out 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:535 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:535.out 2024-04-20T21:25:08.533 INFO:teuthology.orchestra.run.smithi071.stdout:536 2024-04-20T21:25:08.534 INFO:teuthology.orchestra.run.smithi071.stdout:536.out 2024-04-20T21:25:08.534 INFO:teuthology.orchestra.run.smithi071.stdout:537 2024-04-20T21:25:08.534 INFO:teuthology.orchestra.run.smithi071.stdout:537.out 2024-04-20T21:25:08.534 INFO:teuthology.orchestra.run.smithi071.stdout:538 2024-04-20T21:25:08.534 INFO:teuthology.orchestra.run.smithi071.stdout:538.out 2024-04-20T21:25:08.534 INFO:teuthology.orchestra.run.smithi071.stdout:539 2024-04-20T21:25:08.534 INFO:teuthology.orchestra.run.smithi071.stdout:539.out 2024-04-20T21:25:08.534 INFO:teuthology.orchestra.run.smithi071.stdout:540 2024-04-20T21:25:08.534 INFO:teuthology.orchestra.run.smithi071.stdout:540.out 2024-04-20T21:25:08.534 INFO:teuthology.orchestra.run.smithi071.stdout:541 2024-04-20T21:25:08.535 INFO:teuthology.orchestra.run.smithi071.stdout:541.out 2024-04-20T21:25:08.535 INFO:teuthology.orchestra.run.smithi071.stdout:542 2024-04-20T21:25:08.535 INFO:teuthology.orchestra.run.smithi071.stdout:542.out 2024-04-20T21:25:08.535 INFO:teuthology.orchestra.run.smithi071.stdout:543 2024-04-20T21:25:08.535 INFO:teuthology.orchestra.run.smithi071.stdout:543.out 2024-04-20T21:25:08.535 INFO:teuthology.orchestra.run.smithi071.stdout:544 2024-04-20T21:25:08.535 INFO:teuthology.orchestra.run.smithi071.stdout:544.out 2024-04-20T21:25:08.535 INFO:teuthology.orchestra.run.smithi071.stdout:545 2024-04-20T21:25:08.535 INFO:teuthology.orchestra.run.smithi071.stdout:545.out 2024-04-20T21:25:08.535 INFO:teuthology.orchestra.run.smithi071.stdout:546 2024-04-20T21:25:08.536 INFO:teuthology.orchestra.run.smithi071.stdout:546.out 2024-04-20T21:25:08.536 INFO:teuthology.orchestra.run.smithi071.stdout:547 2024-04-20T21:25:08.536 INFO:teuthology.orchestra.run.smithi071.stdout:547.out 2024-04-20T21:25:08.536 INFO:teuthology.orchestra.run.smithi071.stdout:548 2024-04-20T21:25:08.536 INFO:teuthology.orchestra.run.smithi071.stdout:548.out 2024-04-20T21:25:08.536 INFO:teuthology.orchestra.run.smithi071.stdout:549 2024-04-20T21:25:08.536 INFO:teuthology.orchestra.run.smithi071.stdout:549.out 2024-04-20T21:25:08.536 INFO:teuthology.orchestra.run.smithi071.stdout:550 2024-04-20T21:25:08.536 INFO:teuthology.orchestra.run.smithi071.stdout:550.out 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:551 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:551.out 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:552 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:552.out 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:553 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:553.out 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:554 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:554.out 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:555 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:555.out 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:556 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:556.out 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:557 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:557.out 2024-04-20T21:25:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:558 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:558.out 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:559 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:559.out 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:560 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:560.out 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:561 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:561.out 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:562 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:562.out 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:563 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:563.out 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:564 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:564.out 2024-04-20T21:25:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:565 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:565.out 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:566 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:566.out 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:567 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:567.out 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:568 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:568.out 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:569 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:569.out 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:570 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:570.out 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:571 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:571.out 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:572 2024-04-20T21:25:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:572.out 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:573 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:573.out 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:574 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:574.out 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:575 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:575.out 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:576 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:576.out 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:577 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:577.out 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:578 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:578.out 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:579 2024-04-20T21:25:08.540 INFO:teuthology.orchestra.run.smithi071.stdout:579.out 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:580 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:580.out 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:581 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:581.out 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:582 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:582.out 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:583 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:583.out 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:584 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:584.out 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:585 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:585.out 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:586 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:586.out 2024-04-20T21:25:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:587 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:587.out 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:588 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:588.out 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:589 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:589.out 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:590 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:590.out 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:591 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:591.out 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:592 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:592.out 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:593 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:593.out 2024-04-20T21:25:08.542 INFO:teuthology.orchestra.run.smithi071.stdout:594 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:594.out 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:595 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:595.out 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:596 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:596.out 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:597 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:597.out 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:598 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:598.out 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:599 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:599.out 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:600 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:600.out 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:601 2024-04-20T21:25:08.543 INFO:teuthology.orchestra.run.smithi071.stdout:601.out 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:602 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:602.out 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:603 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:603.out 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:604 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:604.out 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:605 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:605.out 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:606 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:606.out 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:607 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:607.out 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:608 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:608.out 2024-04-20T21:25:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:609 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:609.out 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:610 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:610.out 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:611 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:611.out 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:612 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:612.out 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:613 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:613.out 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:614 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:614.out 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:615 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:615.out 2024-04-20T21:25:08.545 INFO:teuthology.orchestra.run.smithi071.stdout:616 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:616.out 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:617 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:617.out 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:618 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:618.out 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:619 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:619.out 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:620 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:620.out 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:621 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:621.out 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:622 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:622.out 2024-04-20T21:25:08.546 INFO:teuthology.orchestra.run.smithi071.stdout:623 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:623.out 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:624 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:624.out 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:625 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:625.out 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:626 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:626.out 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:627 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:627.out 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:628 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:628.out 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:629 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:629.out 2024-04-20T21:25:08.547 INFO:teuthology.orchestra.run.smithi071.stdout:630 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:630.out 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:631 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:631.out 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:632 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:632.out 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:633 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:633.out 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:634 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:634.out 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:635 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:635.out 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:636 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:636.out 2024-04-20T21:25:08.548 INFO:teuthology.orchestra.run.smithi071.stdout:637 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:637.out 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:638 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:638.out 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:639 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:639.out 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:640 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:640.out 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:641 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:641.out 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:642 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:642.out 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:643 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:643.out 2024-04-20T21:25:08.549 INFO:teuthology.orchestra.run.smithi071.stdout:644 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:644.out 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:645 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:645.out 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:646 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:646.out 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:647 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:647.out 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:648 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:648.out 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:649 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:649.out 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:650 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:650.out 2024-04-20T21:25:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:651 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:651.out 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:652 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:652.out 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:653 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:653.out 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:654 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:654.out 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:655 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:655.out 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:656 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:656.out 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:657 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:657.out 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:658 2024-04-20T21:25:08.551 INFO:teuthology.orchestra.run.smithi071.stdout:658.out 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:659 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:659.out 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:660 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:660.out 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:661 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:661.out 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:662 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:662.out 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:663 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:663.out 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:664 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:664.out 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:665 2024-04-20T21:25:08.552 INFO:teuthology.orchestra.run.smithi071.stdout:665.out 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:666 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:666.out 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:667 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:667.out 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:668 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:668.out 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:669 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:669.out 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:670 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:670.out 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:671 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:671.out 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:672 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:672.out 2024-04-20T21:25:08.553 INFO:teuthology.orchestra.run.smithi071.stdout:673 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:673.out 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:674 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:674.out 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:675 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:675.out 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:676 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:676.out 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:677 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:677.out 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:678 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:678.out 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:679 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:679.out 2024-04-20T21:25:08.554 INFO:teuthology.orchestra.run.smithi071.stdout:680 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:680.out 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:681 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:681.out 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:682 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:682.out 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:683 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:683.out 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:684 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:684.out 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:685 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:685.out 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:686 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:686.out 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:687 2024-04-20T21:25:08.555 INFO:teuthology.orchestra.run.smithi071.stdout:687.out 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:688 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:688.out 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:689 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:689.out 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:690 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:690.out 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:691 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:691.out 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:692 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:692.out 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:693 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:693.out 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:694 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:694.out 2024-04-20T21:25:08.556 INFO:teuthology.orchestra.run.smithi071.stdout:695 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:695.out 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:696 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:696.out 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:697 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:697.out 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:698 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:698.out 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:699 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:699.out 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:700 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:700.out 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:701 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:701.out 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:702 2024-04-20T21:25:08.557 INFO:teuthology.orchestra.run.smithi071.stdout:702.out 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:703 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:703.out 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:704 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:704.out 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:705 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:705.out 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:706 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:706.out 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:707 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:707.out 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:708 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:708.out 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:709 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:709.out 2024-04-20T21:25:08.558 INFO:teuthology.orchestra.run.smithi071.stdout:710 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:710.out 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:711 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:711.out 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:712 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:712.out 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:713 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:713.out 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:714 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:714.out 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:715 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:715.out 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:716 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:716.out 2024-04-20T21:25:08.559 INFO:teuthology.orchestra.run.smithi071.stdout:717 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:717.out 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:718 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:718.out 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:719 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:719.out 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:720 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:720.out 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:721 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:721.out 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:722 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:722.out 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:723 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:723.out 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:724 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:724.out 2024-04-20T21:25:08.560 INFO:teuthology.orchestra.run.smithi071.stdout:725 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:725.out 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:726 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:726.out 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:727 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:727.out 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:728 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:728.out 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:729 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:729.out 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:730 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:730.out 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:731 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:731.out 2024-04-20T21:25:08.561 INFO:teuthology.orchestra.run.smithi071.stdout:732 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:732.out 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:733 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:733.out 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:734 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:734.out 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:735 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:735.out 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:736 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:736.out 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:737 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:737.out 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:738 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:738.out 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:739 2024-04-20T21:25:08.562 INFO:teuthology.orchestra.run.smithi071.stdout:739.out 2024-04-20T21:25:08.563 INFO:teuthology.orchestra.run.smithi071.stdout:741 2024-04-20T21:25:08.563 INFO:teuthology.orchestra.run.smithi071.stdout:741.out 2024-04-20T21:25:08.563 INFO:teuthology.orchestra.run.smithi071.stdout:742 2024-04-20T21:25:08.563 INFO:teuthology.orchestra.run.smithi071.stdout:742.out 2024-04-20T21:25:08.563 INFO:teuthology.orchestra.run.smithi071.stdout:743 2024-04-20T21:25:08.563 INFO:teuthology.orchestra.run.smithi071.stdout:743.out 2024-04-20T21:25:08.563 INFO:teuthology.orchestra.run.smithi071.stdout:group.list 2024-04-20T21:25:08.563 INFO:teuthology.orchestra.run.smithi071.stdout:Makefile 2024-04-20T21:25:08.564 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-04-20T21:25:09.101 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:25:09.115 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:25:09.116 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:25:17.124 INFO:teuthology.orchestra.run.smithi071.stdout:generic/001 8s 2024-04-20T21:25:17.140 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/001 2024-04-20T21:25:17.140 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:25:17.149 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:25:17.153 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[39695]: fuse finished with error 0 and tester_r 0 2024-04-20T21:25:17.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:25:17.176 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-04-20T21:25:17.688 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:25:17.700 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:25:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:25:19.127 INFO:teuthology.orchestra.run.smithi071.stdout:generic/002 2s 2024-04-20T21:25:19.148 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/002 2024-04-20T21:25:19.148 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:25:19.159 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:25:19.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:25:19.191 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-04-20T21:25:19.682 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:25:19.695 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:25:19.696 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:25:20.110 INFO:teuthology.orchestra.run.smithi071.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:25:20.123 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/003 2024-04-20T21:25:20.123 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/003 2024-04-20T21:25:20.123 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:25:20.134 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:25:20.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:25:20.163 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-04-20T21:25:20.689 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:25:20.702 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:25:20.702 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:25:21.161 INFO:teuthology.orchestra.run.smithi071.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-04-20T21:25:21.173 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/004 2024-04-20T21:25:21.173 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/004 2024-04-20T21:25:21.173 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:25:21.183 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:25:21.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:25:21.212 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-04-20T21:25:21.743 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:25:21.757 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:25:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:25:24.113 INFO:teuthology.orchestra.run.smithi071.stdout:generic/005 3s 2024-04-20T21:25:24.131 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/005 2024-04-20T21:25:24.131 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:25:24.139 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:25:24.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:25:24.170 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-04-20T21:25:24.668 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:25:24.682 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:25:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:25:24.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:25:24.965 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:25:55.113 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:25:55.124 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:26:25.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:26:25.249 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:26:55.373 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:26:55.382 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:27:04.024 INFO:teuthology.orchestra.run.smithi071.stdout:generic/006 100s 2024-04-20T21:27:04.144 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/006 2024-04-20T21:27:04.144 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:27:04.154 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:27:04.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:27:04.194 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-04-20T21:27:04.787 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:27:04.799 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:27:04.799 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:27:25.536 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:27:25.545 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:27:55.667 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:27:55.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:28:25.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:28:25.892 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:28:56.027 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:28:56.036 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:29:26.162 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:29:26.171 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:29:56.290 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:29:56.298 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:30:26.692 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:30:26.701 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:30:56.827 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:30:56.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:31:12.789 INFO:teuthology.orchestra.run.smithi071.stdout:generic/007 248s 2024-04-20T21:31:12.805 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/007 2024-04-20T21:31:12.805 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:31:12.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:31:12.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:31:12.853 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-04-20T21:31:13.322 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:31:13.335 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:31:13.335 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:31:17.808 INFO:teuthology.orchestra.run.smithi071.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-20T21:31:17.819 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/008 2024-04-20T21:31:17.820 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/008 2024-04-20T21:31:17.820 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:31:17.831 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:31:17.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:31:17.863 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-04-20T21:31:18.394 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:31:18.408 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:31:18.409 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:31:21.872 INFO:teuthology.orchestra.run.smithi071.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-20T21:31:21.884 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/009 2024-04-20T21:31:21.884 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/009 2024-04-20T21:31:21.884 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:31:21.893 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:31:21.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:31:21.925 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-04-20T21:31:22.445 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:31:22.458 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:31:22.458 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:31:24.411 INFO:teuthology.orchestra.run.smithi071.stdout:generic/010 2s 2024-04-20T21:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/010 2024-04-20T21:31:24.428 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:31:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:31:24.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:31:24.489 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-04-20T21:31:24.963 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:31:24.977 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:31:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:31:26.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:31:27.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:31:57.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:31:57.155 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:32:27.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:32:27.274 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:32:58.416 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:32:58.425 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:33:01.658 INFO:teuthology.orchestra.run.smithi071.stdout:generic/011 97s 2024-04-20T21:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/011 2024-04-20T21:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:33:01.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:33:01.727 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-04-20T21:33:02.283 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:33:02.297 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:33:02.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:33:06.956 INFO:teuthology.orchestra.run.smithi071.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-20T21:33:06.969 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/012 2024-04-20T21:33:06.970 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/012 2024-04-20T21:33:06.970 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:33:06.981 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:33:07.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:33:07.026 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-04-20T21:33:07.497 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:33:07.511 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:33:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:33:28.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:33:28.543 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:33:58.716 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:33:58.722 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:34:29.930 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:34:29.937 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:34:30.071 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-20T21:34:30.072+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 29958) UID: 0 2024-04-20T21:34:30.072 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-20T21:34:30.072+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 29958) UID: 0 2024-04-20T21:35:16.703 INFO:teuthology.orchestra.run.smithi071.stdout:generic/013 129s 2024-04-20T21:35:16.719 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/013 2024-04-20T21:35:16.719 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:16.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:16.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:16.757 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-04-20T21:35:17.323 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:17.337 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:17.788 INFO:teuthology.orchestra.run.smithi071.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-04-20T21:35:17.799 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/014 2024-04-20T21:35:17.799 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/014 2024-04-20T21:35:17.799 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:17.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:17.838 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-04-20T21:35:18.381 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:18.399 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:18.773 INFO:teuthology.orchestra.run.smithi071.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:35:18.784 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/015 2024-04-20T21:35:18.784 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/015 2024-04-20T21:35:18.784 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:18.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:18.824 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-04-20T21:35:19.356 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:19.370 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:22.045 INFO:teuthology.orchestra.run.smithi071.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-20T21:35:22.057 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/016 2024-04-20T21:35:22.057 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/016 2024-04-20T21:35:22.057 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:22.066 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:22.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:22.108 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-04-20T21:35:22.706 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:22.722 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:22.722 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:23.113 INFO:teuthology.orchestra.run.smithi071.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:35:23.124 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/017 2024-04-20T21:35:23.124 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/017 2024-04-20T21:35:23.124 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:23.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:23.169 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-04-20T21:35:23.710 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:23.724 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:23.724 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:24.099 INFO:teuthology.orchestra.run.smithi071.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:35:24.110 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/018 2024-04-20T21:35:24.110 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/018 2024-04-20T21:35:24.111 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:24.119 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:24.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:24.148 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-04-20T21:35:24.688 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:24.707 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:25.092 INFO:teuthology.orchestra.run.smithi071.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:35:25.103 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/019 2024-04-20T21:35:25.103 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/019 2024-04-20T21:35:25.103 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:25.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:25.133 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-04-20T21:35:25.609 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:25.624 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:25.624 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:42.854 INFO:teuthology.orchestra.run.smithi071.stdout:generic/020 - output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/020.out.bad) 2024-04-20T21:35:42.864 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/020.out 2024-04-20 21:21:29.602926072 +0000 2024-04-20T21:35:42.864 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/020.out.bad 2024-04-20 21:35:42.852098666 +0000 2024-04-20T21:35:42.864 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -47,9 +47,13 @@ 2024-04-20T21:35:42.864 INFO:teuthology.orchestra.run.smithi071.stdout: user.snrub="fish2\012" 2024-04-20T21:35:42.864 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:42.864 INFO:teuthology.orchestra.run.smithi071.stdout: *** really long value 2024-04-20T21:35:42.864 INFO:teuthology.orchestra.run.smithi071.stdout: -0000000 00 2024-04-20T21:35:42.865 INFO:teuthology.orchestra.run.smithi071.stdout: -* 2024-04-20T21:35:42.865 INFO:teuthology.orchestra.run.smithi071.stdout: -ATTRSIZE 2024-04-20T21:35:42.865 INFO:teuthology.orchestra.run.smithi071.stdout: +attr_set: No space left on device 2024-04-20T21:35:42.865 INFO:teuthology.orchestra.run.smithi071.stdout: +Could not set "long_attr" for 2024-04-20T21:35:42.865 INFO:teuthology.orchestra.run.smithi071.stdout: +attr_get: No data available 2024-04-20T21:35:42.865 INFO:teuthology.orchestra.run.smithi071.stdout: +Could not get "long_attr" for 2024-04-20T21:35:42.865 INFO:teuthology.orchestra.run.smithi071.stdout: +0000000 2024-04-20T21:35:42.865 INFO:teuthology.orchestra.run.smithi071.stdout: +attr_remove: No data available 2024-04-20T21:35:42.865 INFO:teuthology.orchestra.run.smithi071.stdout: +Could not remove "long_attr" for 2024-04-20T21:35:42.865 INFO:teuthology.orchestra.run.smithi071.stdout: *** set/get/remove really long names (expect failure) 2024-04-20T21:35:42.866 INFO:teuthology.orchestra.run.smithi071.stdout: attr_set: Invalid argument 2024-04-20T21:35:42.866 INFO:teuthology.orchestra.run.smithi071.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2024-04-20T21:35:42.871 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/020 2024-04-20T21:35:42.871 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/020 2024-04-20T21:35:42.872 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-20T21:35:42.879 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:42.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:35:42.920 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-20T21:35:42.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-20T21:35:42.920 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-04-20T21:35:43.542 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:43.558 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:43.558 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:46.329 INFO:teuthology.orchestra.run.smithi071.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-20T21:35:46.341 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/021 2024-04-20T21:35:46.341 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/021 2024-04-20T21:35:46.341 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:46.349 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:46.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:46.386 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-04-20T21:35:47.002 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:47.016 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:49.789 INFO:teuthology.orchestra.run.smithi071.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-20T21:35:49.798 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/022 2024-04-20T21:35:49.798 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/022 2024-04-20T21:35:49.798 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:49.808 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:49.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:49.864 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-04-20T21:35:50.468 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:50.484 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:50.485 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:53.587 INFO:teuthology.orchestra.run.smithi071.stdout:generic/023 3s 2024-04-20T21:35:53.604 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/023 2024-04-20T21:35:53.604 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:53.613 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:53.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:53.641 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-04-20T21:35:54.257 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:54.273 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:54.727 INFO:teuthology.orchestra.run.smithi071.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-04-20T21:35:54.737 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/024 2024-04-20T21:35:54.737 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/024 2024-04-20T21:35:54.738 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:54.749 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:54.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:54.780 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-04-20T21:35:55.398 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:55.411 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:55.412 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:55.868 INFO:teuthology.orchestra.run.smithi071.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-04-20T21:35:55.879 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/025 2024-04-20T21:35:55.880 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/025 2024-04-20T21:35:55.880 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:55.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:55.947 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-04-20T21:35:56.551 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:56.571 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:56.571 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:57.042 INFO:teuthology.orchestra.run.smithi071.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-20T21:35:57.053 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/026 2024-04-20T21:35:57.053 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/026 2024-04-20T21:35:57.053 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:57.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:57.088 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-04-20T21:35:57.630 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:57.645 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:58.008 INFO:teuthology.orchestra.run.smithi071.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:35:58.019 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/027 2024-04-20T21:35:58.019 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/027 2024-04-20T21:35:58.019 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:35:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:35:58.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:35:58.060 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-04-20T21:35:58.603 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:35:58.617 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:35:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:04.051 INFO:teuthology.orchestra.run.smithi071.stdout:generic/028 6s 2024-04-20T21:36:04.069 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/028 2024-04-20T21:36:04.070 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:04.081 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:04.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:04.110 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-04-20T21:36:04.662 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:04.679 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:04.679 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:05.062 INFO:teuthology.orchestra.run.smithi071.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:05.073 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/029 2024-04-20T21:36:05.073 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/029 2024-04-20T21:36:05.073 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:05.083 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:05.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:05.114 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-04-20T21:36:05.583 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:05.598 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:05.598 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:05.973 INFO:teuthology.orchestra.run.smithi071.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:05.986 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/030 2024-04-20T21:36:05.986 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/030 2024-04-20T21:36:05.986 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:06.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:06.021 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-04-20T21:36:06.553 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:06.567 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:06.943 INFO:teuthology.orchestra.run.smithi071.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:06.955 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/031 2024-04-20T21:36:06.955 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/031 2024-04-20T21:36:06.955 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:06.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:06.994 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-04-20T21:36:07.519 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:07.532 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:07.532 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:07.900 INFO:teuthology.orchestra.run.smithi071.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:07.912 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/032 2024-04-20T21:36:07.912 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/032 2024-04-20T21:36:07.912 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:07.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:07.952 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-04-20T21:36:08.524 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:08.537 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:08.537 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:08.917 INFO:teuthology.orchestra.run.smithi071.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:08.927 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/033 2024-04-20T21:36:08.928 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/033 2024-04-20T21:36:08.928 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:08.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:08.968 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-04-20T21:36:09.545 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:09.558 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:09.989 INFO:teuthology.orchestra.run.smithi071.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:10.004 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/034 2024-04-20T21:36:10.004 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/034 2024-04-20T21:36:10.004 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:10.016 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:10.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:10.046 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-04-20T21:36:10.562 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:10.578 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:10.579 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:11.135 INFO:teuthology.orchestra.run.smithi071.stdout:generic/035 1s 2024-04-20T21:36:11.275 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/035 2024-04-20T21:36:11.275 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:11.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:11.341 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-04-20T21:36:12.183 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:12.198 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:22.780 INFO:teuthology.orchestra.run.smithi071.stdout:generic/036 10s 2024-04-20T21:36:22.797 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/036 2024-04-20T21:36:22.797 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:22.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:22.847 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-04-20T21:36:23.468 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:23.484 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:23.871 INFO:teuthology.orchestra.run.smithi071.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:23.881 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/037 2024-04-20T21:36:23.881 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/037 2024-04-20T21:36:23.881 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:23.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:23.921 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-04-20T21:36:24.463 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:24.477 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:24.857 INFO:teuthology.orchestra.run.smithi071.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:24.868 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/038 2024-04-20T21:36:24.869 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/038 2024-04-20T21:36:24.869 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:24.878 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:24.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:24.910 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-04-20T21:36:25.452 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:25.467 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:25.467 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:25.873 INFO:teuthology.orchestra.run.smithi071.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:25.883 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/039 2024-04-20T21:36:25.883 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/039 2024-04-20T21:36:25.883 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:25.891 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:25.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:25.924 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-04-20T21:36:26.478 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:26.491 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:26.911 INFO:teuthology.orchestra.run.smithi071.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:26.923 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/040 2024-04-20T21:36:26.923 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/040 2024-04-20T21:36:26.923 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:26.931 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:26.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:26.961 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-04-20T21:36:27.483 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:27.498 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:27.900 INFO:teuthology.orchestra.run.smithi071.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:27.911 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/041 2024-04-20T21:36:27.911 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/041 2024-04-20T21:36:27.911 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:27.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:27.951 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-04-20T21:36:28.515 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:28.528 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:28.528 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:28.900 INFO:teuthology.orchestra.run.smithi071.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:28.911 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/042 2024-04-20T21:36:28.911 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/042 2024-04-20T21:36:28.911 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:28.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:28.955 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-04-20T21:36:29.504 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:29.518 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:29.519 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:29.887 INFO:teuthology.orchestra.run.smithi071.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:29.901 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/043 2024-04-20T21:36:29.902 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/043 2024-04-20T21:36:29.902 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:29.910 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:29.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:29.940 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-04-20T21:36:30.484 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:30.498 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:30.860 INFO:teuthology.orchestra.run.smithi071.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:30.874 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/044 2024-04-20T21:36:30.874 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/044 2024-04-20T21:36:30.874 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:30.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:30.913 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-04-20T21:36:31.454 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:31.469 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:31.830 INFO:teuthology.orchestra.run.smithi071.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:31.843 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/045 2024-04-20T21:36:31.843 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/045 2024-04-20T21:36:31.843 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:31.852 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:31.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:31.880 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-04-20T21:36:32.432 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:32.445 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:32.445 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:32.809 INFO:teuthology.orchestra.run.smithi071.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:32.821 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/046 2024-04-20T21:36:32.821 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/046 2024-04-20T21:36:32.821 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:32.829 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:32.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:32.855 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-04-20T21:36:33.394 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:33.410 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:33.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:33.772 INFO:teuthology.orchestra.run.smithi071.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:33.784 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/047 2024-04-20T21:36:33.784 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/047 2024-04-20T21:36:33.784 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:33.792 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:33.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:33.825 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-04-20T21:36:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:34.397 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:34.765 INFO:teuthology.orchestra.run.smithi071.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:34.777 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/048 2024-04-20T21:36:34.777 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/048 2024-04-20T21:36:34.777 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:34.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:34.812 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-04-20T21:36:35.372 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:35.387 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:35.763 INFO:teuthology.orchestra.run.smithi071.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:35.778 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/049 2024-04-20T21:36:35.778 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/049 2024-04-20T21:36:35.778 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:35.786 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:35.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:35.816 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-04-20T21:36:36.345 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:36.359 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:36.359 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:36.762 INFO:teuthology.orchestra.run.smithi071.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:36.773 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/050 2024-04-20T21:36:36.773 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/050 2024-04-20T21:36:36.773 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:36.781 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:36.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:36.808 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-04-20T21:36:37.335 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:37.345 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:37.345 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:37.716 INFO:teuthology.orchestra.run.smithi071.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:37.725 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/051 2024-04-20T21:36:37.725 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/051 2024-04-20T21:36:37.725 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:37.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:37.761 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-04-20T21:36:38.315 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:38.328 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:38.684 INFO:teuthology.orchestra.run.smithi071.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:38.693 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/052 2024-04-20T21:36:38.693 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/052 2024-04-20T21:36:38.693 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:38.702 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:38.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:38.739 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-04-20T21:36:39.270 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:39.285 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:39.668 INFO:teuthology.orchestra.run.smithi071.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/053 2024-04-20T21:36:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/053 2024-04-20T21:36:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:39.689 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:39.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:39.725 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-04-20T21:36:40.345 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:40.356 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:40.357 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:40.754 INFO:teuthology.orchestra.run.smithi071.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:40.765 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/054 2024-04-20T21:36:40.765 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/054 2024-04-20T21:36:40.765 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:40.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:40.801 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-04-20T21:36:41.357 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:41.375 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:41.375 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:42.062 INFO:teuthology.orchestra.run.smithi071.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:42.072 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/055 2024-04-20T21:36:42.072 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/055 2024-04-20T21:36:42.072 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:42.080 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:42.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:42.113 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-04-20T21:36:42.678 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:42.695 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:42.695 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:43.125 INFO:teuthology.orchestra.run.smithi071.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:43.135 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/056 2024-04-20T21:36:43.135 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/056 2024-04-20T21:36:43.135 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:43.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:43.181 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-04-20T21:36:43.746 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:43.763 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:43.763 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:44.191 INFO:teuthology.orchestra.run.smithi071.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:44.203 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/057 2024-04-20T21:36:44.203 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/057 2024-04-20T21:36:44.204 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:44.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:44.246 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-04-20T21:36:44.794 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:44.809 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:47.394 INFO:teuthology.orchestra.run.smithi071.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-20T21:36:47.406 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/058 2024-04-20T21:36:47.406 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/058 2024-04-20T21:36:47.407 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:47.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:47.447 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-04-20T21:36:48.074 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:48.090 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:48.090 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:48.487 INFO:teuthology.orchestra.run.smithi071.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:48.500 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/059 2024-04-20T21:36:48.500 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/059 2024-04-20T21:36:48.500 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:48.509 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:48.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:48.536 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-04-20T21:36:49.101 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:49.116 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:49.116 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:51.653 INFO:teuthology.orchestra.run.smithi071.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-20T21:36:51.666 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/060 2024-04-20T21:36:51.666 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/060 2024-04-20T21:36:51.666 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:51.677 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:51.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:51.725 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-04-20T21:36:52.326 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:52.341 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:52.341 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:54.894 INFO:teuthology.orchestra.run.smithi071.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-20T21:36:54.904 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/061 2024-04-20T21:36:54.904 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/061 2024-04-20T21:36:54.905 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:54.912 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:54.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:54.947 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-04-20T21:36:55.579 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:55.594 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:55.594 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:55.973 INFO:teuthology.orchestra.run.smithi071.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:36:55.985 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/062 2024-04-20T21:36:55.985 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/062 2024-04-20T21:36:55.985 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:55.993 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:56.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:56.024 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-04-20T21:36:56.555 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:56.570 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:56.570 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:59.113 INFO:teuthology.orchestra.run.smithi071.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-20T21:36:59.124 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/063 2024-04-20T21:36:59.124 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/063 2024-04-20T21:36:59.124 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:36:59.133 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:36:59.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:36:59.166 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-04-20T21:36:59.757 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:36:59.775 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:36:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:00.145 INFO:teuthology.orchestra.run.smithi071.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:37:00.157 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/064 2024-04-20T21:37:00.157 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/064 2024-04-20T21:37:00.157 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:37:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:00.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:37:00.190 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-04-20T21:37:00.723 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:37:00.736 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:37:00.736 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:01.138 INFO:teuthology.orchestra.run.smithi071.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:37:01.149 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/065 2024-04-20T21:37:01.149 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/065 2024-04-20T21:37:01.149 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:37:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:01.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:37:01.187 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-04-20T21:37:01.724 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:37:01.736 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:37:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:02.137 INFO:teuthology.orchestra.run.smithi071.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:37:02.147 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/066 2024-04-20T21:37:02.147 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/066 2024-04-20T21:37:02.147 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:37:02.155 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:02.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:37:02.183 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-04-20T21:37:02.737 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:37:02.752 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:37:02.752 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:03.181 INFO:teuthology.orchestra.run.smithi071.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:37:03.193 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/067 2024-04-20T21:37:03.193 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/067 2024-04-20T21:37:03.193 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:37:03.203 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:03.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:37:03.238 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-04-20T21:37:03.784 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:37:03.799 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:37:03.799 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:04.198 INFO:teuthology.orchestra.run.smithi071.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:37:04.208 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/068 2024-04-20T21:37:04.209 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/068 2024-04-20T21:37:04.209 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:37:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:04.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:37:04.248 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-04-20T21:37:04.779 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:37:04.795 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:37:04.795 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:05.179 INFO:teuthology.orchestra.run.smithi071.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:37:05.191 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/069 2024-04-20T21:37:05.191 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/069 2024-04-20T21:37:05.191 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:37:05.200 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:05.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:37:05.231 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-04-20T21:37:05.763 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:37:05.778 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:37:05.779 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:37:39.281 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:37:39.288 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:38:09.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:38:09.416 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:38:41.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:38:41.570 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:39:11.895 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:39:11.899 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:39:18.024 INFO:teuthology.orchestra.run.smithi071.stdout:generic/070 133s 2024-04-20T21:39:18.044 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/070 2024-04-20T21:39:18.044 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:39:18.052 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:39:18.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:39:18.083 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-04-20T21:39:18.766 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:39:18.781 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:39:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:39:19.145 INFO:teuthology.orchestra.run.smithi071.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:39:19.157 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/071 2024-04-20T21:39:19.157 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/071 2024-04-20T21:39:19.157 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:39:19.165 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:39:19.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:39:19.196 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-04-20T21:39:19.812 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:39:19.828 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:39:19.828 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:39:22.235 INFO:teuthology.orchestra.run.smithi071.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-04-20T21:39:22.247 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/072 2024-04-20T21:39:22.247 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/072 2024-04-20T21:39:22.247 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:39:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:39:22.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:39:22.286 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-04-20T21:39:22.833 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:39:22.845 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:39:22.845 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:39:23.239 INFO:teuthology.orchestra.run.smithi071.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T21:39:23.251 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/073 2024-04-20T21:39:23.251 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/073 2024-04-20T21:39:23.251 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T21:39:23.260 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:39:23.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T21:39:23.290 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-04-20T21:39:23.818 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T21:39:23.832 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T21:39:23.832 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T21:39:42.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:39:42.055 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:40:14.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:40:14.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:40:44.467 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:40:44.473 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:41:15.847 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:41:15.853 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:41:49.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:41:49.993 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:42:20.346 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:42:20.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:42:50.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:42:50.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:43:20.955 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:43:20.961 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:43:51.158 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:43:51.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:44:22.710 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:44:22.718 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:44:52.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:44:52.868 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:45:23.022 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:45:23.028 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:45:53.143 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:45:53.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:46:23.356 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:46:23.361 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:46:55.789 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:46:55.795 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:47:26.221 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:47:26.228 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:47:58.871 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:47:58.877 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:48:29.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:48:29.810 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:48:59.928 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:48:59.936 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:49:30.926 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:49:30.932 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:50:03.481 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:50:03.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:50:34.830 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:50:34.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:51:04.981 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:51:04.988 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:51:05.119 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-20T21:51:05.121+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30539) UID: 0 2024-04-20T21:51:05.120 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-20T21:51:05.121+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30539) UID: 0 2024-04-20T21:51:05.120 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-20T21:51:05.121+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30539) UID: 0 2024-04-20T21:51:05.121 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-20T21:51:05.121+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30539) UID: 0 2024-04-20T21:55:10.264 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:55:10.269 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T21:55:10.427 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-20T21:55:10.428+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30662) UID: 0 2024-04-20T21:55:10.428 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-20T21:55:10.428+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30662) UID: 0 2024-04-20T21:55:10.428 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-20T21:55:10.428+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30662) UID: 0 2024-04-20T21:55:10.428 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-20T21:55:10.428+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30662) UID: 0 2024-04-20T21:55:10.443 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-20T21:55:10.444+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136913) UID: 0 2024-04-20T21:55:10.444 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-20T21:55:10.444+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136913) UID: 0 2024-04-20T21:55:10.444 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-20T21:55:10.444+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136913) UID: 0 2024-04-20T21:55:10.444 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-20T21:55:10.444+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136913) UID: 0 2024-04-20T22:11:06.500 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:11:06.509 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:11:06.708 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-20T22:11:06.707+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138555) UID: 0 2024-04-20T22:11:06.708 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-20T22:11:06.707+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138555) UID: 0 2024-04-20T22:11:06.708 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-20T22:11:06.707+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138555) UID: 0 2024-04-20T22:11:06.709 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-20T22:11:06.707+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138555) UID: 0 2024-04-20T22:11:06.788 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-20T22:11:06.789+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30961) UID: 0 2024-04-20T22:11:06.789 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-20T22:11:06.789+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30961) UID: 0 2024-04-20T22:11:06.789 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-20T22:11:06.789+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30961) UID: 0 2024-04-20T22:11:06.789 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-20T22:11:06.789+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 30961) UID: 0 2024-04-20T22:11:23.959 INFO:teuthology.orchestra.run.smithi071.stdout:generic/074 1920s 2024-04-20T22:11:23.991 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/074 2024-04-20T22:11:23.991 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:11:24.000 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:11:24.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:11:24.054 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-04-20T22:11:25.190 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:11:25.203 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:11:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:00.666 INFO:teuthology.orchestra.run.smithi071.stdout:generic/075 95s 2024-04-20T22:13:00.815 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/075 2024-04-20T22:13:00.815 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:00.828 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:00.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:00.874 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-04-20T22:13:01.531 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:01.542 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:01.542 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:01.910 INFO:teuthology.orchestra.run.smithi071.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T22:13:01.920 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/076 2024-04-20T22:13:01.920 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/076 2024-04-20T22:13:01.920 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:01.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:01.956 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-04-20T22:13:02.412 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:02.425 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:05.417 INFO:teuthology.orchestra.run.smithi071.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T22:13:05.428 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/077 2024-04-20T22:13:05.429 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/077 2024-04-20T22:13:05.429 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:05.438 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:05.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:05.468 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-04-20T22:13:05.951 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:05.962 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-04-20T22:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/078 2024-04-20T22:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/078 2024-04-20T22:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:06.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:06.472 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-04-20T22:13:07.126 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:07.137 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:07.674 INFO:teuthology.orchestra.run.smithi071.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-04-20T22:13:07.689 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/079 2024-04-20T22:13:07.689 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/079 2024-04-20T22:13:07.689 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:07.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:07.728 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-04-20T22:13:08.197 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:08.208 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:08.208 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:10.717 INFO:teuthology.orchestra.run.smithi071.stdout:generic/080 2s 2024-04-20T22:13:10.733 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/080 2024-04-20T22:13:10.733 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:10.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:10.773 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-04-20T22:13:11.238 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:11.644 INFO:teuthology.orchestra.run.smithi071.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T22:13:11.655 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/081 2024-04-20T22:13:11.655 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/081 2024-04-20T22:13:11.655 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:11.663 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:11.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:11.691 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-04-20T22:13:12.149 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:12.162 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:12.162 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:12.532 INFO:teuthology.orchestra.run.smithi071.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T22:13:12.542 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/082 2024-04-20T22:13:12.542 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/082 2024-04-20T22:13:12.542 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:12.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:12.573 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-04-20T22:13:13.058 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:13.071 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:13.071 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:13.447 INFO:teuthology.orchestra.run.smithi071.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T22:13:13.459 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/083 2024-04-20T22:13:13.459 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/083 2024-04-20T22:13:13.459 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:13.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:13.494 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-04-20T22:13:13.978 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:13.991 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:13.991 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:14.364 INFO:teuthology.orchestra.run.smithi071.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T22:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/084 2024-04-20T22:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/084 2024-04-20T22:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:14.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:14.410 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-04-20T22:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:14.898 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:14.898 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:15.399 INFO:teuthology.orchestra.run.smithi071.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T22:13:15.412 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/085 2024-04-20T22:13:15.412 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/085 2024-04-20T22:13:15.412 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:15.424 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:15.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:15.455 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-04-20T22:13:15.924 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:15.937 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:15.937 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:36.485 INFO:teuthology.orchestra.run.smithi071.stdout:generic/086 21s 2024-04-20T22:13:36.746 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/086 2024-04-20T22:13:36.747 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:36.759 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:37.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:37.006 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-04-20T22:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:39.594 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:39.594 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:40.895 INFO:teuthology.orchestra.run.smithi071.stdout:generic/087 1s 2024-04-20T22:13:40.914 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/087 2024-04-20T22:13:40.914 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:40.923 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:40.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:40.980 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-04-20T22:13:41.683 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:41.695 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:41.695 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:42.255 INFO:teuthology.orchestra.run.smithi071.stdout:generic/088 1s 2024-04-20T22:13:42.271 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/088 2024-04-20T22:13:42.271 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:13:42.279 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:13:42.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:13:42.308 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-04-20T22:13:42.988 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:13:43.000 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:13:43.000 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:15:30.222 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:15:30.230 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:16:00.383 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:16:00.393 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:16:30.522 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:16:30.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:17:00.650 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:17:00.659 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:17:31.851 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:17:31.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:18:01.987 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:18:01.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:18:32.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:18:32.235 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:19:02.357 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:19:02.367 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:19:32.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:19:32.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:20:03.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:20:03.020 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:20:33.158 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:20:33.167 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:21:03.514 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:21:03.522 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:21:03.620 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-20T22:21:03.620+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31188) UID: 0 2024-04-20T22:21:03.621 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-20T22:21:03.620+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31188) UID: 0 2024-04-20T22:23:51.774 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:23:51.783 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:24:21.910 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:24:21.918 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:24:52.040 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:24:52.050 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:25:22.171 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:25:22.179 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:25:52.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:25:52.730 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:26:22.854 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:26:22.863 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:26:52.999 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:26:53.008 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:27:24.113 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:27:24.122 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:27:54.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:27:54.259 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:28:24.398 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:28:24.407 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:28:54.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:28:54.537 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:29:24.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:29:24.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:29:54.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:29:54.850 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:30:24.981 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:30:24.989 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:30:55.120 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:30:55.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:30:55.243 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-20T22:30:55.242+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31473) UID: 0 2024-04-20T22:30:55.244 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-20T22:30:55.242+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31473) UID: 0 2024-04-20T22:33:49.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:33:49.669 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:34:19.778 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:34:19.787 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:34:49.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:34:49.906 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:35:20.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:35:20.034 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:35:50.140 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:35:50.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:36:20.310 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:36:20.316 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:36:50.433 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:36:50.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:37:20.555 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:37:20.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:37:51.568 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:37:51.577 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:38:21.717 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:38:21.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:38:52.347 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:38:52.361 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:39:22.501 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:39:22.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:39:52.682 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:39:52.689 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:40:22.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:40:22.791 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:40:52.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:40:52.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:41:23.023 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:41:23.035 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:41:23.129 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-20T22:41:23.129+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31776) UID: 0 2024-04-20T22:41:23.129 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-20T22:41:23.129+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31776) UID: 0 2024-04-20T22:44:06.988 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:44:06.998 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:44:37.192 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:44:37.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:45:07.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:45:07.346 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:45:37.469 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:45:37.478 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:46:07.632 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:46:07.640 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:46:37.914 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:46:37.922 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:47:08.052 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:47:08.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:47:39.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:47:39.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:48:09.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:48:09.185 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:48:39.341 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:48:39.350 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:49:09.480 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:49:09.489 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:49:39.606 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:49:39.615 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:50:09.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:50:09.784 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:50:39.929 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:50:39.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:50:40.076 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-20T22:50:40.076+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148597) UID: 0 2024-04-20T22:50:40.076 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-20T22:50:40.076+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148597) UID: 0 2024-04-20T22:50:40.076 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-20T22:50:40.076+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148597) UID: 0 2024-04-20T22:50:40.077 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-20T22:50:40.076+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148597) UID: 0 2024-04-20T22:53:47.493 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:53:47.503 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:53:47.601 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-20T22:53:47.601+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32062) UID: 0 2024-04-20T22:53:47.601 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-20T22:53:47.601+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32062) UID: 0 2024-04-20T22:54:23.267 INFO:teuthology.orchestra.run.smithi071.stdout:generic/089 2440s 2024-04-20T22:54:23.306 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/089 2024-04-20T22:54:23.306 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:54:23.316 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:54:23.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:54:23.353 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-04-20T22:54:24.303 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:54:24.316 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:54:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:54:24.911 INFO:teuthology.orchestra.run.smithi071.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T22:54:24.923 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/090 2024-04-20T22:54:24.923 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/090 2024-04-20T22:54:24.923 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T22:54:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:54:24.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T22:54:24.965 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-04-20T22:54:25.484 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T22:54:25.497 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T22:54:25.497 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T22:56:38.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:56:38.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:57:08.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:57:08.963 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:57:39.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:57:39.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:58:09.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:58:09.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:58:39.867 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:58:39.876 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:59:10.011 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:59:10.021 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:59:40.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T22:59:40.165 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:00:10.288 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:00:10.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:00:15.841 INFO:teuthology.orchestra.run.smithi071.stdout:generic/091 350s 2024-04-20T23:00:15.860 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/091 2024-04-20T23:00:15.860 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:00:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:15.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:00:15.901 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-04-20T23:00:16.611 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:00:16.624 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:00:16.624 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:17.201 INFO:teuthology.orchestra.run.smithi071.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-20T23:00:17.214 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/092 2024-04-20T23:00:17.215 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/092 2024-04-20T23:00:17.215 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:00:17.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:17.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:00:17.276 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-04-20T23:00:17.930 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:00:17.942 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:00:17.942 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:19.537 INFO:teuthology.orchestra.run.smithi071.stdout:generic/093 2s 2024-04-20T23:00:19.553 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/093 2024-04-20T23:00:19.553 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:00:19.562 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:19.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:00:19.590 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-04-20T23:00:20.282 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:00:20.292 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:00:20.292 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:20.706 INFO:teuthology.orchestra.run.smithi071.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:00:20.717 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/094 2024-04-20T23:00:20.717 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/094 2024-04-20T23:00:20.717 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:00:20.726 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:20.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:00:20.755 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-04-20T23:00:21.304 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:00:21.316 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:00:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:00:21.752 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/095 2024-04-20T23:00:21.752 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/095 2024-04-20T23:00:21.752 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:00:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:21.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:00:21.794 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-04-20T23:00:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:00:22.349 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:00:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:22.806 INFO:teuthology.orchestra.run.smithi071.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:00:22.820 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/096 2024-04-20T23:00:22.820 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/096 2024-04-20T23:00:22.820 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:00:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:22.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:00:22.867 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-04-20T23:00:23.437 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:00:23.450 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:00:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:24.617 INFO:teuthology.orchestra.run.smithi071.stdout:generic/097 1s 2024-04-20T23:00:24.630 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/097 2024-04-20T23:00:24.630 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:00:24.637 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:24.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:00:24.658 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-04-20T23:00:25.191 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:00:25.205 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:00:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:25.595 INFO:teuthology.orchestra.run.smithi071.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:00:25.606 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/098 2024-04-20T23:00:25.606 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/098 2024-04-20T23:00:25.606 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:00:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:25.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:00:25.645 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-04-20T23:00:26.207 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:00:26.222 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:00:26.222 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:26.773 INFO:teuthology.orchestra.run.smithi071.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-20T23:00:26.784 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/099 2024-04-20T23:00:26.785 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/099 2024-04-20T23:00:26.785 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:00:26.794 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:26.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:00:26.824 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-04-20T23:00:27.396 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:00:27.410 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:00:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:00:40.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:00:40.424 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:01:10.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:01:10.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:01:10.688 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-20T23:01:10.687+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 167737) UID: 0 2024-04-20T23:01:10.688 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-20T23:01:10.687+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 167737) UID: 0 2024-04-20T23:01:10.688 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-20T23:01:10.687+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 167737) UID: 0 2024-04-20T23:01:10.688 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-20T23:01:10.687+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 167737) UID: 0 2024-04-20T23:02:12.839 INFO:teuthology.orchestra.run.smithi071.stdout:generic/100 105s 2024-04-20T23:02:12.854 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/100 2024-04-20T23:02:12.854 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:12.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:12.923 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-04-20T23:02:13.638 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:13.649 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:13.649 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:14.049 INFO:teuthology.orchestra.run.smithi071.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:02:14.060 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/101 2024-04-20T23:02:14.060 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/101 2024-04-20T23:02:14.060 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:14.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:14.097 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-04-20T23:02:14.602 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:14.614 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:14.991 INFO:teuthology.orchestra.run.smithi071.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:02:15.002 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/102 2024-04-20T23:02:15.002 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/102 2024-04-20T23:02:15.002 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:15.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:15.036 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-04-20T23:02:15.515 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:15.528 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:15.902 INFO:teuthology.orchestra.run.smithi071.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:02:15.913 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/103 2024-04-20T23:02:15.913 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/103 2024-04-20T23:02:15.913 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:15.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:15.948 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-04-20T23:02:16.430 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:16.444 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:16.849 INFO:teuthology.orchestra.run.smithi071.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:02:16.860 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/104 2024-04-20T23:02:16.860 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/104 2024-04-20T23:02:16.860 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:16.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:16.899 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-04-20T23:02:17.370 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:17.381 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:17.381 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:17.733 INFO:teuthology.orchestra.run.smithi071.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:02:17.743 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/105 2024-04-20T23:02:17.743 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/105 2024-04-20T23:02:17.743 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:17.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:17.774 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-04-20T23:02:18.213 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:18.225 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:18.225 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:18.965 INFO:teuthology.orchestra.run.smithi071.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:02:18.973 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/106 2024-04-20T23:02:18.973 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/106 2024-04-20T23:02:18.973 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:18.981 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:19.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:19.008 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-04-20T23:02:19.489 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:19.501 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:19.501 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:19.902 INFO:teuthology.orchestra.run.smithi071.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:02:19.912 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/107 2024-04-20T23:02:19.912 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/107 2024-04-20T23:02:19.912 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:19.919 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:19.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:19.947 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-04-20T23:02:20.416 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:20.428 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:21.304 INFO:teuthology.orchestra.run.smithi071.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:02:21.316 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/108 2024-04-20T23:02:21.316 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/108 2024-04-20T23:02:21.316 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:21.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:21.356 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-04-20T23:02:21.876 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:21.890 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:21.890 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:22.280 INFO:teuthology.orchestra.run.smithi071.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:02:22.289 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/109 2024-04-20T23:02:22.290 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/109 2024-04-20T23:02:22.290 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:22.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:22.323 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-04-20T23:02:22.793 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:22.805 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:23.302 INFO:teuthology.orchestra.run.smithi071.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:02:23.313 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/110 2024-04-20T23:02:23.313 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/110 2024-04-20T23:02:23.313 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:23.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:23.348 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-04-20T23:02:24.023 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:24.033 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:24.033 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:24.495 INFO:teuthology.orchestra.run.smithi071.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:02:24.505 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/111 2024-04-20T23:02:24.505 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/111 2024-04-20T23:02:24.505 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:02:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:02:24.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:02:24.541 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-04-20T23:02:25.252 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:02:25.263 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:02:25.263 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:04:17.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:04:17.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:04:17.929 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-20T23:04:17.929+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32288) UID: 0 2024-04-20T23:04:17.929 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-20T23:04:17.929+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32288) UID: 0 2024-04-20T23:04:17.930 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-20T23:04:17.929+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32288) UID: 0 2024-04-20T23:04:17.930 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-20T23:04:17.929+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32288) UID: 0 2024-04-20T23:04:22.711 INFO:teuthology.orchestra.run.smithi071.stdout:generic/112 117s 2024-04-20T23:04:22.728 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/112 2024-04-20T23:04:22.729 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:04:22.738 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:04:22.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:04:22.769 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-04-20T23:04:23.515 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:04:23.529 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:04:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:14.846 INFO:teuthology.orchestra.run.smithi071.stdout:generic/113 51s 2024-04-20T23:05:14.869 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/113 2024-04-20T23:05:14.869 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:14.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:14.919 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-04-20T23:05:15.642 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:15.654 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:15.654 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:16.124 INFO:teuthology.orchestra.run.smithi071.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-04-20T23:05:16.135 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/114 2024-04-20T23:05:16.135 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/114 2024-04-20T23:05:16.136 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:16.144 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:16.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:16.175 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-04-20T23:05:16.707 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:16.721 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:16.721 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:17.284 INFO:teuthology.orchestra.run.smithi071.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:05:17.296 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/115 2024-04-20T23:05:17.296 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/115 2024-04-20T23:05:17.297 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:17.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:17.341 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-04-20T23:05:18.018 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:18.032 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:18.575 INFO:teuthology.orchestra.run.smithi071.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:05:18.586 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/116 2024-04-20T23:05:18.586 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/116 2024-04-20T23:05:18.586 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:18.595 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:18.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:18.624 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-04-20T23:05:19.271 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:19.284 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:19.706 INFO:teuthology.orchestra.run.smithi071.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:05:19.720 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/117 2024-04-20T23:05:19.720 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/117 2024-04-20T23:05:19.720 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:19.731 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:19.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:19.766 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-04-20T23:05:20.312 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:20.325 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:20.325 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:20.848 INFO:teuthology.orchestra.run.smithi071.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:05:20.860 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/118 2024-04-20T23:05:20.860 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/118 2024-04-20T23:05:20.860 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:20.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:20.910 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-04-20T23:05:21.578 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:21.590 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:21.590 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:22.136 INFO:teuthology.orchestra.run.smithi071.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:05:22.148 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/119 2024-04-20T23:05:22.148 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/119 2024-04-20T23:05:22.148 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:22.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:22.208 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-04-20T23:05:22.849 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:22.860 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:23.261 INFO:teuthology.orchestra.run.smithi071.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:05:23.273 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/120 2024-04-20T23:05:23.273 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/120 2024-04-20T23:05:23.273 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:23.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:23.316 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-04-20T23:05:23.865 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:23.879 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:23.879 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:24.445 INFO:teuthology.orchestra.run.smithi071.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-20T23:05:24.457 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/121 2024-04-20T23:05:24.457 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/121 2024-04-20T23:05:24.457 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:24.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:24.512 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-04-20T23:05:25.184 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:25.196 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:25.747 INFO:teuthology.orchestra.run.smithi071.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-20T23:05:25.759 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/122 2024-04-20T23:05:25.760 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/122 2024-04-20T23:05:25.760 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:25.769 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:25.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:25.813 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-04-20T23:05:26.473 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:26.484 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:28.006 INFO:teuthology.orchestra.run.smithi071.stdout:generic/123 1s 2024-04-20T23:05:28.023 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/123 2024-04-20T23:05:28.023 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:28.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:28.064 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-04-20T23:05:28.721 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:28.732 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:28.732 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:29.150 INFO:teuthology.orchestra.run.smithi071.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:05:29.163 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/124 2024-04-20T23:05:29.163 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/124 2024-04-20T23:05:29.163 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:05:29.172 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:05:29.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:05:29.202 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-04-20T23:05:29.730 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:05:29.743 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:05:29.744 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:06:32.072 INFO:teuthology.orchestra.run.smithi071.stdout:generic/125 62s 2024-04-20T23:06:32.094 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/125 2024-04-20T23:06:32.094 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:06:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:06:32.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:06:32.154 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-04-20T23:06:32.891 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:06:32.902 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:06:32.902 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:06:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:generic/126 - output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/126.out.bad) 2024-04-20T23:06:34.487 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/126.out 2024-04-20 21:21:29.619925774 +0000 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/126.out.bad 2024-04-20 23:06:34.478792748 +0000 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -1,7 +1,7 @@ 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: QA output created by 126 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2024-04-20T23:06:34.488 INFO:teuthology.orchestra.run.smithi071.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2024-04-20T23:06:34.495 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/126 2024-04-20T23:06:34.495 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/126 2024-04-20T23:06:34.495 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-20T23:06:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:06:34.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T23:06:34.534 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-20T23:06:34.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-20T23:06:34.534 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-04-20T23:06:35.230 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:06:35.242 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:06:35.242 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:07:24.755 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:07:24.764 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:07:24.867 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-20T23:07:24.867+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32356) UID: 0 2024-04-20T23:07:24.867 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-20T23:07:24.867+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32356) UID: 0 2024-04-20T23:07:24.868 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-20T23:07:24.867+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32356) UID: 0 2024-04-20T23:07:24.868 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-20T23:07:24.867+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32356) UID: 0 2024-04-20T23:10:15.932 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:10:15.941 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:10:46.379 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:10:46.388 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:11:16.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:11:16.541 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:11:46.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:11:46.680 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:12:16.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:12:16.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:12:46.948 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:12:46.957 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:13:17.096 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:13:17.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:13:47.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:13:47.238 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:14:17.372 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:14:17.381 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:14:47.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:14:47.548 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:15:17.684 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:15:17.693 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:15:47.898 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:15:47.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:16:18.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:16:18.053 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:16:48.187 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:16:48.196 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:17:18.350 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:17:18.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:17:48.480 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:17:48.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:18:18.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:18:18.609 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:18:48.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:18:48.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:19:18.867 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:19:18.877 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:19:49.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:19:49.021 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:20:19.154 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:20:19.165 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:20:49.278 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:20:49.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:21:19.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:21:19.525 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:21:49.662 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:21:49.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:22:19.799 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:22:19.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:22:49.956 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:22:49.965 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:23:20.103 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:23:20.111 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:23:20.205 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-20T23:23:20.204+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32883) UID: 0 2024-04-20T23:23:20.205 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-20T23:23:20.205+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32883) UID: 0 2024-04-20T23:23:20.205 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-20T23:23:20.204+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32883) UID: 0 2024-04-20T23:23:20.206 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-20T23:23:20.205+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32883) UID: 0 2024-04-20T23:26:29.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:26:29.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:27:00.080 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:27:00.089 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:27:30.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:27:30.265 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:28:00.398 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:28:00.409 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:28:30.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:28:30.536 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:29:00.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:29:00.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:29:31.026 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:29:31.035 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:30:01.160 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:30:01.169 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:30:31.314 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:30:31.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:31:01.455 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:31:01.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:31:31.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:31:31.592 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:32:01.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:32:01.732 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:32:31.861 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:32:31.869 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:33:02.066 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:33:02.075 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:33:32.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:33:32.235 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:34:02.344 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:34:02.352 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:34:32.667 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:34:32.675 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:35:02.798 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:35:02.806 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:35:33.035 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:35:33.045 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:36:03.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:36:03.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:36:33.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:36:33.312 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:37:03.475 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:37:03.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:37:33.605 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:37:33.614 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:38:04.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:38:04.278 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:38:34.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:38:34.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:39:04.604 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:39:04.613 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:39:34.742 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:39:34.751 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:40:05.011 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:40:05.020 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:40:35.155 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:40:35.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:41:05.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:41:05.310 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:41:35.446 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:41:35.456 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:42:05.578 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:42:05.586 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:42:35.846 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:42:35.855 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:43:05.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:43:05.974 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:43:36.092 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:43:36.101 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:44:06.216 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:44:06.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:44:36.370 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:44:36.378 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:45:06.510 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:45:06.519 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:45:36.641 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:45:36.651 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:46:06.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:46:06.803 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:46:36.927 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:46:36.936 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:47:07.072 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:47:07.083 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:47:29.036 INFO:teuthology.orchestra.run.smithi071.stdout:generic/127 2453s 2024-04-20T23:47:29.058 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/127 2024-04-20T23:47:29.058 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:47:29.070 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:29.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:47:29.104 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-04-20T23:47:29.790 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:47:29.803 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:47:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:30.203 INFO:teuthology.orchestra.run.smithi071.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:47:30.215 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/128 2024-04-20T23:47:30.215 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/128 2024-04-20T23:47:30.215 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:47:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:30.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:47:30.253 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-04-20T23:47:30.786 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:47:30.798 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:47:30.798 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:31.203 INFO:teuthology.orchestra.run.smithi071.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:47:31.215 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/129 2024-04-20T23:47:31.215 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/129 2024-04-20T23:47:31.215 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:47:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:31.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:47:31.253 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-04-20T23:47:31.768 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:47:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:47:31.781 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:32.186 INFO:teuthology.orchestra.run.smithi071.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:47:32.198 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/130 2024-04-20T23:47:32.198 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/130 2024-04-20T23:47:32.198 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:47:32.207 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:32.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:47:32.239 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-04-20T23:47:32.774 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:47:32.787 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:47:32.787 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:34.899 INFO:teuthology.orchestra.run.smithi071.stdout:generic/131 2s 2024-04-20T23:47:34.917 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/131 2024-04-20T23:47:34.917 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:47:34.926 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:34.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:47:34.960 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-04-20T23:47:35.665 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:47:35.678 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:47:35.678 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:36.112 INFO:teuthology.orchestra.run.smithi071.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:47:36.123 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/132 2024-04-20T23:47:36.123 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/132 2024-04-20T23:47:36.123 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:47:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:36.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:47:36.165 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-04-20T23:47:36.699 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:47:36.712 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:47:36.712 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:47:37.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:47:37.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:48:07.341 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:48:07.350 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:48:37.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:48:37.478 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:49:07.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:49:07.795 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:49:37.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:49:37.920 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:50:08.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:50:08.056 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:50:38.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:50:38.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:51:08.331 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:51:08.340 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:51:38.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:51:38.469 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:52:08.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:52:08.592 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:52:08.689 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-20T23:52:08.689+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 184433) UID: 0 2024-04-20T23:52:08.689 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-20T23:52:08.689+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 184433) UID: 0 2024-04-20T23:52:08.689 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-20T23:52:08.689+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 184433) UID: 0 2024-04-20T23:52:08.690 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-20T23:52:08.689+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 184433) UID: 0 2024-04-20T23:55:10.795 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:55:10.804 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:55:41.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:55:41.008 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:56:11.174 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:56:11.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:56:41.319 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:56:41.328 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:57:11.508 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:57:11.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:57:41.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:57:41.654 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:58:11.783 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:58:11.792 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:58:16.443 INFO:teuthology.orchestra.run.smithi071.stdout:generic/133 640s 2024-04-20T23:58:16.461 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/133 2024-04-20T23:58:16.461 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:16.469 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:16.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:16.501 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-04-20T23:58:17.262 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:17.272 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:17.272 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:17.801 INFO:teuthology.orchestra.run.smithi071.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:17.815 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/134 2024-04-20T23:58:17.816 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/134 2024-04-20T23:58:17.816 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:17.828 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:17.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:17.866 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-04-20T23:58:18.520 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:18.530 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:18.530 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:19.092 INFO:teuthology.orchestra.run.smithi071.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:58:19.105 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/135 2024-04-20T23:58:19.105 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/135 2024-04-20T23:58:19.105 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:19.115 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:19.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:19.149 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-04-20T23:58:19.665 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:19.677 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:19.677 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:20.281 INFO:teuthology.orchestra.run.smithi071.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:20.293 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/136 2024-04-20T23:58:20.293 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/136 2024-04-20T23:58:20.293 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:20.305 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:20.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:20.342 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-04-20T23:58:20.998 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:21.009 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:21.543 INFO:teuthology.orchestra.run.smithi071.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:21.557 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/137 2024-04-20T23:58:21.557 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/137 2024-04-20T23:58:21.557 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:21.569 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:21.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:21.601 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-04-20T23:58:22.287 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:22.298 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:22.814 INFO:teuthology.orchestra.run.smithi071.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:22.829 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/138 2024-04-20T23:58:22.829 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/138 2024-04-20T23:58:22.829 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:22.841 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:22.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:22.890 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-04-20T23:58:23.563 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:23.574 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:23.575 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:24.163 INFO:teuthology.orchestra.run.smithi071.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:24.175 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/139 2024-04-20T23:58:24.175 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/139 2024-04-20T23:58:24.175 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:24.184 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:24.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:24.228 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-04-20T23:58:24.912 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:24.923 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:25.447 INFO:teuthology.orchestra.run.smithi071.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:25.460 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/140 2024-04-20T23:58:25.460 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/140 2024-04-20T23:58:25.460 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:25.472 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:25.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:25.523 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-04-20T23:58:26.194 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:26.206 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:26.577 INFO:teuthology.orchestra.run.smithi071.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:58:26.589 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/141 2024-04-20T23:58:26.589 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/141 2024-04-20T23:58:26.589 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:26.598 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:26.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:26.628 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-04-20T23:58:27.137 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:27.151 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:27.151 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:27.749 INFO:teuthology.orchestra.run.smithi071.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:27.760 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/142 2024-04-20T23:58:27.760 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/142 2024-04-20T23:58:27.760 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:27.770 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:27.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:27.809 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-04-20T23:58:28.482 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:28.494 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:28.494 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:29.005 INFO:teuthology.orchestra.run.smithi071.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:29.019 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/143 2024-04-20T23:58:29.019 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/143 2024-04-20T23:58:29.019 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:29.031 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:29.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:29.076 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-04-20T23:58:29.733 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:29.747 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:29.747 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:30.287 INFO:teuthology.orchestra.run.smithi071.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:30.299 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/144 2024-04-20T23:58:30.299 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/144 2024-04-20T23:58:30.300 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:30.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:30.356 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-04-20T23:58:31.036 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:31.048 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:31.048 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:31.560 INFO:teuthology.orchestra.run.smithi071.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:31.574 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/145 2024-04-20T23:58:31.574 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/145 2024-04-20T23:58:31.574 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:31.586 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:31.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:31.622 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-04-20T23:58:32.292 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:32.303 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:32.303 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:32.839 INFO:teuthology.orchestra.run.smithi071.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:32.852 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/146 2024-04-20T23:58:32.852 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/146 2024-04-20T23:58:32.853 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:32.862 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:32.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:32.894 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-04-20T23:58:33.558 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:33.570 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:33.570 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:34.078 INFO:teuthology.orchestra.run.smithi071.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:34.090 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/147 2024-04-20T23:58:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/147 2024-04-20T23:58:34.091 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:34.101 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:34.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:34.140 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-04-20T23:58:34.805 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:34.817 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:34.817 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:35.353 INFO:teuthology.orchestra.run.smithi071.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:35.364 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/148 2024-04-20T23:58:35.365 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/148 2024-04-20T23:58:35.365 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:35.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:35.404 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-04-20T23:58:36.080 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:36.090 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:36.601 INFO:teuthology.orchestra.run.smithi071.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:36.612 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/149 2024-04-20T23:58:36.612 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/149 2024-04-20T23:58:36.612 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:36.621 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:36.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:36.668 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-04-20T23:58:37.309 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:37.320 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:37.320 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:37.844 INFO:teuthology.orchestra.run.smithi071.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:37.857 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/150 2024-04-20T23:58:37.857 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/150 2024-04-20T23:58:37.857 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:37.867 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:37.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:37.914 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-04-20T23:58:38.563 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:38.574 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:38.574 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:39.140 INFO:teuthology.orchestra.run.smithi071.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:39.154 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/151 2024-04-20T23:58:39.154 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/151 2024-04-20T23:58:39.154 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:39.164 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:39.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:39.227 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-04-20T23:58:39.888 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:39.901 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:39.901 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:40.406 INFO:teuthology.orchestra.run.smithi071.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:40.418 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/152 2024-04-20T23:58:40.418 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/152 2024-04-20T23:58:40.418 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:40.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:40.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:40.461 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-04-20T23:58:41.111 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:41.122 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:41.122 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:41.711 INFO:teuthology.orchestra.run.smithi071.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:41.722 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/153 2024-04-20T23:58:41.722 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/153 2024-04-20T23:58:41.722 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:41.732 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:41.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:41.777 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-04-20T23:58:41.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:58:41.926 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:58:42.451 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:42.463 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:43.031 INFO:teuthology.orchestra.run.smithi071.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:43.043 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/154 2024-04-20T23:58:43.043 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/154 2024-04-20T23:58:43.043 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:43.053 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:43.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:43.084 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-04-20T23:58:43.759 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:43.771 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:43.771 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:44.310 INFO:teuthology.orchestra.run.smithi071.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:44.324 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/155 2024-04-20T23:58:44.324 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/155 2024-04-20T23:58:44.325 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:44.337 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:44.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:44.370 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-04-20T23:58:45.037 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:45.049 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:45.049 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:45.596 INFO:teuthology.orchestra.run.smithi071.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:45.608 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/156 2024-04-20T23:58:45.608 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/156 2024-04-20T23:58:45.608 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:45.617 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:45.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:45.667 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-04-20T23:58:46.325 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:46.337 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:46.337 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:46.927 INFO:teuthology.orchestra.run.smithi071.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:46.938 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/157 2024-04-20T23:58:46.939 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/157 2024-04-20T23:58:46.939 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:46.949 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:46.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:46.982 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-04-20T23:58:47.642 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:47.653 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:47.653 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:48.200 INFO:teuthology.orchestra.run.smithi071.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-20T23:58:48.212 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/158 2024-04-20T23:58:48.212 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/158 2024-04-20T23:58:48.212 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:48.221 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:48.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:48.258 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-04-20T23:58:48.914 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:48.925 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:48.926 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:49.453 INFO:teuthology.orchestra.run.smithi071.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-04-20T23:58:49.464 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/159 2024-04-20T23:58:49.464 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/159 2024-04-20T23:58:49.464 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:49.473 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:49.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:49.506 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-04-20T23:58:50.031 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:50.044 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:50.044 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:50.551 INFO:teuthology.orchestra.run.smithi071.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-04-20T23:58:50.566 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/160 2024-04-20T23:58:50.566 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/160 2024-04-20T23:58:50.567 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:50.577 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:50.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:50.608 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-04-20T23:58:51.154 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:51.167 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:51.167 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:51.608 INFO:teuthology.orchestra.run.smithi071.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:58:51.619 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/161 2024-04-20T23:58:51.619 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/161 2024-04-20T23:58:51.620 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:51.628 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:51.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:51.658 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-04-20T23:58:52.183 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:52.195 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:52.195 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:52.582 INFO:teuthology.orchestra.run.smithi071.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:58:52.593 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/162 2024-04-20T23:58:52.593 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/162 2024-04-20T23:58:52.593 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:52.603 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:52.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:52.634 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-04-20T23:58:53.166 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:53.180 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:53.181 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:53.650 INFO:teuthology.orchestra.run.smithi071.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:58:53.662 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/163 2024-04-20T23:58:53.662 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/163 2024-04-20T23:58:53.662 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:53.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:53.701 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-04-20T23:58:54.235 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:54.248 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:54.757 INFO:teuthology.orchestra.run.smithi071.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:58:54.769 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/164 2024-04-20T23:58:54.769 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/164 2024-04-20T23:58:54.769 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:54.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:54.804 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-04-20T23:58:55.315 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:55.329 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:55.329 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:58:55.776 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/165 2024-04-20T23:58:55.776 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/165 2024-04-20T23:58:55.777 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:55.786 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:55.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:55.816 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-04-20T23:58:56.356 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:56.370 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:56.817 INFO:teuthology.orchestra.run.smithi071.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:58:56.832 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/166 2024-04-20T23:58:56.832 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/166 2024-04-20T23:58:56.832 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:56.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:56.874 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-04-20T23:58:57.403 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:57.415 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:57.415 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:57.868 INFO:teuthology.orchestra.run.smithi071.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:58:57.882 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/167 2024-04-20T23:58:57.883 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/167 2024-04-20T23:58:57.883 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:57.894 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:57.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:57.929 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-04-20T23:58:58.464 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:58.478 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:58.478 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:58.900 INFO:teuthology.orchestra.run.smithi071.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:58:58.911 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/168 2024-04-20T23:58:58.911 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/168 2024-04-20T23:58:58.911 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:58.921 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:58.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:58.950 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-04-20T23:58:59.484 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:58:59.498 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:58:59.498 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:59.906 INFO:teuthology.orchestra.run.smithi071.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:58:59.919 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/169 2024-04-20T23:58:59.920 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/169 2024-04-20T23:58:59.920 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:58:59.933 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:58:59.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:58:59.964 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-04-20T23:59:00.493 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:00.507 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:00.507 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:00.905 INFO:teuthology.orchestra.run.smithi071.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:00.916 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/170 2024-04-20T23:59:00.916 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/170 2024-04-20T23:59:00.916 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:00.925 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:00.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:00.952 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-04-20T23:59:01.479 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:01.492 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:01.492 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:01.923 INFO:teuthology.orchestra.run.smithi071.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/171 2024-04-20T23:59:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/171 2024-04-20T23:59:01.938 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:01.949 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:01.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:01.983 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-04-20T23:59:02.511 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:02.523 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:02.523 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:02.946 INFO:teuthology.orchestra.run.smithi071.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:02.961 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/172 2024-04-20T23:59:02.961 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/172 2024-04-20T23:59:02.961 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:03.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:03.008 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-04-20T23:59:03.540 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:03.554 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:03.972 INFO:teuthology.orchestra.run.smithi071.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:03.985 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/173 2024-04-20T23:59:03.985 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/173 2024-04-20T23:59:03.985 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:03.995 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:04.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:04.025 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-04-20T23:59:04.520 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:04.534 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:04.534 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:04.963 INFO:teuthology.orchestra.run.smithi071.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:04.974 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/174 2024-04-20T23:59:04.975 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/174 2024-04-20T23:59:04.975 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:05.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:05.013 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-04-20T23:59:05.546 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:05.560 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:05.560 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:05.994 INFO:teuthology.orchestra.run.smithi071.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:06.007 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/175 2024-04-20T23:59:06.008 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/175 2024-04-20T23:59:06.008 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:06.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:06.050 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-04-20T23:59:06.577 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:06.590 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:07.024 INFO:teuthology.orchestra.run.smithi071.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:07.036 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/176 2024-04-20T23:59:07.036 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/176 2024-04-20T23:59:07.036 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:07.045 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:07.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:07.077 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-04-20T23:59:07.616 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:07.631 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:07.632 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:08.200 INFO:teuthology.orchestra.run.smithi071.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:08.212 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/177 2024-04-20T23:59:08.212 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/177 2024-04-20T23:59:08.212 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:08.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:08.251 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-04-20T23:59:08.767 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:08.781 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:09.342 INFO:teuthology.orchestra.run.smithi071.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:59:09.354 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/178 2024-04-20T23:59:09.354 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/178 2024-04-20T23:59:09.354 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:09.364 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:09.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:09.398 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-04-20T23:59:10.069 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:10.080 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:10.080 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:10.651 INFO:teuthology.orchestra.run.smithi071.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:59:10.662 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/179 2024-04-20T23:59:10.663 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/179 2024-04-20T23:59:10.663 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:10.672 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:10.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:10.701 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-04-20T23:59:11.372 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:11.384 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:11.952 INFO:teuthology.orchestra.run.smithi071.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:59:11.964 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/180 2024-04-20T23:59:11.964 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/180 2024-04-20T23:59:11.964 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:12.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:12.015 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-04-20T23:59:12.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:59:12.130 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:59:12.709 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:12.721 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:13.212 INFO:teuthology.orchestra.run.smithi071.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-20T23:59:13.310 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/181 2024-04-20T23:59:13.310 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/181 2024-04-20T23:59:13.310 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:13.310 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:13.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:13.310 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-04-20T23:59:13.964 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:13.975 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:13.975 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:14.432 INFO:teuthology.orchestra.run.smithi071.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-20T23:59:14.443 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/182 2024-04-20T23:59:14.443 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/182 2024-04-20T23:59:14.443 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:14.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:14.492 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-04-20T23:59:15.158 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:15.170 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:15.539 INFO:teuthology.orchestra.run.smithi071.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:15.549 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/183 2024-04-20T23:59:15.549 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/183 2024-04-20T23:59:15.550 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:15.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:15.583 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-04-20T23:59:16.087 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:16.100 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:16.100 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:16.639 INFO:teuthology.orchestra.run.smithi071.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/184.out.bad) 2024-04-20T23:59:16.647 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/184.out 2024-04-20 21:21:29.629925599 +0000 2024-04-20T23:59:16.647 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/184.out.bad 2024-04-20 23:59:16.637471516 +0000 2024-04-20T23:59:16.647 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -1 +1,2 @@ 2024-04-20T23:59:16.647 INFO:teuthology.orchestra.run.smithi071.stdout: QA output created by 184 2024-04-20T23:59:16.647 INFO:teuthology.orchestra.run.smithi071.stdout: +/tmp/tmp.fxhob2prpHxfstests-dev/tests/generic/184: line 23: /tmp/tmp.8yh8DCdvNntest/null: Permission denied 2024-04-20T23:59:16.654 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/184 2024-04-20T23:59:16.654 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/184 2024-04-20T23:59:16.654 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-20T23:59:16.662 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:16.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T23:59:16.690 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-20T23:59:16.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-20T23:59:16.690 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-04-20T23:59:17.233 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:17.247 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:17.674 INFO:teuthology.orchestra.run.smithi071.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:17.687 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/185 2024-04-20T23:59:17.687 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/185 2024-04-20T23:59:17.687 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:17.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:17.726 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-04-20T23:59:18.263 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:18.277 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:18.707 INFO:teuthology.orchestra.run.smithi071.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:18.719 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/186 2024-04-20T23:59:18.719 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/186 2024-04-20T23:59:18.719 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:18.728 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:18.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:18.759 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-04-20T23:59:19.323 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:19.336 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:19.336 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:19.794 INFO:teuthology.orchestra.run.smithi071.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:19.806 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/187 2024-04-20T23:59:19.806 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/187 2024-04-20T23:59:19.806 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:19.816 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:19.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:19.845 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-04-20T23:59:20.365 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:20.381 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:20.797 INFO:teuthology.orchestra.run.smithi071.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:20.808 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/188 2024-04-20T23:59:20.808 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/188 2024-04-20T23:59:20.808 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:20.817 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:20.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:20.850 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-04-20T23:59:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:21.439 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:21.856 INFO:teuthology.orchestra.run.smithi071.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:21.870 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/189 2024-04-20T23:59:21.871 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/189 2024-04-20T23:59:21.871 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:21.883 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:21.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:21.915 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-04-20T23:59:22.440 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:22.451 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:22.451 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:22.867 INFO:teuthology.orchestra.run.smithi071.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:22.879 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/190 2024-04-20T23:59:22.879 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/190 2024-04-20T23:59:22.879 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:22.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:22.925 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-04-20T23:59:23.450 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:23.464 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:23.888 INFO:teuthology.orchestra.run.smithi071.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:23.900 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/191 2024-04-20T23:59:23.900 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/191 2024-04-20T23:59:23.900 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:23.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:23.939 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-04-20T23:59:24.455 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:24.468 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:24.881 INFO:teuthology.orchestra.run.smithi071.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2024-04-20T23:59:24.892 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/192 2024-04-20T23:59:24.892 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/192 2024-04-20T23:59:24.892 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:24.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:24.923 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-04-20T23:59:25.434 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:25.446 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:28.448 INFO:teuthology.orchestra.run.smithi071.stdout:generic/193 - output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/193.out.bad) 2024-04-20T23:59:28.455 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/193.out 2024-04-20 21:21:29.630925581 +0000 2024-04-20T23:59:28.456 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/193.out.bad 2024-04-20 23:59:28.432265628 +0000 2024-04-20T23:59:28.456 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -24,7 +24,6 @@ 2024-04-20T23:59:28.456 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:28.456 INFO:teuthology.orchestra.run.smithi071.stdout: user: chmod a+r on qa_user owned file (should succeed) 2024-04-20T23:59:28.456 INFO:teuthology.orchestra.run.smithi071.stdout: user: chmod a+r on root owned file (should fail) 2024-04-20T23:59:28.456 INFO:teuthology.orchestra.run.smithi071.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2024-04-20T23:59:28.456 INFO:teuthology.orchestra.run.smithi071.stdout: check that the sgid bit is cleared 2024-04-20T23:59:28.456 INFO:teuthology.orchestra.run.smithi071.stdout: -rw-rw-rw- 2024-04-20T23:59:28.456 INFO:teuthology.orchestra.run.smithi071.stdout: check that suid bit is not cleared 2024-04-20T23:59:28.466 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/193 2024-04-20T23:59:28.466 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/193 2024-04-20T23:59:28.466 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-20T23:59:28.477 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:28.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T23:59:28.527 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-20T23:59:28.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-20T23:59:28.527 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-04-20T23:59:29.192 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:29.204 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:29.204 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:29.600 INFO:teuthology.orchestra.run.smithi071.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:29.613 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/194 2024-04-20T23:59:29.613 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/194 2024-04-20T23:59:29.613 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:29.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:29.656 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-04-20T23:59:30.177 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:30.192 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:30.192 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:30.619 INFO:teuthology.orchestra.run.smithi071.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:30.629 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/195 2024-04-20T23:59:30.630 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/195 2024-04-20T23:59:30.630 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:30.637 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:30.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:30.667 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-04-20T23:59:31.177 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:31.189 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:31.625 INFO:teuthology.orchestra.run.smithi071.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:31.638 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/196 2024-04-20T23:59:31.638 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/196 2024-04-20T23:59:31.638 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:31.648 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:31.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:31.675 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-04-20T23:59:32.195 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:32.208 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:32.208 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:32.611 INFO:teuthology.orchestra.run.smithi071.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:32.623 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/197 2024-04-20T23:59:32.623 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/197 2024-04-20T23:59:32.623 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:32.633 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:32.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:32.667 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-04-20T23:59:33.196 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:35.544 INFO:teuthology.orchestra.run.smithi071.stdout:generic/198 2s 2024-04-20T23:59:35.565 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/198 2024-04-20T23:59:35.565 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:35.577 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:35.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:35.624 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-04-20T23:59:36.351 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:36.362 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:36.362 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:36.746 INFO:teuthology.orchestra.run.smithi071.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:36.757 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/199 2024-04-20T23:59:36.757 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/199 2024-04-20T23:59:36.757 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:36.767 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:36.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:36.795 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-04-20T23:59:37.314 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:37.327 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:37.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:37.747 INFO:teuthology.orchestra.run.smithi071.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:37.759 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/200 2024-04-20T23:59:37.759 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/200 2024-04-20T23:59:37.759 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:37.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:37.802 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-04-20T23:59:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:38.361 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:38.779 INFO:teuthology.orchestra.run.smithi071.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:38.791 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/201 2024-04-20T23:59:38.791 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/201 2024-04-20T23:59:38.791 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:38.801 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:38.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:38.832 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-04-20T23:59:39.411 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:39.424 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:39.424 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:39.857 INFO:teuthology.orchestra.run.smithi071.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:39.870 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/202 2024-04-20T23:59:39.870 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/202 2024-04-20T23:59:39.870 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:39.882 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:39.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:39.916 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-04-20T23:59:40.456 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:40.470 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:40.470 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:40.873 INFO:teuthology.orchestra.run.smithi071.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:40.885 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/203 2024-04-20T23:59:40.885 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/203 2024-04-20T23:59:40.885 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:40.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:40.928 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-04-20T23:59:41.433 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:41.446 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:41.446 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:42.251 INFO:teuthology.orchestra.run.smithi071.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:42.265 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/204 2024-04-20T23:59:42.265 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/204 2024-04-20T23:59:42.266 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:42.277 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:42.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:42.312 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-04-20T23:59:42.330 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:59:42.364 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T23:59:42.802 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:42.814 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:42.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:43.183 INFO:teuthology.orchestra.run.smithi071.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:43.193 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/205 2024-04-20T23:59:43.193 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/205 2024-04-20T23:59:43.193 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:43.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:43.226 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-04-20T23:59:43.698 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:43.710 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:43.710 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:44.073 INFO:teuthology.orchestra.run.smithi071.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2024-04-20T23:59:44.086 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/206 2024-04-20T23:59:44.086 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/206 2024-04-20T23:59:44.086 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-20T23:59:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-20T23:59:44.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-20T23:59:44.126 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-04-20T23:59:44.632 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-20T23:59:44.644 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-20T23:59:44.644 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:00:12.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:00:12.521 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:00:32.033 INFO:teuthology.orchestra.run.smithi071.stdout:generic/207 48s 2024-04-21T00:00:32.049 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/207 2024-04-21T00:00:32.050 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:00:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:00:32.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:00:32.093 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-04-21T00:00:32.797 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:00:32.811 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:00:32.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:00:42.700 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:00:42.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:01:12.925 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:01:12.935 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:01:43.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:01:43.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:02:13.279 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:02:13.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:02:43.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:02:43.408 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:03:13.519 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:03:13.528 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:03:44.015 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:03:44.025 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:03:53.541 INFO:teuthology.orchestra.run.smithi071.stdout:generic/208 201s 2024-04-21T00:03:53.563 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/208 2024-04-21T00:03:53.563 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:03:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:03:53.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:03:53.620 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-04-21T00:03:54.271 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:03:54.283 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:03:54.283 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:14.156 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:04:14.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:04:21.851 INFO:teuthology.orchestra.run.smithi071.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/209.out.bad) 2024-04-21T00:04:21.882 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/209.out 2024-04-20 21:21:29.633925528 +0000 2024-04-21T00:04:21.882 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/209.out.bad 2024-04-21 00:04:21.839149086 +0000 2024-04-21T00:04:21.882 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -1,2 +1,2 @@ 2024-04-21T00:04:21.882 INFO:teuthology.orchestra.run.smithi071.stdout: QA output created by 209 2024-04-21T00:04:21.882 INFO:teuthology.orchestra.run.smithi071.stdout: -test ran for 30 seconds without error 2024-04-21T00:04:21.882 INFO:teuthology.orchestra.run.smithi071.stdout: +reader found old byte at pos 4096 2024-04-21T00:04:21.882 INFO:teuthology.orchestra.run.smithi071.stdout: \ No newline at end of file 2024-04-21T00:04:21.898 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/209 2024-04-21T00:04:21.898 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/209 2024-04-21T00:04:21.898 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-21T00:04:21.911 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:21.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T00:04:21.960 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-21T00:04:21.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-21T00:04:21.960 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-04-21T00:04:22.463 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:22.475 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:23.148 INFO:teuthology.orchestra.run.smithi071.stdout:generic/210 1s 2024-04-21T00:04:23.170 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/210 2024-04-21T00:04:23.170 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:23.182 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:23.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:23.220 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-04-21T00:04:23.870 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:23.882 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:24.856 INFO:teuthology.orchestra.run.smithi071.stdout:generic/211 1s 2024-04-21T00:04:24.872 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/211 2024-04-21T00:04:24.872 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:24.880 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:24.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:24.909 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-04-21T00:04:25.423 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:25.437 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:25.437 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:26.089 INFO:teuthology.orchestra.run.smithi071.stdout:generic/212 1s 2024-04-21T00:04:26.107 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/212 2024-04-21T00:04:26.110 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:26.117 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:26.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:26.145 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-04-21T00:04:26.648 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:26.661 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:27.479 INFO:teuthology.orchestra.run.smithi071.stdout:generic/213 - output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/213.out.bad) 2024-04-21T00:04:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/213.out 2024-04-20 21:21:29.634925511 +0000 2024-04-21T00:04:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/213.out.bad 2024-04-21 00:04:27.477050817 +0000 2024-04-21T00:04:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -1,4 +1,3 @@ 2024-04-21T00:04:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: QA output created by 213 2024-04-21T00:04:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: We should get: fallocate: No space left on device 2024-04-21T00:04:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2024-04-21T00:04:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: -fallocate: No space left on device 2024-04-21T00:04:27.490 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/213 2024-04-21T00:04:27.490 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/213 2024-04-21T00:04:27.490 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-21T00:04:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:27.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T00:04:27.539 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-21T00:04:27.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-21T00:04:27.539 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-04-21T00:04:28.281 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:28.296 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:29.185 INFO:teuthology.orchestra.run.smithi071.stdout:generic/214 1s 2024-04-21T00:04:29.200 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/214 2024-04-21T00:04:29.200 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:29.207 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:29.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:29.240 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-04-21T00:04:29.970 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:29.983 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:29.984 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:33.964 INFO:teuthology.orchestra.run.smithi071.stdout:generic/215 3s 2024-04-21T00:04:33.978 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/215 2024-04-21T00:04:33.979 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:34.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:34.023 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-04-21T00:04:34.594 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:34.608 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:34.608 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:34.987 INFO:teuthology.orchestra.run.smithi071.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:34.998 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/216 2024-04-21T00:04:34.998 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/216 2024-04-21T00:04:34.998 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:35.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:35.041 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-04-21T00:04:35.573 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:35.584 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:35.584 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:35.961 INFO:teuthology.orchestra.run.smithi071.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:35.972 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/217 2024-04-21T00:04:35.972 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/217 2024-04-21T00:04:35.972 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:35.984 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:36.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:36.023 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-04-21T00:04:36.564 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:36.579 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:36.579 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:36.963 INFO:teuthology.orchestra.run.smithi071.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:36.974 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/218 2024-04-21T00:04:36.974 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/218 2024-04-21T00:04:36.974 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:36.982 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:37.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:37.010 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-04-21T00:04:37.577 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:37.594 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:37.974 INFO:teuthology.orchestra.run.smithi071.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:37.985 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/219 2024-04-21T00:04:37.985 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/219 2024-04-21T00:04:37.985 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:37.993 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:38.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:38.023 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-04-21T00:04:38.576 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:38.595 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:38.595 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:38.979 INFO:teuthology.orchestra.run.smithi071.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:38.992 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/220 2024-04-21T00:04:38.992 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/220 2024-04-21T00:04:38.992 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:39.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:39.033 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-04-21T00:04:39.587 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:39.601 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:39.601 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:41.063 INFO:teuthology.orchestra.run.smithi071.stdout:generic/221 2s 2024-04-21T00:04:41.088 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/221 2024-04-21T00:04:41.088 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:41.099 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:41.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:41.135 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-04-21T00:04:41.653 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:41.667 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:41.667 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:42.034 INFO:teuthology.orchestra.run.smithi071.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:42.044 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/222 2024-04-21T00:04:42.044 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/222 2024-04-21T00:04:42.045 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:42.054 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:42.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:42.086 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-04-21T00:04:42.645 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:42.658 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:42.658 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:43.034 INFO:teuthology.orchestra.run.smithi071.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:43.045 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/223 2024-04-21T00:04:43.045 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/223 2024-04-21T00:04:43.045 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:43.053 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:43.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:43.082 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-04-21T00:04:43.627 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:43.640 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:44.062 INFO:teuthology.orchestra.run.smithi071.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:44.073 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/224 2024-04-21T00:04:44.073 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/224 2024-04-21T00:04:44.073 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:44.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:44.115 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-04-21T00:04:44.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:04:44.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:04:44.683 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:44.699 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:44.699 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:45.081 INFO:teuthology.orchestra.run.smithi071.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/225 2024-04-21T00:04:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/225 2024-04-21T00:04:45.091 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:45.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:45.125 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-04-21T00:04:45.677 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:45.693 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:45.693 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:46.074 INFO:teuthology.orchestra.run.smithi071.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:46.087 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/226 2024-04-21T00:04:46.087 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/226 2024-04-21T00:04:46.087 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:46.097 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:46.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:46.128 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-04-21T00:04:46.647 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:46.664 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:46.664 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:47.084 INFO:teuthology.orchestra.run.smithi071.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:47.097 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/227 2024-04-21T00:04:47.097 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/227 2024-04-21T00:04:47.097 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:47.105 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:47.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:47.137 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-04-21T00:04:47.687 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:47.700 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:47.700 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:48.971 INFO:teuthology.orchestra.run.smithi071.stdout:generic/228 1s 2024-04-21T00:04:48.992 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/228 2024-04-21T00:04:48.992 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:49.001 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:49.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:49.045 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-04-21T00:04:49.726 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:49.740 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:49.740 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:50.120 INFO:teuthology.orchestra.run.smithi071.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:50.131 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/229 2024-04-21T00:04:50.131 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/229 2024-04-21T00:04:50.131 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:50.141 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:50.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:50.177 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-04-21T00:04:50.728 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:50.744 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:50.744 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:51.121 INFO:teuthology.orchestra.run.smithi071.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:51.132 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/230 2024-04-21T00:04:51.132 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/230 2024-04-21T00:04:51.132 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:51.140 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:51.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:51.170 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-04-21T00:04:51.736 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:51.753 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:51.753 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:52.119 INFO:teuthology.orchestra.run.smithi071.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:52.129 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/231 2024-04-21T00:04:52.129 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/231 2024-04-21T00:04:52.129 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:52.137 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:52.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:52.170 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-04-21T00:04:52.746 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:52.760 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:52.760 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:53.155 INFO:teuthology.orchestra.run.smithi071.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:53.178 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/232 2024-04-21T00:04:53.178 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/232 2024-04-21T00:04:53.178 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:53.180 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:53.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:53.210 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-04-21T00:04:53.765 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:53.779 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:53.779 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:54.154 INFO:teuthology.orchestra.run.smithi071.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:54.165 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/233 2024-04-21T00:04:54.166 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/233 2024-04-21T00:04:54.166 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:54.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:54.204 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-04-21T00:04:54.746 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:54.761 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:54.761 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:55.137 INFO:teuthology.orchestra.run.smithi071.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:55.149 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/234 2024-04-21T00:04:55.150 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/234 2024-04-21T00:04:55.150 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:55.157 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:55.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:55.193 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-04-21T00:04:55.761 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:55.776 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:55.776 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:56.148 INFO:teuthology.orchestra.run.smithi071.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:04:56.162 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/235 2024-04-21T00:04:56.162 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/235 2024-04-21T00:04:56.162 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:56.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:56.210 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-04-21T00:04:56.775 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:56.787 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:58.352 INFO:teuthology.orchestra.run.smithi071.stdout:generic/236 2s 2024-04-21T00:04:58.372 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/236 2024-04-21T00:04:58.372 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:58.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:58.420 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-04-21T00:04:59.137 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:04:59.150 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:04:59.150 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:59.625 INFO:teuthology.orchestra.run.smithi071.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-21T00:04:59.636 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/237 2024-04-21T00:04:59.636 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/237 2024-04-21T00:04:59.636 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:04:59.645 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:04:59.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:04:59.675 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-04-21T00:05:00.211 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:05:00.226 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:05:00.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:05:00.607 INFO:teuthology.orchestra.run.smithi071.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:05:00.617 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/238 2024-04-21T00:05:00.617 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/238 2024-04-21T00:05:00.617 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:05:00.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:05:00.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:05:00.657 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-04-21T00:05:01.187 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:05:01.200 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:05:01.200 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:05:01.642 INFO:teuthology.orchestra.run.smithi071.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-04-21T00:05:01.652 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/239 2024-04-21T00:05:01.652 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/239 2024-04-21T00:05:01.653 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:05:01.660 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:05:01.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:05:01.693 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-04-21T00:05:02.275 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:05:02.293 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:05:02.293 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:05:02.718 INFO:teuthology.orchestra.run.smithi071.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-04-21T00:05:02.727 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/240 2024-04-21T00:05:02.727 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/240 2024-04-21T00:05:02.727 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:05:02.734 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:05:02.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:05:02.768 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-04-21T00:05:03.305 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:05:03.320 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:05:03.320 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:05:14.448 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:05:14.456 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:05:44.589 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:05:44.593 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:06:14.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:06:14.765 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:06:17.401 INFO:teuthology.orchestra.run.smithi071.stdout:generic/241 74s 2024-04-21T00:06:17.418 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/241 2024-04-21T00:06:17.418 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:06:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:17.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:06:17.464 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-04-21T00:06:18.220 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:06:18.233 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:06:18.233 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:18.605 INFO:teuthology.orchestra.run.smithi071.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:06:18.616 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/242 2024-04-21T00:06:18.616 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/242 2024-04-21T00:06:18.616 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:06:18.625 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:18.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:06:18.655 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-04-21T00:06:19.237 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:06:19.255 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:06:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:19.630 INFO:teuthology.orchestra.run.smithi071.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:06:19.641 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/243 2024-04-21T00:06:19.641 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/243 2024-04-21T00:06:19.642 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:06:19.650 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:19.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:06:19.677 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-04-21T00:06:20.203 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:06:20.217 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:06:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:20.609 INFO:teuthology.orchestra.run.smithi071.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-21T00:06:20.619 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/244 2024-04-21T00:06:20.619 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/244 2024-04-21T00:06:20.619 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:06:20.626 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:20.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:06:20.656 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-04-21T00:06:21.230 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:06:21.245 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:06:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:21.826 INFO:teuthology.orchestra.run.smithi071.stdout:generic/245 0s 2024-04-21T00:06:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/245 2024-04-21T00:06:21.844 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:06:21.853 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:21.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:06:21.878 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-04-21T00:06:22.588 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:06:22.602 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:06:22.603 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:23.875 INFO:teuthology.orchestra.run.smithi071.stdout:generic/246 1s 2024-04-21T00:06:23.893 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/246 2024-04-21T00:06:23.894 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:06:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:23.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:06:23.935 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-04-21T00:06:24.671 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:06:24.687 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:06:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:06:44.961 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:06:44.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:07:15.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:07:15.169 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:07:16.592 INFO:teuthology.orchestra.run.smithi071.stdout:generic/247 52s 2024-04-21T00:07:16.611 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/247 2024-04-21T00:07:16.611 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:16.622 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:16.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:16.651 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-04-21T00:07:17.206 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:17.220 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:17.686 INFO:teuthology.orchestra.run.smithi071.stdout:generic/248 0s 2024-04-21T00:07:17.705 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/248 2024-04-21T00:07:17.705 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:17.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:17.750 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-04-21T00:07:18.285 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:18.302 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:22.312 INFO:teuthology.orchestra.run.smithi071.stdout:generic/249 4s 2024-04-21T00:07:22.328 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/249 2024-04-21T00:07:22.328 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:22.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:22.371 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-04-21T00:07:23.087 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:23.100 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:23.100 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:23.521 INFO:teuthology.orchestra.run.smithi071.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:07:23.532 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/250 2024-04-21T00:07:23.532 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/250 2024-04-21T00:07:23.532 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:23.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:23.572 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-04-21T00:07:24.114 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:24.130 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:24.130 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:24.526 INFO:teuthology.orchestra.run.smithi071.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:07:24.538 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/251 2024-04-21T00:07:24.538 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/251 2024-04-21T00:07:24.539 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:24.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:24.577 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-04-21T00:07:25.119 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:25.133 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:25.551 INFO:teuthology.orchestra.run.smithi071.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:07:25.562 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/252 2024-04-21T00:07:25.562 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/252 2024-04-21T00:07:25.563 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:25.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:25.602 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-04-21T00:07:26.139 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:26.154 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:26.154 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:26.518 INFO:teuthology.orchestra.run.smithi071.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:07:26.529 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/253 2024-04-21T00:07:26.529 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/253 2024-04-21T00:07:26.529 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:26.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:26.574 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-04-21T00:07:27.115 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:27.129 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:27.129 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:27.509 INFO:teuthology.orchestra.run.smithi071.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:07:27.518 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/254 2024-04-21T00:07:27.518 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/254 2024-04-21T00:07:27.519 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:27.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:27.555 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-04-21T00:07:28.119 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:28.134 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:28.134 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:30.696 INFO:teuthology.orchestra.run.smithi071.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-21T00:07:30.708 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/255 2024-04-21T00:07:30.708 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/255 2024-04-21T00:07:30.709 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:30.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:30.770 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-04-21T00:07:31.503 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:31.520 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:34.181 INFO:teuthology.orchestra.run.smithi071.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:07:34.191 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/256 2024-04-21T00:07:34.192 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/256 2024-04-21T00:07:34.192 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:34.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:34.230 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-04-21T00:07:34.782 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:34.795 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:37.196 INFO:teuthology.orchestra.run.smithi071.stdout:generic/257 3s 2024-04-21T00:07:37.215 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/257 2024-04-21T00:07:37.215 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:37.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:37.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:37.258 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-04-21T00:07:38.035 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:38.051 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:38.051 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:38.527 INFO:teuthology.orchestra.run.smithi071.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/258.out.bad) 2024-04-21T00:07:38.538 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/258.out 2024-04-20 21:21:29.641925388 +0000 2024-04-21T00:07:38.538 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/258.out.bad 2024-04-21 00:07:38.523720847 +0000 2024-04-21T00:07:38.538 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -1,5 +1,6 @@ 2024-04-21T00:07:38.538 INFO:teuthology.orchestra.run.smithi071.stdout: QA output created by 258 2024-04-21T00:07:38.538 INFO:teuthology.orchestra.run.smithi071.stdout: Creating file with timestamp of Jan 1, 1960 2024-04-21T00:07:38.538 INFO:teuthology.orchestra.run.smithi071.stdout: Testing for negative seconds since epoch 2024-04-21T00:07:38.538 INFO:teuthology.orchestra.run.smithi071.stdout: -Remounting to flush cache 2024-04-21T00:07:38.538 INFO:teuthology.orchestra.run.smithi071.stdout: -Testing for negative seconds since epoch 2024-04-21T00:07:38.539 INFO:teuthology.orchestra.run.smithi071.stdout: +Timestamp wrapped: 3979351756 2024-04-21T00:07:38.539 INFO:teuthology.orchestra.run.smithi071.stdout: +Timestamp wrapped 2024-04-21T00:07:38.539 INFO:teuthology.orchestra.run.smithi071.stdout: +(see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/258.full for details) 2024-04-21T00:07:38.544 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/258 2024-04-21T00:07:38.545 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/258 2024-04-21T00:07:38.545 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-21T00:07:38.554 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:38.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T00:07:38.580 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-21T00:07:38.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-21T00:07:38.580 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-04-21T00:07:39.125 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:39.139 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:39.139 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:39.506 INFO:teuthology.orchestra.run.smithi071.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:07:39.519 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/259 2024-04-21T00:07:39.519 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/259 2024-04-21T00:07:39.519 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:39.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:39.561 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-04-21T00:07:40.143 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:40.156 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:40.624 INFO:teuthology.orchestra.run.smithi071.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:07:40.637 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/260 2024-04-21T00:07:40.637 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/260 2024-04-21T00:07:40.637 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:40.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:40.672 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-04-21T00:07:41.236 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:41.249 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:41.249 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:41.837 INFO:teuthology.orchestra.run.smithi071.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:07:41.847 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/261 2024-04-21T00:07:41.847 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/261 2024-04-21T00:07:41.847 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:41.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:41.891 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-04-21T00:07:42.471 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:42.488 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:42.965 INFO:teuthology.orchestra.run.smithi071.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:07:42.979 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/262 2024-04-21T00:07:42.979 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/262 2024-04-21T00:07:42.979 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:07:42.989 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:43.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:07:43.026 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-04-21T00:07:43.553 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:07:43.567 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:07:43.567 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:07:45.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:07:45.291 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:08:15.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:08:15.413 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:08:45.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:08:45.610 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:09:15.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:09:15.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:09:39.411 INFO:teuthology.orchestra.run.smithi071.stdout:generic/263 116s 2024-04-21T00:09:39.432 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/263 2024-04-21T00:09:39.432 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:39.444 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:39.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:39.476 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-04-21T00:09:40.160 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:40.171 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:40.590 INFO:teuthology.orchestra.run.smithi071.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:40.601 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/264 2024-04-21T00:09:40.601 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/264 2024-04-21T00:09:40.601 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:40.609 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:40.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:40.637 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-04-21T00:09:41.127 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:41.140 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:41.140 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:41.565 INFO:teuthology.orchestra.run.smithi071.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:41.577 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/265 2024-04-21T00:09:41.577 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/265 2024-04-21T00:09:41.577 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:41.586 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:41.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:41.614 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-04-21T00:09:42.154 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:42.169 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:42.169 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:42.622 INFO:teuthology.orchestra.run.smithi071.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:42.633 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/266 2024-04-21T00:09:42.633 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/266 2024-04-21T00:09:42.633 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:42.642 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:42.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:42.674 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-04-21T00:09:43.226 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:43.240 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:43.705 INFO:teuthology.orchestra.run.smithi071.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:43.720 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/267 2024-04-21T00:09:43.720 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/267 2024-04-21T00:09:43.720 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:43.732 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:43.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:43.766 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-04-21T00:09:44.282 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:44.294 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:44.294 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:44.753 INFO:teuthology.orchestra.run.smithi071.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:44.767 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/268 2024-04-21T00:09:44.767 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/268 2024-04-21T00:09:44.767 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:44.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:44.813 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-04-21T00:09:45.344 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:45.356 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:45.356 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:45.760 INFO:teuthology.orchestra.run.smithi071.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:45.775 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/269 2024-04-21T00:09:45.775 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/269 2024-04-21T00:09:45.775 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:45.786 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:45.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:45.819 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-04-21T00:09:45.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:09:45.898 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:09:46.295 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:46.308 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:46.308 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:46.722 INFO:teuthology.orchestra.run.smithi071.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-21T00:09:46.735 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/270 2024-04-21T00:09:46.735 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/270 2024-04-21T00:09:46.735 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:46.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:46.779 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-04-21T00:09:47.328 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:47.342 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:47.810 INFO:teuthology.orchestra.run.smithi071.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:47.822 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/271 2024-04-21T00:09:47.822 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/271 2024-04-21T00:09:47.823 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:47.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:47.867 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-04-21T00:09:48.422 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:48.435 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:48.435 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:48.903 INFO:teuthology.orchestra.run.smithi071.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:48.916 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/272 2024-04-21T00:09:48.917 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/272 2024-04-21T00:09:48.917 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:48.929 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:48.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:48.959 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-04-21T00:09:49.480 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:49.494 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:49.494 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:49.902 INFO:teuthology.orchestra.run.smithi071.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:49.913 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/273 2024-04-21T00:09:49.913 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/273 2024-04-21T00:09:49.913 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:49.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:49.952 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-04-21T00:09:50.477 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:50.490 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:50.490 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:50.918 INFO:teuthology.orchestra.run.smithi071.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:50.930 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/274 2024-04-21T00:09:50.930 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/274 2024-04-21T00:09:50.930 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:50.942 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:50.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:50.975 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-04-21T00:09:51.523 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:51.536 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:51.536 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:51.948 INFO:teuthology.orchestra.run.smithi071.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:51.962 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/275 2024-04-21T00:09:51.962 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/275 2024-04-21T00:09:51.962 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:52.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:52.007 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-04-21T00:09:52.533 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:52.546 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:52.546 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:53.018 INFO:teuthology.orchestra.run.smithi071.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:53.031 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/276 2024-04-21T00:09:53.031 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/276 2024-04-21T00:09:53.031 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:53.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:53.076 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-04-21T00:09:53.623 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:53.636 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:54.051 INFO:teuthology.orchestra.run.smithi071.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:54.063 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/277 2024-04-21T00:09:54.063 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/277 2024-04-21T00:09:54.063 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:54.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:54.103 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-04-21T00:09:54.627 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:54.641 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:54.641 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:55.168 INFO:teuthology.orchestra.run.smithi071.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:55.182 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/278 2024-04-21T00:09:55.183 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/278 2024-04-21T00:09:55.183 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:55.195 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:55.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:55.230 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-04-21T00:09:55.781 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:55.795 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:55.795 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:56.237 INFO:teuthology.orchestra.run.smithi071.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:56.251 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/279 2024-04-21T00:09:56.251 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/279 2024-04-21T00:09:56.251 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:56.262 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:56.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:56.294 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-04-21T00:09:56.836 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:56.850 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:57.309 INFO:teuthology.orchestra.run.smithi071.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:57.320 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/280 2024-04-21T00:09:57.320 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/280 2024-04-21T00:09:57.320 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:57.329 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:57.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:57.359 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-04-21T00:09:57.877 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:57.890 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:57.891 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:58.339 INFO:teuthology.orchestra.run.smithi071.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:58.349 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/281 2024-04-21T00:09:58.350 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/281 2024-04-21T00:09:58.350 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:58.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:58.391 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-04-21T00:09:58.918 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:58.931 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:58.932 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:59.395 INFO:teuthology.orchestra.run.smithi071.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:09:59.406 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/282 2024-04-21T00:09:59.406 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/282 2024-04-21T00:09:59.406 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:09:59.414 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:09:59.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:09:59.444 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-04-21T00:09:59.965 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:09:59.980 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:09:59.980 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:10:00.442 INFO:teuthology.orchestra.run.smithi071.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:10:00.455 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/283 2024-04-21T00:10:00.455 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/283 2024-04-21T00:10:00.456 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:10:00.465 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:10:00.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:10:00.497 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-04-21T00:10:01.025 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:10:01.037 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:10:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:10:01.460 INFO:teuthology.orchestra.run.smithi071.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:10:01.474 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/284 2024-04-21T00:10:01.474 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/284 2024-04-21T00:10:01.474 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:10:01.485 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:10:01.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:10:01.518 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-04-21T00:10:02.032 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:10:02.045 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:10:02.045 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:10:07.785 INFO:teuthology.orchestra.run.smithi071.stdout:generic/285 5s 2024-04-21T00:10:07.802 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/285 2024-04-21T00:10:07.802 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:10:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:10:07.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:10:07.842 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-04-21T00:10:08.606 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:10:08.620 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:10:08.620 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:10:16.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:10:16.055 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:10:46.249 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:10:46.258 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:11:16.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:11:16.445 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:11:46.623 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:11:46.634 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:12:16.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:12:16.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:12:46.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:12:46.935 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:13:04.541 INFO:teuthology.orchestra.run.smithi071.stdout:generic/286 176s 2024-04-21T00:13:04.560 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/286 2024-04-21T00:13:04.560 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:04.569 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:04.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:04.601 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-04-21T00:13:05.294 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:05.306 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:05.716 INFO:teuthology.orchestra.run.smithi071.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:05.726 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/287 2024-04-21T00:13:05.726 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/287 2024-04-21T00:13:05.726 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:05.734 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:05.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:05.755 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-04-21T00:13:06.182 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:06.194 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:06.195 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:06.593 INFO:teuthology.orchestra.run.smithi071.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:06.603 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/288 2024-04-21T00:13:06.603 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/288 2024-04-21T00:13:06.604 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:06.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:06.642 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-04-21T00:13:07.159 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:07.173 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:07.585 INFO:teuthology.orchestra.run.smithi071.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:07.597 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/289 2024-04-21T00:13:07.597 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/289 2024-04-21T00:13:07.597 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:07.607 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:07.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:07.643 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-04-21T00:13:08.181 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:08.194 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:08.564 INFO:teuthology.orchestra.run.smithi071.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:08.577 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/290 2024-04-21T00:13:08.577 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/290 2024-04-21T00:13:08.577 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:08.589 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:08.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:08.624 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-04-21T00:13:09.145 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:09.158 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:09.158 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:09.587 INFO:teuthology.orchestra.run.smithi071.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:09.598 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/291 2024-04-21T00:13:09.598 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/291 2024-04-21T00:13:09.598 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:09.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:09.637 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-04-21T00:13:10.168 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:10.181 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:10.609 INFO:teuthology.orchestra.run.smithi071.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:10.619 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/292 2024-04-21T00:13:10.619 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/292 2024-04-21T00:13:10.619 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:10.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:10.654 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-04-21T00:13:11.168 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:11.181 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:11.181 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:11.595 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/293 2024-04-21T00:13:11.596 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/293 2024-04-21T00:13:11.596 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:11.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:11.633 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-04-21T00:13:12.124 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:12.137 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:12.643 INFO:teuthology.orchestra.run.smithi071.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:12.655 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/294 2024-04-21T00:13:12.655 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/294 2024-04-21T00:13:12.655 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:12.664 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:12.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:12.696 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-04-21T00:13:13.236 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:13.249 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:13.677 INFO:teuthology.orchestra.run.smithi071.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:13.689 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/295 2024-04-21T00:13:13.689 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/295 2024-04-21T00:13:13.689 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:13.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:13.732 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-04-21T00:13:14.298 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:14.311 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:14.311 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:14.738 INFO:teuthology.orchestra.run.smithi071.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:14.748 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/296 2024-04-21T00:13:14.748 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/296 2024-04-21T00:13:14.748 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:14.758 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:14.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:14.787 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-04-21T00:13:15.358 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:15.371 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:15.371 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:15.827 INFO:teuthology.orchestra.run.smithi071.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:15.837 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/297 2024-04-21T00:13:15.837 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/297 2024-04-21T00:13:15.837 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:15.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:15.875 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-04-21T00:13:16.397 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:16.409 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:16.409 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:16.829 INFO:teuthology.orchestra.run.smithi071.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:16.843 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/298 2024-04-21T00:13:16.843 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/298 2024-04-21T00:13:16.844 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:16.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:16.882 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-04-21T00:13:17.146 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:13:17.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:13:17.389 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:17.401 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:17.841 INFO:teuthology.orchestra.run.smithi071.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:17.852 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/299 2024-04-21T00:13:17.852 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/299 2024-04-21T00:13:17.852 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:17.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:17.891 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-04-21T00:13:18.472 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:18.485 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:18.485 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:18.884 INFO:teuthology.orchestra.run.smithi071.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:18.894 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/300 2024-04-21T00:13:18.895 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/300 2024-04-21T00:13:18.895 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:18.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:18.932 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-04-21T00:13:19.477 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:19.491 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:19.491 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:19.968 INFO:teuthology.orchestra.run.smithi071.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:19.981 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/301 2024-04-21T00:13:19.981 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/301 2024-04-21T00:13:19.981 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:20.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:20.019 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-04-21T00:13:20.547 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:20.559 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:20.559 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:20.997 INFO:teuthology.orchestra.run.smithi071.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:21.010 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/302 2024-04-21T00:13:21.010 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/302 2024-04-21T00:13:21.010 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:21.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:21.053 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-04-21T00:13:21.588 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:21.601 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:21.602 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:22.171 INFO:teuthology.orchestra.run.smithi071.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-21T00:13:22.186 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/303 2024-04-21T00:13:22.186 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/303 2024-04-21T00:13:22.186 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:22.196 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:22.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:22.236 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-04-21T00:13:22.890 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:22.902 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:23.483 INFO:teuthology.orchestra.run.smithi071.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-21T00:13:23.496 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/304 2024-04-21T00:13:23.496 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/304 2024-04-21T00:13:23.496 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:23.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:23.565 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-04-21T00:13:24.214 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:24.226 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:24.607 INFO:teuthology.orchestra.run.smithi071.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:24.615 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/305 2024-04-21T00:13:24.616 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/305 2024-04-21T00:13:24.616 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:24.625 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:24.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:24.655 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-04-21T00:13:25.186 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:25.201 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:25.626 INFO:teuthology.orchestra.run.smithi071.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:25.636 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/306 2024-04-21T00:13:25.636 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/306 2024-04-21T00:13:25.636 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:25.647 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:25.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:25.677 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-04-21T00:13:26.208 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:26.222 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:26.222 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:26.672 INFO:teuthology.orchestra.run.smithi071.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:13:26.686 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/307 2024-04-21T00:13:26.686 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/307 2024-04-21T00:13:26.686 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:26.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:26.729 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-04-21T00:13:27.274 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:27.287 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:27.287 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:27.803 INFO:teuthology.orchestra.run.smithi071.stdout:generic/308 0s 2024-04-21T00:13:27.818 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/308 2024-04-21T00:13:27.818 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:27.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:27.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:27.858 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-04-21T00:13:28.397 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:28.411 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:30.012 INFO:teuthology.orchestra.run.smithi071.stdout:generic/309 1s 2024-04-21T00:13:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/309 2024-04-21T00:13:30.029 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:13:30.038 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:30.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:13:30.072 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-04-21T00:13:30.752 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:13:30.765 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:13:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:13:47.356 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:13:47.361 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:14:17.530 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:14:17.539 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:14:47.829 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:14:47.837 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:15:18.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:15:18.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:15:37.857 INFO:teuthology.orchestra.run.smithi071.stdout:generic/310 127s 2024-04-21T00:15:37.888 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/310 2024-04-21T00:15:37.888 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:37.898 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:37.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:15:37.958 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-04-21T00:15:38.801 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:15:38.812 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:15:38.812 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:39.369 INFO:teuthology.orchestra.run.smithi071.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:15:39.383 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/311 2024-04-21T00:15:39.383 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/311 2024-04-21T00:15:39.383 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:39.393 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:39.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:15:39.430 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-04-21T00:15:39.971 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:15:39.984 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:15:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:40.525 INFO:teuthology.orchestra.run.smithi071.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:15:40.538 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/312 2024-04-21T00:15:40.539 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/312 2024-04-21T00:15:40.539 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:40.551 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:40.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:15:40.585 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-04-21T00:15:41.129 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:15:41.143 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:15:41.143 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:45.758 INFO:teuthology.orchestra.run.smithi071.stdout:generic/313 4s 2024-04-21T00:15:45.776 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/313 2024-04-21T00:15:45.776 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:45.785 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:45.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:15:45.817 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-04-21T00:15:46.354 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:15:46.369 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:15:46.369 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:47.623 INFO:teuthology.orchestra.run.smithi071.stdout:generic/314 1s 2024-04-21T00:15:47.641 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/314 2024-04-21T00:15:47.641 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:47.650 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:47.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:15:47.680 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-04-21T00:15:48.192 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:15:48.204 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:15:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:48.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:15:48.434 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:15:49.820 INFO:teuthology.orchestra.run.smithi071.stdout:generic/315 1s 2024-04-21T00:15:49.837 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/315 2024-04-21T00:15:49.837 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:49.845 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:49.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:15:49.891 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-04-21T00:15:50.606 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:15:50.617 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:15:50.618 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:54.633 INFO:teuthology.orchestra.run.smithi071.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-21T00:15:54.647 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/316 2024-04-21T00:15:54.647 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/316 2024-04-21T00:15:54.647 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:54.657 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:54.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:15:54.708 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-04-21T00:15:55.365 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:15:55.377 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:15:55.377 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:55.809 INFO:teuthology.orchestra.run.smithi071.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:15:55.822 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/317 2024-04-21T00:15:55.822 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/317 2024-04-21T00:15:55.822 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:55.833 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:55.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:15:55.864 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-04-21T00:15:56.379 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:15:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:15:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:56.800 INFO:teuthology.orchestra.run.smithi071.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:15:56.812 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/318 2024-04-21T00:15:56.812 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/318 2024-04-21T00:15:56.812 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:56.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:15:56.851 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-04-21T00:15:57.378 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:15:57.392 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:15:57.392 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:57.876 INFO:teuthology.orchestra.run.smithi071.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-21T00:15:57.887 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/319 2024-04-21T00:15:57.896 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/319 2024-04-21T00:15:57.897 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:57.899 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:57.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:15:57.937 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-04-21T00:15:58.470 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:15:58.484 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:15:58.484 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:58.918 INFO:teuthology.orchestra.run.smithi071.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:15:58.932 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/320 2024-04-21T00:15:58.932 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/320 2024-04-21T00:15:58.932 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:58.941 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:58.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:15:58.974 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-04-21T00:15:59.494 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:15:59.508 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:15:59.508 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:15:59.971 INFO:teuthology.orchestra.run.smithi071.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:15:59.983 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/321 2024-04-21T00:15:59.983 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/321 2024-04-21T00:15:59.983 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:15:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:16:00.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:16:00.027 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-04-21T00:16:00.565 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:16:00.577 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:16:00.577 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:16:01.017 INFO:teuthology.orchestra.run.smithi071.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:16:01.031 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/322 2024-04-21T00:16:01.031 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/322 2024-04-21T00:16:01.031 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:16:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:16:01.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:16:01.075 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-04-21T00:16:01.611 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:16:01.624 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:16:01.624 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:16:18.569 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:16:18.574 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:16:48.690 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:16:48.697 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:17:18.812 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:17:18.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:17:48.936 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:17:48.944 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:18:04.459 INFO:teuthology.orchestra.run.smithi071.stdout:generic/323 123s 2024-04-21T00:18:04.477 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/323 2024-04-21T00:18:04.477 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:04.486 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:04.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:04.529 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-04-21T00:18:05.177 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:05.189 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:05.189 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:05.695 INFO:teuthology.orchestra.run.smithi071.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:05.706 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/324 2024-04-21T00:18:05.706 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/324 2024-04-21T00:18:05.706 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:05.716 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:05.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:05.745 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-04-21T00:18:06.290 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:06.304 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:06.304 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:06.770 INFO:teuthology.orchestra.run.smithi071.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:06.783 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/325 2024-04-21T00:18:06.783 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/325 2024-04-21T00:18:06.784 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:06.793 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:06.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:06.823 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-04-21T00:18:07.364 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:07.377 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:07.377 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:07.809 INFO:teuthology.orchestra.run.smithi071.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:07.821 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/326 2024-04-21T00:18:07.821 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/326 2024-04-21T00:18:07.821 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:07.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:07.862 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-04-21T00:18:08.410 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:08.424 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:08.869 INFO:teuthology.orchestra.run.smithi071.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:08.880 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/327 2024-04-21T00:18:08.880 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/327 2024-04-21T00:18:08.880 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:08.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:08.917 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-04-21T00:18:09.442 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:09.455 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:09.455 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:09.880 INFO:teuthology.orchestra.run.smithi071.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:09.894 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/328 2024-04-21T00:18:09.894 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/328 2024-04-21T00:18:09.894 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:09.906 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:09.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:09.935 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-04-21T00:18:10.455 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:10.470 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:10.921 INFO:teuthology.orchestra.run.smithi071.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:10.934 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/329 2024-04-21T00:18:10.934 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/329 2024-04-21T00:18:10.935 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:10.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:10.979 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-04-21T00:18:11.508 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:11.521 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:11.521 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:11.950 INFO:teuthology.orchestra.run.smithi071.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:11.961 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/330 2024-04-21T00:18:11.961 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/330 2024-04-21T00:18:11.961 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:11.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:11.999 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-04-21T00:18:12.532 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:12.545 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:12.993 INFO:teuthology.orchestra.run.smithi071.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:13.005 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/331 2024-04-21T00:18:13.005 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/331 2024-04-21T00:18:13.005 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:13.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:13.050 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-04-21T00:18:13.579 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:13.592 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:13.593 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:14.020 INFO:teuthology.orchestra.run.smithi071.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:14.034 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/332 2024-04-21T00:18:14.035 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/332 2024-04-21T00:18:14.035 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:14.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:14.081 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-04-21T00:18:14.634 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:14.649 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:15.054 INFO:teuthology.orchestra.run.smithi071.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:15.066 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/333 2024-04-21T00:18:15.066 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/333 2024-04-21T00:18:15.066 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:15.079 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:15.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:15.109 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-04-21T00:18:15.659 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:15.673 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:16.071 INFO:teuthology.orchestra.run.smithi071.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:16.083 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/334 2024-04-21T00:18:16.083 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/334 2024-04-21T00:18:16.083 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:16.092 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:16.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:16.121 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-04-21T00:18:16.645 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:16.659 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:16.659 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:17.152 INFO:teuthology.orchestra.run.smithi071.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:17.163 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/335 2024-04-21T00:18:17.164 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/335 2024-04-21T00:18:17.164 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:17.173 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:17.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:17.205 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-04-21T00:18:17.720 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:17.735 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:18.179 INFO:teuthology.orchestra.run.smithi071.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:18.190 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/336 2024-04-21T00:18:18.190 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/336 2024-04-21T00:18:18.190 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:18.199 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:18.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:18.231 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-04-21T00:18:18.773 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:18.785 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:18.785 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:19.226 INFO:teuthology.orchestra.run.smithi071.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:19.239 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/337 2024-04-21T00:18:19.239 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/337 2024-04-21T00:18:19.239 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:19.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:19.280 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-04-21T00:18:19.818 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:18:19.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:18:19.833 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:19.845 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:19.846 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:20.281 INFO:teuthology.orchestra.run.smithi071.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:20.294 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/338 2024-04-21T00:18:20.294 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/338 2024-04-21T00:18:20.294 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:20.304 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:20.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:20.340 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-04-21T00:18:20.867 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:20.881 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:21.298 INFO:teuthology.orchestra.run.smithi071.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:21.311 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/339 2024-04-21T00:18:21.311 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/339 2024-04-21T00:18:21.311 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:21.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:21.440 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-04-21T00:18:21.977 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:21.992 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:21.992 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:22.397 INFO:teuthology.orchestra.run.smithi071.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:22.408 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/340 2024-04-21T00:18:22.409 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/340 2024-04-21T00:18:22.409 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:22.418 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:22.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:22.451 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-04-21T00:18:22.968 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:22.982 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:23.452 INFO:teuthology.orchestra.run.smithi071.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:23.467 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/341 2024-04-21T00:18:23.467 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/341 2024-04-21T00:18:23.467 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:23.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:23.507 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-04-21T00:18:24.033 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:24.047 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:24.501 INFO:teuthology.orchestra.run.smithi071.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:24.512 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/342 2024-04-21T00:18:24.512 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/342 2024-04-21T00:18:24.512 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:24.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:24.550 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-04-21T00:18:25.083 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:25.097 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:25.596 INFO:teuthology.orchestra.run.smithi071.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:25.609 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/343 2024-04-21T00:18:25.610 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/343 2024-04-21T00:18:25.610 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:25.621 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:25.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:25.654 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-04-21T00:18:26.189 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:26.202 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:26.202 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:26.616 INFO:teuthology.orchestra.run.smithi071.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:26.627 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/344 2024-04-21T00:18:26.627 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/344 2024-04-21T00:18:26.627 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:26.636 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:26.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:26.667 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-04-21T00:18:27.217 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:27.230 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:27.230 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:27.652 INFO:teuthology.orchestra.run.smithi071.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/345 2024-04-21T00:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/345 2024-04-21T00:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:27.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:27.710 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-04-21T00:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:28.265 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:28.687 INFO:teuthology.orchestra.run.smithi071.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:28.697 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/346 2024-04-21T00:18:28.697 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/346 2024-04-21T00:18:28.697 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:28.706 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:28.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:28.734 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-04-21T00:18:29.268 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:29.282 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:29.830 INFO:teuthology.orchestra.run.smithi071.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:29.844 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/347 2024-04-21T00:18:29.844 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/347 2024-04-21T00:18:29.844 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:29.855 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:29.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:29.888 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-04-21T00:18:30.427 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:30.439 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:30.439 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:30.898 INFO:teuthology.orchestra.run.smithi071.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:30.913 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/348 2024-04-21T00:18:30.913 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/348 2024-04-21T00:18:30.913 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:30.925 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:30.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:30.962 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-04-21T00:18:31.495 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:31.508 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:34.928 INFO:teuthology.orchestra.run.smithi071.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-21T00:18:34.942 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/349 2024-04-21T00:18:34.942 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/349 2024-04-21T00:18:34.942 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:34.952 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:34.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:34.984 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-04-21T00:18:35.501 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:35.514 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:35.514 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:39.884 INFO:teuthology.orchestra.run.smithi071.stdout:generic/350 4s 2024-04-21T00:18:39.900 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/350 2024-04-21T00:18:39.900 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:39.909 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:39.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:39.937 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-04-21T00:18:40.481 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:40.496 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:40.497 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:43.467 INFO:teuthology.orchestra.run.smithi071.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-21T00:18:43.478 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/351 2024-04-21T00:18:43.478 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/351 2024-04-21T00:18:43.478 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:43.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:43.529 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-04-21T00:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:44.217 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:44.217 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:44.656 INFO:teuthology.orchestra.run.smithi071.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:44.669 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/352 2024-04-21T00:18:44.670 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/352 2024-04-21T00:18:44.670 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:44.681 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:44.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:44.714 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-04-21T00:18:45.271 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:45.285 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:45.285 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:45.761 INFO:teuthology.orchestra.run.smithi071.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:45.771 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/353 2024-04-21T00:18:45.772 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/353 2024-04-21T00:18:45.772 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:45.779 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:45.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:45.811 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-04-21T00:18:46.344 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:46.356 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:46.356 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:46.787 INFO:teuthology.orchestra.run.smithi071.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:46.801 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/354 2024-04-21T00:18:46.801 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/354 2024-04-21T00:18:46.802 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:46.813 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:46.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:46.847 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-04-21T00:18:47.391 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:47.404 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:49.070 INFO:teuthology.orchestra.run.smithi071.stdout:generic/355 2s 2024-04-21T00:18:49.086 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/355 2024-04-21T00:18:49.086 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:49.095 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:49.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:49.126 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-04-21T00:18:49.831 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:49.843 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:49.843 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:49.937 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:18:49.945 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:18:50.197 INFO:teuthology.orchestra.run.smithi071.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:50.210 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/356 2024-04-21T00:18:50.210 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/356 2024-04-21T00:18:50.210 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:50.223 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:50.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:50.255 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-04-21T00:18:50.754 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:50.765 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:50.765 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:51.117 INFO:teuthology.orchestra.run.smithi071.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:51.124 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/357 2024-04-21T00:18:51.124 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/357 2024-04-21T00:18:51.124 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:51.131 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:51.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:51.155 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-04-21T00:18:51.667 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:51.679 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:51.680 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:52.053 INFO:teuthology.orchestra.run.smithi071.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:52.064 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/358 2024-04-21T00:18:52.064 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/358 2024-04-21T00:18:52.064 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:52.073 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:52.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:52.102 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-04-21T00:18:52.645 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:52.660 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:53.083 INFO:teuthology.orchestra.run.smithi071.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:53.095 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/359 2024-04-21T00:18:53.095 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/359 2024-04-21T00:18:53.095 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:53.104 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:53.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:53.135 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-04-21T00:18:53.670 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:53.684 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:54.367 INFO:teuthology.orchestra.run.smithi071.stdout:generic/360 1s 2024-04-21T00:18:54.384 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/360 2024-04-21T00:18:54.384 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:54.393 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:54.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:54.425 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-04-21T00:18:54.969 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:54.982 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:54.983 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:55.412 INFO:teuthology.orchestra.run.smithi071.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:55.426 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/361 2024-04-21T00:18:55.426 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/361 2024-04-21T00:18:55.427 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:55.438 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:55.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:55.468 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-04-21T00:18:55.983 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:55.996 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:55.996 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:56.419 INFO:teuthology.orchestra.run.smithi071.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:56.429 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/362 2024-04-21T00:18:56.430 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/362 2024-04-21T00:18:56.430 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:56.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:56.467 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-04-21T00:18:57.002 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:57.015 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:57.426 INFO:teuthology.orchestra.run.smithi071.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:57.438 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/363 2024-04-21T00:18:57.438 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/363 2024-04-21T00:18:57.438 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:57.447 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:57.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:57.475 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-04-21T00:18:57.989 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:58.002 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:58.002 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:58.452 INFO:teuthology.orchestra.run.smithi071.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:58.467 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/364 2024-04-21T00:18:58.467 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/364 2024-04-21T00:18:58.467 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:58.479 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:58.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:58.517 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-04-21T00:18:59.039 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:18:59.052 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:18:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:59.482 INFO:teuthology.orchestra.run.smithi071.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:18:59.496 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/365 2024-04-21T00:18:59.497 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/365 2024-04-21T00:18:59.497 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:18:59.508 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:18:59.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:18:59.542 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-04-21T00:19:00.126 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:00.142 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:00.581 INFO:teuthology.orchestra.run.smithi071.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:00.595 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/366 2024-04-21T00:19:00.595 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/366 2024-04-21T00:19:00.596 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:00.607 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:00.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:00.641 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-04-21T00:19:01.181 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:01.195 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:01.195 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:01.646 INFO:teuthology.orchestra.run.smithi071.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:01.658 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/367 2024-04-21T00:19:01.658 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/367 2024-04-21T00:19:01.658 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:01.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:01.699 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-04-21T00:19:02.222 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:02.238 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:02.699 INFO:teuthology.orchestra.run.smithi071.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:02.712 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/368 2024-04-21T00:19:02.712 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/368 2024-04-21T00:19:02.713 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:02.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:02.758 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-04-21T00:19:03.319 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:03.333 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:03.334 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:03.775 INFO:teuthology.orchestra.run.smithi071.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:03.789 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/369 2024-04-21T00:19:03.789 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/369 2024-04-21T00:19:03.789 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:03.799 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:03.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:03.835 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-04-21T00:19:04.352 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:04.364 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:04.365 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:04.752 INFO:teuthology.orchestra.run.smithi071.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:04.766 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/370 2024-04-21T00:19:04.766 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/370 2024-04-21T00:19:04.766 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:04.776 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:04.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:04.809 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-04-21T00:19:05.349 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:05.363 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:05.363 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:05.779 INFO:teuthology.orchestra.run.smithi071.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:05.790 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/371 2024-04-21T00:19:05.791 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/371 2024-04-21T00:19:05.791 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:05.800 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:05.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:05.833 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-04-21T00:19:06.355 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:06.788 INFO:teuthology.orchestra.run.smithi071.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:06.802 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/372 2024-04-21T00:19:06.802 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/372 2024-04-21T00:19:06.802 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:06.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:06.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:06.843 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-04-21T00:19:07.406 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:07.420 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:07.420 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:07.839 INFO:teuthology.orchestra.run.smithi071.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:07.850 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/373 2024-04-21T00:19:07.851 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/373 2024-04-21T00:19:07.851 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:07.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:07.890 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-04-21T00:19:08.439 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:08.451 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:08.451 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:08.878 INFO:teuthology.orchestra.run.smithi071.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:08.889 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/374 2024-04-21T00:19:08.889 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/374 2024-04-21T00:19:08.890 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:08.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:08.928 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-04-21T00:19:09.465 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:09.481 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:09.481 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:09.992 INFO:teuthology.orchestra.run.smithi071.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-21T00:19:10.004 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/375 2024-04-21T00:19:10.004 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/375 2024-04-21T00:19:10.004 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:10.014 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:10.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:10.045 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-04-21T00:19:10.589 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:10.601 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:10.601 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:11.083 INFO:teuthology.orchestra.run.smithi071.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:11.096 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/376 2024-04-21T00:19:11.096 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/376 2024-04-21T00:19:11.096 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:11.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:11.139 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-04-21T00:19:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:11.661 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:11.662 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:12.060 INFO:teuthology.orchestra.run.smithi071.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:12.071 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/377 2024-04-21T00:19:12.071 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/377 2024-04-21T00:19:12.071 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:12.081 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:12.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:12.111 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-04-21T00:19:12.639 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:12.653 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:12.653 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:13.784 INFO:teuthology.orchestra.run.smithi071.stdout:generic/378 1s 2024-04-21T00:19:13.805 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/378 2024-04-21T00:19:13.805 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:13.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:13.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:13.852 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-04-21T00:19:14.549 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:14.561 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:14.990 INFO:teuthology.orchestra.run.smithi071.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:15.001 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/379 2024-04-21T00:19:15.001 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/379 2024-04-21T00:19:15.001 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:15.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:15.039 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-04-21T00:19:15.578 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:15.592 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:16.027 INFO:teuthology.orchestra.run.smithi071.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:16.041 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/380 2024-04-21T00:19:16.042 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/380 2024-04-21T00:19:16.042 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:16.053 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:16.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:16.084 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-04-21T00:19:16.623 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:16.636 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:16.637 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:17.063 INFO:teuthology.orchestra.run.smithi071.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:17.073 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/381 2024-04-21T00:19:17.073 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/381 2024-04-21T00:19:17.073 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:17.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:17.110 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-04-21T00:19:17.622 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:17.636 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:18.029 INFO:teuthology.orchestra.run.smithi071.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:18.043 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/382 2024-04-21T00:19:18.043 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/382 2024-04-21T00:19:18.043 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:18.054 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:18.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:18.085 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-04-21T00:19:18.610 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:18.622 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:18.622 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:19.077 INFO:teuthology.orchestra.run.smithi071.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:19.089 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/383 2024-04-21T00:19:19.089 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/383 2024-04-21T00:19:19.089 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:19.099 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:19.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:19.129 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-04-21T00:19:19.609 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:19.622 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:19.622 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:19.955 INFO:teuthology.orchestra.run.smithi071.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-21T00:19:19.964 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/384 2024-04-21T00:19:19.964 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/384 2024-04-21T00:19:19.964 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:19.971 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:19.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:19.998 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-04-21T00:19:20.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:19:20.181 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:19:20.478 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:20.492 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:20.849 INFO:teuthology.orchestra.run.smithi071.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:20.858 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/385 2024-04-21T00:19:20.858 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/385 2024-04-21T00:19:20.858 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:20.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:20.892 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-04-21T00:19:21.402 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:21.851 INFO:teuthology.orchestra.run.smithi071.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-21T00:19:21.865 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/386 2024-04-21T00:19:21.866 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/386 2024-04-21T00:19:21.866 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:21.877 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:21.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:21.909 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-04-21T00:19:22.413 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:22.425 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:22.425 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:22.848 INFO:teuthology.orchestra.run.smithi071.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:22.863 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/387 2024-04-21T00:19:22.863 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/387 2024-04-21T00:19:22.864 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:22.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:22.904 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-04-21T00:19:23.463 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:23.476 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:23.913 INFO:teuthology.orchestra.run.smithi071.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:23.924 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/388 2024-04-21T00:19:23.924 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/388 2024-04-21T00:19:23.924 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:23.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:23.961 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-04-21T00:19:24.497 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:24.510 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:24.981 INFO:teuthology.orchestra.run.smithi071.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-04-21T00:19:24.991 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/389 2024-04-21T00:19:24.992 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/389 2024-04-21T00:19:24.992 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:25.001 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:25.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:25.029 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-04-21T00:19:25.547 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:25.559 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:25.559 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:26.029 INFO:teuthology.orchestra.run.smithi071.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:19:26.041 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/390 2024-04-21T00:19:26.041 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/390 2024-04-21T00:19:26.041 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:19:26.053 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:26.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:19:26.083 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-04-21T00:19:26.651 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:19:26.664 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:19:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:19:50.365 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:19:50.372 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:20:20.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:20:20.843 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:20:41.925 INFO:teuthology.orchestra.run.smithi071.stdout:generic/391 75s 2024-04-21T00:20:42.053 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/391 2024-04-21T00:20:42.053 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:42.065 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:42.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:42.152 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-04-21T00:20:43.172 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:43.186 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:43.601 INFO:teuthology.orchestra.run.smithi071.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:20:43.612 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/392 2024-04-21T00:20:43.612 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/392 2024-04-21T00:20:43.612 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:43.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:43.650 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-04-21T00:20:44.194 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:44.211 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:44.581 INFO:teuthology.orchestra.run.smithi071.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:20:44.592 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/393 2024-04-21T00:20:44.592 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/393 2024-04-21T00:20:44.592 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:44.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:44.630 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-04-21T00:20:45.188 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:45.201 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:45.201 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:45.716 INFO:teuthology.orchestra.run.smithi071.stdout:generic/394 0s 2024-04-21T00:20:45.732 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/394 2024-04-21T00:20:45.732 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:45.741 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:45.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:45.768 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-04-21T00:20:46.402 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:46.413 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:46.414 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:46.896 INFO:teuthology.orchestra.run.smithi071.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:20:46.909 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/395 2024-04-21T00:20:46.909 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/395 2024-04-21T00:20:46.909 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:46.917 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:46.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:46.944 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-04-21T00:20:47.431 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:47.443 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:47.443 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:48.032 INFO:teuthology.orchestra.run.smithi071.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:20:48.044 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/396 2024-04-21T00:20:48.044 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/396 2024-04-21T00:20:48.044 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:48.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:48.082 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-04-21T00:20:48.620 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:48.634 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:48.634 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:49.223 INFO:teuthology.orchestra.run.smithi071.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:20:49.237 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/397 2024-04-21T00:20:49.237 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/397 2024-04-21T00:20:49.237 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:49.247 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:49.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:49.279 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-04-21T00:20:49.825 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:49.839 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:49.839 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:50.381 INFO:teuthology.orchestra.run.smithi071.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:20:50.396 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/398 2024-04-21T00:20:50.396 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/398 2024-04-21T00:20:50.396 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:50.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:50.443 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-04-21T00:20:51.001 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:51.013 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:51.013 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:51.260 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:20:51.265 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:20:51.487 INFO:teuthology.orchestra.run.smithi071.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:20:51.499 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/399 2024-04-21T00:20:51.500 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/399 2024-04-21T00:20:51.500 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:51.509 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:51.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:51.539 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-04-21T00:20:52.094 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:52.107 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:52.107 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:52.543 INFO:teuthology.orchestra.run.smithi071.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-21T00:20:52.554 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/400 2024-04-21T00:20:52.554 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/400 2024-04-21T00:20:52.554 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:52.564 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:52.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:52.593 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-04-21T00:20:53.140 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:53.153 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:53.153 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:53.554 INFO:teuthology.orchestra.run.smithi071.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:20:53.566 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/401 2024-04-21T00:20:53.567 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/401 2024-04-21T00:20:53.567 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:53.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:53.604 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-04-21T00:20:54.149 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:54.162 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:54.581 INFO:teuthology.orchestra.run.smithi071.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:20:54.594 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/402 2024-04-21T00:20:54.594 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/402 2024-04-21T00:20:54.594 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:54.606 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:54.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:54.642 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-04-21T00:20:55.185 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:55.199 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:55.199 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:55.637 INFO:teuthology.orchestra.run.smithi071.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:20:55.652 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/403 2024-04-21T00:20:55.652 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/403 2024-04-21T00:20:55.653 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:55.664 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:55.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:55.693 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-04-21T00:20:56.229 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:20:56.243 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:20:56.244 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:59.433 INFO:teuthology.orchestra.run.smithi071.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-21T00:20:59.446 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/404 2024-04-21T00:20:59.446 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/404 2024-04-21T00:20:59.446 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:20:59.458 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:20:59.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:20:59.489 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-04-21T00:21:00.151 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:00.162 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:00.761 INFO:teuthology.orchestra.run.smithi071.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:00.771 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/405 2024-04-21T00:21:00.771 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/405 2024-04-21T00:21:00.772 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:00.780 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:00.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:00.808 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-04-21T00:21:01.358 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:01.372 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:01.777 INFO:teuthology.orchestra.run.smithi071.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:01.788 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/406 2024-04-21T00:21:01.789 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/406 2024-04-21T00:21:01.789 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:01.798 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:01.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:01.825 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-04-21T00:21:02.366 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:02.378 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:02.942 INFO:teuthology.orchestra.run.smithi071.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-21T00:21:02.955 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/407 2024-04-21T00:21:02.956 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/407 2024-04-21T00:21:02.956 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:02.965 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:02.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:02.996 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-04-21T00:21:03.674 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:03.686 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:03.686 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:04.297 INFO:teuthology.orchestra.run.smithi071.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-21T00:21:04.310 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/408 2024-04-21T00:21:04.310 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/408 2024-04-21T00:21:04.310 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:04.322 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:04.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:04.359 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-04-21T00:21:05.008 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:05.022 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:05.452 INFO:teuthology.orchestra.run.smithi071.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:05.463 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/409 2024-04-21T00:21:05.463 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/409 2024-04-21T00:21:05.463 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:05.472 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:05.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:05.503 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-04-21T00:21:06.031 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:06.043 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:06.474 INFO:teuthology.orchestra.run.smithi071.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:06.485 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/410 2024-04-21T00:21:06.485 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/410 2024-04-21T00:21:06.485 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:06.494 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:06.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:06.524 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-04-21T00:21:07.054 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:07.068 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:07.068 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:07.488 INFO:teuthology.orchestra.run.smithi071.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:07.497 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/411 2024-04-21T00:21:07.498 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/411 2024-04-21T00:21:07.498 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:07.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:07.532 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-04-21T00:21:08.066 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:08.080 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:08.080 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:08.478 INFO:teuthology.orchestra.run.smithi071.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/412 2024-04-21T00:21:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/412 2024-04-21T00:21:08.490 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:08.499 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:08.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:08.528 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-04-21T00:21:09.059 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:09.071 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:09.071 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:09.513 INFO:teuthology.orchestra.run.smithi071.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:09.526 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/413 2024-04-21T00:21:09.527 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/413 2024-04-21T00:21:09.527 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:09.539 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:09.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:09.570 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-04-21T00:21:10.113 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:10.126 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:10.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:10.527 INFO:teuthology.orchestra.run.smithi071.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:10.539 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/414 2024-04-21T00:21:10.539 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/414 2024-04-21T00:21:10.539 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:10.548 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:10.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:10.575 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-04-21T00:21:11.132 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:11.148 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:11.148 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:11.602 INFO:teuthology.orchestra.run.smithi071.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:11.612 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/415 2024-04-21T00:21:11.613 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/415 2024-04-21T00:21:11.613 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:11.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:11.649 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-04-21T00:21:12.198 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:12.212 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:12.709 INFO:teuthology.orchestra.run.smithi071.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:12.720 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/416 2024-04-21T00:21:12.720 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/416 2024-04-21T00:21:12.720 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:12.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:12.756 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-04-21T00:21:13.305 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:13.318 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:13.318 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:13.733 INFO:teuthology.orchestra.run.smithi071.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:13.747 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/417 2024-04-21T00:21:13.748 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/417 2024-04-21T00:21:13.748 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:13.757 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:13.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:13.787 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-04-21T00:21:14.314 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:14.327 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:14.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:14.914 INFO:teuthology.orchestra.run.smithi071.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2024-04-21T00:21:14.925 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/418 2024-04-21T00:21:14.925 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/418 2024-04-21T00:21:14.925 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:14.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:14.964 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-04-21T00:21:15.531 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:15.544 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:16.059 INFO:teuthology.orchestra.run.smithi071.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:16.075 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/419 2024-04-21T00:21:16.075 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/419 2024-04-21T00:21:16.075 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:16.085 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:16.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:16.120 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-04-21T00:21:16.652 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:16.665 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:16.666 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:20.942 INFO:teuthology.orchestra.run.smithi071.stdout:generic/420 4s 2024-04-21T00:21:20.960 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/420 2024-04-21T00:21:20.960 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:20.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:20.999 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-04-21T00:21:21.389 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:21:21.395 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:21:21.675 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:21.685 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:22.179 INFO:teuthology.orchestra.run.smithi071.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:22.190 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/421 2024-04-21T00:21:22.190 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/421 2024-04-21T00:21:22.190 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:22.200 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:22.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:22.228 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-04-21T00:21:22.779 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:22.792 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:23.226 INFO:teuthology.orchestra.run.smithi071.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:23.244 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/422 2024-04-21T00:21:23.244 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/422 2024-04-21T00:21:23.244 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:23.245 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:23.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:23.270 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-04-21T00:21:23.795 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:23.809 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:23.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:24.664 INFO:teuthology.orchestra.run.smithi071.stdout:generic/423 1s 2024-04-21T00:21:24.681 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/423 2024-04-21T00:21:24.682 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:24.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:24.720 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-04-21T00:21:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:25.406 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:25.857 INFO:teuthology.orchestra.run.smithi071.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-04-21T00:21:25.870 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/424 2024-04-21T00:21:25.870 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/424 2024-04-21T00:21:25.870 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:25.881 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:25.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:25.910 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-04-21T00:21:26.464 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:26.478 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:26.478 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:26.858 INFO:teuthology.orchestra.run.smithi071.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:21:26.869 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/425 2024-04-21T00:21:26.869 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/425 2024-04-21T00:21:26.869 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:21:26.878 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:26.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:21:26.909 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-04-21T00:21:27.470 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:21:27.483 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:21:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:21:51.550 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:21:51.560 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:22:22.414 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:22:22.424 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:22:53.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:22:53.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:22:54.370 INFO:teuthology.orchestra.run.smithi071.stdout:generic/426 87s 2024-04-21T00:22:54.644 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/426 2024-04-21T00:22:54.644 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:22:54.657 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:22:54.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:22:54.721 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-04-21T00:22:55.862 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:22:55.874 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:22:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:22:56.354 INFO:teuthology.orchestra.run.smithi071.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:22:56.367 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/427 2024-04-21T00:22:56.367 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/427 2024-04-21T00:22:56.367 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:22:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:22:56.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:22:56.411 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-04-21T00:22:56.975 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:22:56.992 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:22:56.992 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:22:57.577 INFO:teuthology.orchestra.run.smithi071.stdout:generic/428 0s 2024-04-21T00:22:57.595 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/428 2024-04-21T00:22:57.595 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:22:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:22:57.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:22:57.634 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-04-21T00:22:58.186 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:22:58.200 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:22:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:22:58.725 INFO:teuthology.orchestra.run.smithi071.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:22:58.733 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/429 2024-04-21T00:22:58.733 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/429 2024-04-21T00:22:58.733 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:22:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:22:58.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:22:58.770 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-04-21T00:22:59.323 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:22:59.335 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:22:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:00.219 INFO:teuthology.orchestra.run.smithi071.stdout:generic/430 1s 2024-04-21T00:23:00.233 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/430 2024-04-21T00:23:00.233 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:23:00.241 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:00.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:23:00.274 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-04-21T00:23:00.948 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:23:00.960 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:23:00.961 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:01.803 INFO:teuthology.orchestra.run.smithi071.stdout:generic/431 1s 2024-04-21T00:23:01.832 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/431 2024-04-21T00:23:01.832 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:23:01.841 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:01.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:23:01.878 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-04-21T00:23:02.577 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:23:02.592 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:23:02.592 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:03.513 INFO:teuthology.orchestra.run.smithi071.stdout:generic/432 1s 2024-04-21T00:23:03.532 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/432 2024-04-21T00:23:03.532 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:23:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:03.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:23:03.573 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-04-21T00:23:04.245 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:23:04.258 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:23:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:04.976 INFO:teuthology.orchestra.run.smithi071.stdout:generic/433 0s 2024-04-21T00:23:04.992 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/433 2024-04-21T00:23:04.992 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:23:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:05.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:23:05.025 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-04-21T00:23:05.698 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:23:05.710 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:23:05.711 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:06.463 INFO:teuthology.orchestra.run.smithi071.stdout:generic/434 - output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/434.out.bad) 2024-04-21T00:23:06.471 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/434.out 2024-04-20 21:21:29.670924880 +0000 2024-04-21T00:23:06.471 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/434.out.bad 2024-04-21 00:23:06.460916265 +0000 2024-04-21T00:23:06.471 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -9,6 +9,6 @@ 2024-04-21T00:23:06.471 INFO:teuthology.orchestra.run.smithi071.stdout: copy_range: Bad file descriptor 2024-04-21T00:23:06.471 INFO:teuthology.orchestra.run.smithi071.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2024-04-21T00:23:06.471 INFO:teuthology.orchestra.run.smithi071.stdout: Try to copy to a device 2024-04-21T00:23:06.471 INFO:teuthology.orchestra.run.smithi071.stdout: -copy_range: Invalid argument 2024-04-21T00:23:06.472 INFO:teuthology.orchestra.run.smithi071.stdout: +/tmp/tmp.8yh8DCdvNntest/test-434/dev1: Permission denied 2024-04-21T00:23:06.472 INFO:teuthology.orchestra.run.smithi071.stdout: Try to copy to a fifo 2024-04-21T00:23:06.472 INFO:teuthology.orchestra.run.smithi071.stdout: copy_range: Invalid argument 2024-04-21T00:23:06.479 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/434 2024-04-21T00:23:06.479 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/434 2024-04-21T00:23:06.479 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-21T00:23:06.489 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:06.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T00:23:06.523 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-21T00:23:06.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-21T00:23:06.523 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-04-21T00:23:07.194 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:23:07.205 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:23:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:07.704 INFO:teuthology.orchestra.run.smithi071.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:23:07.715 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/435 2024-04-21T00:23:07.715 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/435 2024-04-21T00:23:07.715 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:23:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:07.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:23:07.752 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-04-21T00:23:08.279 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:23:08.292 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:23:08.292 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:10.893 INFO:teuthology.orchestra.run.smithi071.stdout:generic/436 2s 2024-04-21T00:23:10.910 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/436 2024-04-21T00:23:10.910 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:23:10.919 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:10.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:23:10.951 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-04-21T00:23:11.621 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:23:11.633 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:23:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:13.004 INFO:teuthology.orchestra.run.smithi071.stdout:generic/437 1s 2024-04-21T00:23:13.021 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/437 2024-04-21T00:23:13.021 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:23:13.032 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:13.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:23:13.061 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-04-21T00:23:13.583 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:23:13.595 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:23:13.595 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:23:24.618 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:23:24.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:23:54.767 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:23:54.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:24:24.904 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:24:24.913 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:24:55.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:24:55.059 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:25:25.330 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:25:25.337 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:25:55.467 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:25:55.473 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:26:25.600 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:26:25.606 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:26:55.749 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:26:55.759 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:27:25.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:27:25.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:27:41.423 INFO:teuthology.orchestra.run.smithi071.stdout:generic/438 268s 2024-04-21T00:27:41.441 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/438 2024-04-21T00:27:41.441 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:41.451 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:41.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:41.484 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-04-21T00:27:42.012 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:42.025 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:42.427 INFO:teuthology.orchestra.run.smithi071.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:27:42.441 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/439 2024-04-21T00:27:42.441 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/439 2024-04-21T00:27:42.441 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:42.453 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:42.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:42.485 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-04-21T00:27:43.030 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:43.045 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:43.045 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:43.531 INFO:teuthology.orchestra.run.smithi071.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:27:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/440 2024-04-21T00:27:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/440 2024-04-21T00:27:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:43.555 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:43.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:43.589 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-04-21T00:27:44.162 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:44.178 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:44.178 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:44.722 INFO:teuthology.orchestra.run.smithi071.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:27:44.737 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/441 2024-04-21T00:27:44.737 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/441 2024-04-21T00:27:44.737 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:44.749 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:44.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:44.781 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-04-21T00:27:45.326 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:45.339 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:45.339 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:45.798 INFO:teuthology.orchestra.run.smithi071.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:27:45.809 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/442 2024-04-21T00:27:45.809 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/442 2024-04-21T00:27:45.809 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:45.819 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:45.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:45.847 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-04-21T00:27:46.383 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:46.395 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:46.395 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:46.914 INFO:teuthology.orchestra.run.smithi071.stdout:generic/443 0s 2024-04-21T00:27:46.935 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/443 2024-04-21T00:27:46.935 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:46.946 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:46.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:46.979 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-04-21T00:27:47.527 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:47.540 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:47.540 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:48.098 INFO:teuthology.orchestra.run.smithi071.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-21T00:27:48.111 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/444 2024-04-21T00:27:48.111 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/444 2024-04-21T00:27:48.111 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:48.120 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:48.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:48.151 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-04-21T00:27:48.666 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:48.678 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:48.678 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:51.218 INFO:teuthology.orchestra.run.smithi071.stdout:generic/445 3s 2024-04-21T00:27:51.236 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/445 2024-04-21T00:27:51.236 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:51.245 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:51.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:51.275 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-04-21T00:27:51.952 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:51.965 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:51.965 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:52.409 INFO:teuthology.orchestra.run.smithi071.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:27:52.420 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/446 2024-04-21T00:27:52.420 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/446 2024-04-21T00:27:52.420 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:52.429 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:52.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:52.458 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-04-21T00:27:52.994 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:53.006 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:53.429 INFO:teuthology.orchestra.run.smithi071.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:27:53.442 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/447 2024-04-21T00:27:53.442 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/447 2024-04-21T00:27:53.443 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:53.454 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:53.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:53.486 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-04-21T00:27:54.025 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:54.039 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:56.038 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:27:56.048 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:27:56.527 INFO:teuthology.orchestra.run.smithi071.stdout:generic/448 2s 2024-04-21T00:27:56.545 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/448 2024-04-21T00:27:56.546 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:56.554 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:56.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:56.602 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-04-21T00:27:57.270 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:57.281 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:57.281 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:57.714 INFO:teuthology.orchestra.run.smithi071.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:27:57.725 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/449 2024-04-21T00:27:57.726 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/449 2024-04-21T00:27:57.726 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:27:57.734 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:27:57.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:27:57.765 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-04-21T00:27:58.296 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:27:58.308 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:27:58.308 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:02.035 INFO:teuthology.orchestra.run.smithi071.stdout:generic/450 4s 2024-04-21T00:28:02.053 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/450 2024-04-21T00:28:02.053 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:02.062 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:02.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:02.104 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-04-21T00:28:02.760 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:02.770 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:02.771 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:03.575 INFO:teuthology.orchestra.run.smithi071.stdout:generic/451 - output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/451.out.bad) 2024-04-21T00:28:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/451.out 2024-04-20 21:21:29.672924844 +0000 2024-04-21T00:28:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/451.out.bad 2024-04-21 00:28:03.572845761 +0000 2024-04-21T00:28:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -1,2 +1,5 @@ 2024-04-21T00:28:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: QA output created by 451 2024-04-21T00:28:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: +get stale data from buffer read 2024-04-21T00:28:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2024-04-21T00:28:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: +000a0000 2024-04-21T00:28:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: Silence is golden 2024-04-21T00:28:03.587 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/451 2024-04-21T00:28:03.587 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/451 2024-04-21T00:28:03.587 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-21T00:28:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:03.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T00:28:03.617 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-21T00:28:03.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-21T00:28:03.617 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-04-21T00:28:04.344 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:04.367 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:04.368 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:04.667 INFO:teuthology.orchestra.run.smithi071.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:04.677 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/452 2024-04-21T00:28:04.677 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/452 2024-04-21T00:28:04.677 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:04.686 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:04.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:04.714 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-04-21T00:28:05.240 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:05.253 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:05.752 INFO:teuthology.orchestra.run.smithi071.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:05.763 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/453 2024-04-21T00:28:05.763 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/453 2024-04-21T00:28:05.764 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:05.772 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:05.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:05.801 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-04-21T00:28:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:06.334 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:06.729 INFO:teuthology.orchestra.run.smithi071.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:06.741 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/454 2024-04-21T00:28:06.741 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/454 2024-04-21T00:28:06.741 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:06.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:06.785 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-04-21T00:28:07.308 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:07.321 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:07.321 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:07.926 INFO:teuthology.orchestra.run.smithi071.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:07.937 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/455 2024-04-21T00:28:07.937 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/455 2024-04-21T00:28:07.937 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:07.945 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:07.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:07.973 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-04-21T00:28:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:08.511 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:08.956 INFO:teuthology.orchestra.run.smithi071.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:08.970 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/456 2024-04-21T00:28:08.970 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/456 2024-04-21T00:28:08.970 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:08.981 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:09.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:09.013 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-04-21T00:28:09.569 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:09.584 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:10.164 INFO:teuthology.orchestra.run.smithi071.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:10.175 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/457 2024-04-21T00:28:10.175 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/457 2024-04-21T00:28:10.175 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:10.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:10.213 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-04-21T00:28:10.786 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:10.800 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:11.257 INFO:teuthology.orchestra.run.smithi071.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:11.273 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/458 2024-04-21T00:28:11.273 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/458 2024-04-21T00:28:11.273 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:11.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:11.322 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-04-21T00:28:11.850 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:11.861 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:12.474 INFO:teuthology.orchestra.run.smithi071.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:12.490 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/459 2024-04-21T00:28:12.490 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/459 2024-04-21T00:28:12.490 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:12.502 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:12.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:12.533 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-04-21T00:28:13.080 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:13.093 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:13.093 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:13.523 INFO:teuthology.orchestra.run.smithi071.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:13.536 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/460 2024-04-21T00:28:13.536 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/460 2024-04-21T00:28:13.536 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:13.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:13.576 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-04-21T00:28:14.110 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:14.121 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:14.527 INFO:teuthology.orchestra.run.smithi071.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:14.538 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/461 2024-04-21T00:28:14.538 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/461 2024-04-21T00:28:14.538 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:14.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:14.572 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-04-21T00:28:15.127 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:15.141 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:15.142 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:15.591 INFO:teuthology.orchestra.run.smithi071.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:15.601 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/462 2024-04-21T00:28:15.602 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/462 2024-04-21T00:28:15.602 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:15.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:15.638 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-04-21T00:28:16.161 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:16.174 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:16.769 INFO:teuthology.orchestra.run.smithi071.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-21T00:28:16.780 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/463 2024-04-21T00:28:16.780 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/463 2024-04-21T00:28:16.780 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:16.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:16.821 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-04-21T00:28:17.491 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:17.503 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:17.904 INFO:teuthology.orchestra.run.smithi071.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:17.916 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/464 2024-04-21T00:28:17.916 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/464 2024-04-21T00:28:17.916 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:17.924 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:17.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:17.950 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-04-21T00:28:18.499 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:18.511 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:26.235 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:28:26.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:28:48.210 INFO:teuthology.orchestra.run.smithi071.stdout:generic/465 30s 2024-04-21T00:28:48.253 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/465 2024-04-21T00:28:48.253 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:48.274 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:48.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:48.322 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-04-21T00:28:48.913 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:48.926 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:48.926 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:49.309 INFO:teuthology.orchestra.run.smithi071.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:28:49.321 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/466 2024-04-21T00:28:49.321 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/466 2024-04-21T00:28:49.321 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:28:49.329 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:49.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:28:49.357 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-04-21T00:28:49.919 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:28:49.932 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:28:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:56.374 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:28:56.383 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:28:58.305 INFO:teuthology.orchestra.run.smithi071.stdout:generic/467 - output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/467.out.bad) 2024-04-21T00:28:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/467.out 2024-04-20 21:21:29.675924792 +0000 2024-04-21T00:28:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/467.out.bad 2024-04-21 00:28:58.267906300 +0000 2024-04-21T00:28:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -1,5 +1,15 @@ 2024-04-21T00:28:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: QA output created by 467 2024-04-21T00:28:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: test_file_handles TEST_DIR/467-dir -dp 2024-04-21T00:28:58.326 INFO:teuthology.orchestra.run.smithi071.stdout: +open_by_handle(/tmp/tmp.8yh8DCdvNntest/467-dir/file000000) opened an unlinked file! 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: +open_by_handle(/tmp/tmp.8yh8DCdvNntest/467-dir/file000001) opened an unlinked file! 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: +open_by_handle(/tmp/tmp.8yh8DCdvNntest/467-dir/file000002) opened an unlinked file! 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: +open_by_handle(/tmp/tmp.8yh8DCdvNntest/467-dir/file000003) opened an unlinked file! 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: +open_by_handle(/tmp/tmp.8yh8DCdvNntest/467-dir/file000004) opened an unlinked file! 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: +open_by_handle(/tmp/tmp.8yh8DCdvNntest/467-dir/file000005) opened an unlinked file! 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: +open_by_handle(/tmp/tmp.8yh8DCdvNntest/467-dir/file000006) opened an unlinked file! 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: +open_by_handle(/tmp/tmp.8yh8DCdvNntest/467-dir/file000007) opened an unlinked file! 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: +open_by_handle(/tmp/tmp.8yh8DCdvNntest/467-dir/file000008) opened an unlinked file! 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: +open_by_handle(/tmp/tmp.8yh8DCdvNntest/467-dir/file000009) opened an unlinked file! 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: test_file_handles TEST_DIR/467-dir -rp 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: test_file_handles TEST_DIR/467-dir -dkr 2024-04-21T00:28:58.327 INFO:teuthology.orchestra.run.smithi071.stdout: test_file_handles TEST_DIR/467-dir -lr 2024-04-21T00:28:58.352 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/467 2024-04-21T00:28:58.352 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/467 2024-04-21T00:28:58.352 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-21T00:28:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:28:58.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T00:28:58.490 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-21T00:28:58.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-21T00:28:58.490 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-04-21T00:29:00.032 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:29:00.046 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:29:00.046 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:29:00.524 INFO:teuthology.orchestra.run.smithi071.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:29:00.535 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/468 2024-04-21T00:29:00.535 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/468 2024-04-21T00:29:00.535 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:29:00.544 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:29:00.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:29:00.574 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-04-21T00:29:01.089 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:29:01.103 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:29:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:29:06.254 INFO:teuthology.orchestra.run.smithi071.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-21T00:29:06.267 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/469 2024-04-21T00:29:06.267 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/469 2024-04-21T00:29:06.267 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:29:06.276 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:29:06.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:29:06.308 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-04-21T00:29:06.981 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:29:06.993 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:29:06.994 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:29:07.497 INFO:teuthology.orchestra.run.smithi071.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:29:07.512 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/470 2024-04-21T00:29:07.512 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/470 2024-04-21T00:29:07.512 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:29:07.523 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:29:07.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:29:07.553 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-04-21T00:29:08.084 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:29:08.096 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:29:08.097 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:29:28.220 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:29:28.229 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:29:28.400 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-21T00:29:28.401+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35376) UID: 0 2024-04-21T00:29:28.400 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-21T00:29:28.401+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35376) UID: 0 2024-04-21T00:31:30.877 INFO:teuthology.orchestra.run.smithi071.stdout:generic/471 142s 2024-04-21T00:31:30.899 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/471 2024-04-21T00:31:30.900 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:31:30.911 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:30.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:31:30.947 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-04-21T00:31:31.768 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:31:31.789 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:31:31.789 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:32.192 INFO:teuthology.orchestra.run.smithi071.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:31:32.203 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/472 2024-04-21T00:31:32.203 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/472 2024-04-21T00:31:32.203 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:31:32.211 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:32.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:31:32.236 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-04-21T00:31:32.733 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:31:32.745 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:31:32.745 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:33.299 INFO:teuthology.orchestra.run.smithi071.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-21T00:31:33.310 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/473 2024-04-21T00:31:33.311 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/473 2024-04-21T00:31:33.311 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:31:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:33.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:31:33.349 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-04-21T00:31:33.872 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:31:33.885 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:31:33.885 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:34.321 INFO:teuthology.orchestra.run.smithi071.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:31:34.335 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/474 2024-04-21T00:31:34.335 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/474 2024-04-21T00:31:34.335 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:31:34.348 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:34.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:31:34.383 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-04-21T00:31:34.914 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:31:34.929 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:31:34.930 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:35.477 INFO:teuthology.orchestra.run.smithi071.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:31:35.489 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/475 2024-04-21T00:31:35.489 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/475 2024-04-21T00:31:35.489 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:31:35.498 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:35.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:31:35.528 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-04-21T00:31:36.079 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:31:36.092 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:31:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:36.833 INFO:teuthology.orchestra.run.smithi071.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:31:36.846 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/476 2024-04-21T00:31:36.846 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/476 2024-04-21T00:31:36.846 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:31:36.853 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:36.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:31:36.883 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-04-21T00:31:37.433 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:31:37.448 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:31:37.448 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:45.647 INFO:teuthology.orchestra.run.smithi071.stdout:generic/477 8s 2024-04-21T00:31:45.749 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/477 2024-04-21T00:31:45.749 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:31:45.773 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:45.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:31:45.870 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-04-21T00:31:47.458 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:31:47.474 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:31:47.474 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:31:59.978 INFO:teuthology.orchestra.run.smithi071.stdout:generic/478 - output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/478.out.bad) 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/478.out 2024-04-20 21:21:29.677924757 +0000 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/478.out.bad 2024-04-21 00:31:59.906766153 +0000 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -10,7 +10,7 @@ 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: get wrlck 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: -lock could be placed 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: +get wrlck 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -25,7 +25,7 @@ 2024-04-21T00:31:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: get wrlck 2024-04-21T00:31:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: -lock could be placed 2024-04-21T00:31:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: +get wrlck 2024-04-21T00:31:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -37,7 +37,7 @@ 2024-04-21T00:31:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: get rdlck 2024-04-21T00:31:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: get rdlck 2024-04-21T00:31:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: -lock could be placed 2024-04-21T00:31:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: +get rdlck 2024-04-21T00:31:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: get rdlck 2024-04-21T00:31:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: get rdlck 2024-04-21T00:31:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -46,7 +46,7 @@ 2024-04-21T00:31:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: get rdlck 2024-04-21T00:31:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: get rdlck 2024-04-21T00:31:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: -lock could be placed 2024-04-21T00:31:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: +get rdlck 2024-04-21T00:31:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: lock could be placed 2024-04-21T00:31:59.998 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/478 2024-04-21T00:31:59.998 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/478 2024-04-21T00:31:59.998 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-21T00:32:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:00.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T00:32:00.041 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-21T00:32:00.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-21T00:32:00.042 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-04-21T00:32:00.618 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:00.633 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:00.633 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:01.221 INFO:teuthology.orchestra.run.smithi071.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:01.236 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/479 2024-04-21T00:32:01.237 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/479 2024-04-21T00:32:01.237 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:01.249 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:01.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:01.283 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-04-21T00:32:01.816 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:01.830 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:02.285 INFO:teuthology.orchestra.run.smithi071.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:02.296 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/480 2024-04-21T00:32:02.297 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/480 2024-04-21T00:32:02.297 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:02.304 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:02.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:02.332 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-04-21T00:32:02.883 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:02.896 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:03.384 INFO:teuthology.orchestra.run.smithi071.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:03.395 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/481 2024-04-21T00:32:03.395 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/481 2024-04-21T00:32:03.396 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:03.405 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:03.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:03.436 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-04-21T00:32:03.997 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:04.009 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:04.009 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:04.621 INFO:teuthology.orchestra.run.smithi071.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:04.633 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/482 2024-04-21T00:32:04.633 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/482 2024-04-21T00:32:04.633 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:04.642 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:04.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:04.672 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-04-21T00:32:05.219 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:05.231 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:05.231 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:05.720 INFO:teuthology.orchestra.run.smithi071.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:05.732 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/483 2024-04-21T00:32:05.733 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/483 2024-04-21T00:32:05.733 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:05.744 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:05.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:05.776 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-04-21T00:32:06.311 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:06.324 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:06.788 INFO:teuthology.orchestra.run.smithi071.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:06.802 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/484 2024-04-21T00:32:06.802 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/484 2024-04-21T00:32:06.802 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:06.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:06.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:06.845 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-04-21T00:32:07.369 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:07.382 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:07.382 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:10.704 INFO:teuthology.orchestra.run.smithi071.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-21T00:32:10.718 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/485 2024-04-21T00:32:10.718 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/485 2024-04-21T00:32:10.718 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:10.730 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:10.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:10.762 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-04-21T00:32:11.442 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:11.454 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:11.990 INFO:teuthology.orchestra.run.smithi071.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:12.004 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/486 2024-04-21T00:32:12.004 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/486 2024-04-21T00:32:12.004 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:12.015 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:12.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:12.045 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-04-21T00:32:12.571 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:12.585 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:13.046 INFO:teuthology.orchestra.run.smithi071.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:13.059 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/487 2024-04-21T00:32:13.059 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/487 2024-04-21T00:32:13.060 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:13.072 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:13.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:13.103 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-04-21T00:32:13.634 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:13.647 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:13.649 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/488 2024-04-21T00:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/488 2024-04-21T00:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:14.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:14.106 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-04-21T00:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:15.116 INFO:teuthology.orchestra.run.smithi071.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:15.130 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/489 2024-04-21T00:32:15.131 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/489 2024-04-21T00:32:15.131 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:15.142 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:15.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:15.176 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-04-21T00:32:15.716 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:15.729 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:15.729 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:18.522 INFO:teuthology.orchestra.run.smithi071.stdout:generic/490 3s 2024-04-21T00:32:18.539 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/490 2024-04-21T00:32:18.539 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:18.548 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:18.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:18.582 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-04-21T00:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:19.719 INFO:teuthology.orchestra.run.smithi071.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:19.733 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/491 2024-04-21T00:32:19.733 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/491 2024-04-21T00:32:19.733 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:19.745 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:19.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:19.776 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-04-21T00:32:20.297 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:20.310 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:20.310 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:20.721 INFO:teuthology.orchestra.run.smithi071.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:20.732 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/492 2024-04-21T00:32:20.732 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/492 2024-04-21T00:32:20.732 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:20.741 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:20.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:20.772 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-04-21T00:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:21.698 INFO:teuthology.orchestra.run.smithi071.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:21.711 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/493 2024-04-21T00:32:21.711 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/493 2024-04-21T00:32:21.711 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:21.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:21.756 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-04-21T00:32:21.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:32:21.807 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:32:22.273 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:22.711 INFO:teuthology.orchestra.run.smithi071.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:22.723 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/494 2024-04-21T00:32:22.723 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/494 2024-04-21T00:32:22.723 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:22.732 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:22.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:22.762 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-04-21T00:32:23.287 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:23.299 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:23.717 INFO:teuthology.orchestra.run.smithi071.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:23.727 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/495 2024-04-21T00:32:23.728 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/495 2024-04-21T00:32:23.728 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:23.737 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:23.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:23.765 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-04-21T00:32:24.280 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:24.293 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:24.293 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:24.716 INFO:teuthology.orchestra.run.smithi071.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:24.728 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/496 2024-04-21T00:32:24.728 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/496 2024-04-21T00:32:24.728 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:24.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:24.771 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-04-21T00:32:25.316 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:25.330 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:25.765 INFO:teuthology.orchestra.run.smithi071.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:25.779 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/497 2024-04-21T00:32:25.779 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/497 2024-04-21T00:32:25.779 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:25.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:25.820 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-04-21T00:32:26.334 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:26.347 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:26.348 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:26.774 INFO:teuthology.orchestra.run.smithi071.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:26.784 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/498 2024-04-21T00:32:26.784 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/498 2024-04-21T00:32:26.784 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:26.791 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:26.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:26.818 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-04-21T00:32:27.334 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:27.347 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:27.787 INFO:teuthology.orchestra.run.smithi071.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:27.798 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/499 2024-04-21T00:32:27.798 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/499 2024-04-21T00:32:27.798 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:27.806 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:27.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:27.836 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-04-21T00:32:28.386 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:28.400 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:28.908 INFO:teuthology.orchestra.run.smithi071.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:28.919 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/500 2024-04-21T00:32:28.919 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/500 2024-04-21T00:32:28.919 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:28.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:28.957 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-04-21T00:32:29.491 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:29.506 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:29.506 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:30.013 INFO:teuthology.orchestra.run.smithi071.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/501 2024-04-21T00:32:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/501 2024-04-21T00:32:30.028 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:30.040 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:30.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:30.071 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-04-21T00:32:30.630 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:30.643 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:30.644 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:31.115 INFO:teuthology.orchestra.run.smithi071.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:31.127 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/502 2024-04-21T00:32:31.127 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/502 2024-04-21T00:32:31.127 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:31.139 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:31.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:31.170 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-04-21T00:32:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:31.715 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:31.715 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:32.170 INFO:teuthology.orchestra.run.smithi071.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:32.180 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/503 2024-04-21T00:32:32.180 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/503 2024-04-21T00:32:32.180 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:32.188 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:32.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:32.214 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-04-21T00:32:32.746 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:32.759 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:32.759 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:33.289 INFO:teuthology.orchestra.run.smithi071.stdout:generic/504 - output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/504.out.bad) 2024-04-21T00:32:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/504.out 2024-04-20 21:21:29.681924687 +0000 2024-04-21T00:32:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/504.out.bad 2024-04-21 00:32:33.286186878 +0000 2024-04-21T00:32:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -1,2 +1,3 @@ 2024-04-21T00:32:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: QA output created by 504 2024-04-21T00:32:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: +lock info not found 2024-04-21T00:32:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: Silence is golden 2024-04-21T00:32:33.304 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/504 2024-04-21T00:32:33.304 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/504 2024-04-21T00:32:33.304 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-21T00:32:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:33.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T00:32:33.343 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-21T00:32:33.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-21T00:32:33.343 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-04-21T00:32:33.874 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:33.888 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:34.324 INFO:teuthology.orchestra.run.smithi071.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:34.339 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/505 2024-04-21T00:32:34.339 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/505 2024-04-21T00:32:34.339 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:34.352 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:34.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:34.385 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-04-21T00:32:34.905 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:34.919 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:34.919 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:35.385 INFO:teuthology.orchestra.run.smithi071.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:35.397 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/506 2024-04-21T00:32:35.397 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/506 2024-04-21T00:32:35.397 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:35.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:35.435 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-04-21T00:32:35.976 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:35.990 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:35.990 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:36.544 INFO:teuthology.orchestra.run.smithi071.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-04-21T00:32:36.557 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/507 2024-04-21T00:32:36.557 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/507 2024-04-21T00:32:36.557 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:36.568 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:36.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:36.606 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-04-21T00:32:37.156 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:37.169 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:37.578 INFO:teuthology.orchestra.run.smithi071.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2024-04-21T00:32:37.587 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/508 2024-04-21T00:32:37.588 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/508 2024-04-21T00:32:37.588 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:37.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:37.624 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-04-21T00:32:38.159 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:38.170 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:38.170 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:38.608 INFO:teuthology.orchestra.run.smithi071.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:38.623 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/509 2024-04-21T00:32:38.624 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/509 2024-04-21T00:32:38.624 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:38.635 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:38.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:38.667 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-04-21T00:32:39.209 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:39.223 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:39.223 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:39.691 INFO:teuthology.orchestra.run.smithi071.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:39.705 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/510 2024-04-21T00:32:39.705 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/510 2024-04-21T00:32:39.705 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:39.716 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:39.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:39.748 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-04-21T00:32:40.274 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:40.288 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:40.694 INFO:teuthology.orchestra.run.smithi071.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/511 2024-04-21T00:32:40.707 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/511 2024-04-21T00:32:40.707 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:40.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:40.753 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-04-21T00:32:41.271 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:41.284 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:41.718 INFO:teuthology.orchestra.run.smithi071.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:41.731 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/512 2024-04-21T00:32:41.732 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/512 2024-04-21T00:32:41.732 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:41.743 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:41.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:41.775 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-04-21T00:32:42.315 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:42.331 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:42.331 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:42.742 INFO:teuthology.orchestra.run.smithi071.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:42.757 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/513 2024-04-21T00:32:42.757 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/513 2024-04-21T00:32:42.757 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:42.768 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:42.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:42.800 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-04-21T00:32:43.360 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:43.374 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:43.375 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:43.807 INFO:teuthology.orchestra.run.smithi071.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:43.818 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/514 2024-04-21T00:32:43.818 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/514 2024-04-21T00:32:43.818 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:43.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:43.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:43.871 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-04-21T00:32:44.400 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:44.414 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:44.415 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:44.832 INFO:teuthology.orchestra.run.smithi071.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:44.845 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/515 2024-04-21T00:32:44.845 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/515 2024-04-21T00:32:44.846 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:44.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:44.888 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-04-21T00:32:45.454 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:45.467 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:46.057 INFO:teuthology.orchestra.run.smithi071.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-21T00:32:46.068 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/516 2024-04-21T00:32:46.068 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/516 2024-04-21T00:32:46.068 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:46.075 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:46.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:46.125 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-04-21T00:32:46.774 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:46.786 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:46.787 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:47.210 INFO:teuthology.orchestra.run.smithi071.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:47.220 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/517 2024-04-21T00:32:47.221 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/517 2024-04-21T00:32:47.221 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:47.229 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:47.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:47.261 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-04-21T00:32:47.781 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:47.794 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:47.794 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:48.240 INFO:teuthology.orchestra.run.smithi071.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:48.252 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/518 2024-04-21T00:32:48.252 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/518 2024-04-21T00:32:48.252 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:48.264 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:48.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:48.296 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-04-21T00:32:48.810 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:48.823 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:48.824 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:49.252 INFO:teuthology.orchestra.run.smithi071.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:49.266 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/519 2024-04-21T00:32:49.267 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/519 2024-04-21T00:32:49.267 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:49.276 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:49.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:49.308 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-04-21T00:32:49.833 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:49.847 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:49.847 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:50.334 INFO:teuthology.orchestra.run.smithi071.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T00:32:50.348 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/520 2024-04-21T00:32:50.348 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/520 2024-04-21T00:32:50.348 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T00:32:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:50.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T00:32:50.392 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-04-21T00:32:50.936 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T00:32:50.951 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T00:32:50.951 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T00:32:51.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:32:51.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:33:22.288 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:33:22.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:33:52.438 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:33:52.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:34:22.569 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:34:22.578 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:34:52.700 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:34:52.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:35:22.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:35:22.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:35:52.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:35:52.951 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:36:23.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:36:23.092 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:36:53.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:36:53.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:37:23.373 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:37:23.585 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:37:53.714 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:37:53.723 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:38:23.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:38:23.854 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:38:53.985 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:38:53.993 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:39:24.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:39:24.133 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:39:54.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:39:54.274 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:40:24.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:40:24.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:40:54.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:40:54.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:41:24.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:41:24.738 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:41:54.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:41:54.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:42:25.015 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:42:25.024 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:42:55.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:42:55.177 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:43:25.290 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:43:25.298 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:43:55.438 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:43:55.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:44:25.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:44:25.582 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:44:55.895 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:44:55.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:45:26.031 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:45:26.040 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:45:56.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:45:56.160 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:46:26.306 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:46:26.315 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:46:56.462 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:46:56.471 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:46:56.565 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T00:46:56.565+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35942) UID: 0 2024-04-21T00:46:56.565 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T00:46:56.565+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35942) UID: 0 2024-04-21T00:46:56.566 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T00:46:56.565+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35942) UID: 0 2024-04-21T00:46:56.566 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T00:46:56.565+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35942) UID: 0 2024-04-21T00:50:11.533 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:50:11.542 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:50:41.757 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:50:41.766 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:51:11.904 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:51:11.919 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:51:42.060 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:51:42.069 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:52:12.189 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:52:12.199 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:52:42.330 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:52:42.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:53:12.477 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:53:12.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:53:42.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:53:42.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:54:12.781 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:54:12.790 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:54:42.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:54:42.920 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:55:13.040 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:55:13.049 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:55:43.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:55:43.177 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:56:13.298 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:56:13.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:56:43.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:56:43.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:57:13.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:57:13.582 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:57:43.735 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:57:43.744 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:58:13.891 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:58:13.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:58:44.045 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:58:44.054 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:59:14.204 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:59:14.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:59:44.353 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T00:59:44.362 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:00:14.486 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:00:14.495 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:00:44.641 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:00:44.650 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:01:14.798 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:01:14.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:01:44.955 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:01:44.965 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:02:15.107 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:02:15.117 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:02:45.247 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:02:45.258 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:03:15.378 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:03:15.387 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:03:45.515 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:03:45.525 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:04:15.635 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:04:15.644 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:04:45.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:04:45.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:05:15.948 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:05:15.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:05:46.072 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:05:46.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:06:16.216 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:06:16.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:06:46.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:06:46.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:07:16.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:07:16.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:07:46.595 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:07:46.604 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:08:16.973 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:08:16.982 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:08:47.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:08:47.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:09:17.265 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:09:17.274 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:09:47.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:09:47.420 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:10:17.571 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:10:17.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:10:47.712 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:10:47.723 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:11:17.838 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:11:17.847 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:11:47.963 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:11:47.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:12:18.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:12:18.121 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:12:48.241 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:12:48.250 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:13:18.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:13:18.416 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:13:48.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:13:48.542 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:14:18.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:14:18.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:14:48.814 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:14:48.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:15:18.961 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:15:18.970 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:15:49.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:15:49.091 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:16:19.213 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:16:19.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:16:49.369 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:16:49.378 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:17:19.505 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:17:19.514 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:17:49.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:17:49.633 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:18:20.155 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:18:20.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:18:50.294 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:18:50.303 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:19:20.424 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:19:20.433 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:19:50.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:19:50.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:20:20.719 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:20:20.727 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:20:50.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:20:50.968 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:21:21.105 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:21:21.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:21:51.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:21:51.257 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:22:21.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:22:21.403 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:22:51.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:22:51.526 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:23:21.646 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:23:21.656 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:23:51.801 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:23:51.810 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:24:21.941 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:24:21.950 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:24:52.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:24:52.084 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:25:22.218 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:25:22.228 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:25:52.356 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:25:52.365 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:26:22.503 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:26:22.512 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:26:52.641 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:26:52.650 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:27:22.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:27:22.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:27:52.941 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:27:52.950 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:28:23.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:28:23.066 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:28:53.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:28:53.197 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:29:23.317 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:29:23.326 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:29:53.456 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:29:53.467 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:30:23.579 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:30:23.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:30:53.734 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:30:53.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:31:24.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:31:24.041 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:31:54.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:31:54.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:32:24.318 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:32:24.326 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:32:54.449 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:32:54.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:33:24.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:33:24.803 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:33:54.941 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:33:54.950 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:34:25.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:34:25.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:34:55.216 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:34:55.224 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:35:25.348 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:35:25.356 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:35:55.770 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:35:55.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:36:25.901 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:36:25.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:36:56.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:36:56.042 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:37:26.163 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:37:26.172 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:37:56.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:37:56.309 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:38:26.430 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:38:26.442 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:38:56.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:38:56.570 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:39:26.699 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:39:26.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:39:56.830 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:39:56.838 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:40:26.981 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:40:26.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:40:27.087 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T01:40:27.087+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37862) UID: 0 2024-04-21T01:40:27.087 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T01:40:27.087+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37862) UID: 0 2024-04-21T01:40:27.088 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T01:40:27.088+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37862) UID: 0 2024-04-21T01:40:27.088 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T01:40:27.087+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37862) UID: 0 2024-04-21T01:43:28.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:43:29.001 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:43:59.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:43:59.210 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:44:29.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:44:29.417 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:44:59.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:44:59.545 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:45:29.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:45:29.686 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:45:59.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:45:59.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:46:30.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:46:30.121 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:47:00.242 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:47:00.251 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:47:30.378 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:47:30.387 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:48:00.501 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:48:00.510 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:48:30.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:48:30.653 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:49:00.817 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:49:00.827 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:49:30.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:49:30.987 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:50:01.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:50:01.136 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:50:31.264 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:50:31.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:51:01.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:51:01.404 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:51:31.530 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:51:31.539 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:52:01.674 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:52:01.683 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:52:31.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:52:31.863 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:52:31.956 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T01:52:31.957+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 38222) UID: 0 2024-04-21T01:52:31.956 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T01:52:31.957+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 38222) UID: 0 2024-04-21T01:52:31.957 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T01:52:31.957+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 38222) UID: 0 2024-04-21T01:52:31.957 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T01:52:31.957+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 38222) UID: 0 2024-04-21T01:55:32.526 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:55:32.535 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:56:02.661 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:56:02.669 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:56:32.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:56:32.793 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:57:02.912 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:57:02.921 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:57:33.064 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:57:33.075 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:58:03.194 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:58:03.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:58:33.348 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:58:33.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:59:03.696 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:59:03.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:59:33.826 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T01:59:33.835 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:00:03.964 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:00:03.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:00:34.088 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:00:34.097 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:01:04.207 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:01:04.216 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:01:34.413 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:01:34.422 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:02:04.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:02:04.553 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:02:34.692 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:02:34.701 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:03:05.013 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:03:05.023 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:03:35.141 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:03:35.149 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:04:05.290 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:04:05.299 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:04:35.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:04:35.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:05:05.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:05:05.558 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:05:35.676 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:05:35.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:06:05.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:06:05.814 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:06:35.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:06:35.988 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:07:06.113 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:07:06.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:07:36.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:07:36.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:08:06.387 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:08:06.396 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:08:36.508 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:08:36.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:09:06.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:09:06.653 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:09:37.009 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:09:37.019 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:10:07.153 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:10:07.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:10:37.308 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:10:37.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:11:07.444 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:11:07.452 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:11:37.572 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:11:37.580 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:12:07.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:12:07.721 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:12:37.849 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:12:37.858 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:13:08.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:13:08.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:13:38.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:13:38.135 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:14:08.343 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:14:08.351 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:14:38.504 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:14:38.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:15:08.759 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:15:08.768 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:15:38.891 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:15:38.899 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:16:09.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:16:09.034 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:16:39.987 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:16:39.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:17:10.117 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:17:10.126 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:17:40.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:17:40.258 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:18:10.364 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:18:10.373 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:18:40.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:18:40.494 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:19:10.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:19:10.618 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:19:40.761 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:19:40.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:20:10.912 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:20:10.920 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:20:41.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:20:41.052 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:21:11.165 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:21:11.175 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:21:41.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:21:41.337 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:22:11.602 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:22:11.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:22:41.748 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:22:41.757 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:23:11.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:23:11.895 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:23:42.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:23:42.058 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:24:12.193 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:24:12.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:24:42.334 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:24:42.343 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:25:12.456 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:25:12.465 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:25:42.581 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:25:42.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:26:12.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:26:12.727 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:26:42.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:26:42.899 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:27:13.020 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:27:13.028 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:27:43.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:27:43.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:28:13.369 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:28:13.378 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:28:43.506 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:28:43.515 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:29:13.626 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:29:13.636 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:29:43.774 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:29:43.783 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:30:13.930 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:30:13.939 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:30:44.074 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:30:44.083 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:31:14.314 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:31:14.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:31:44.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:31:44.469 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:32:14.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:32:14.633 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:32:44.797 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:32:44.805 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:33:14.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:33:14.952 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:33:45.069 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:33:45.078 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:34:15.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:34:15.196 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:34:45.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:34:45.421 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:35:15.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:35:15.548 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:35:45.679 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:35:45.688 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:36:15.814 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:36:15.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:36:45.956 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:36:45.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:37:16.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:37:16.112 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:37:46.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:37:46.251 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:38:16.456 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:38:16.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:38:46.627 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:38:46.636 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:39:16.757 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:39:16.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:39:46.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:39:46.894 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:40:17.023 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:40:17.031 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:40:47.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:40:47.161 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:41:17.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:41:17.323 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:41:47.468 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:41:47.478 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:42:17.599 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:42:17.607 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:42:47.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:42:47.753 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:43:17.865 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:43:17.873 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:43:48.011 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:43:48.019 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:44:18.165 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:44:18.174 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:44:48.951 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:44:48.960 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:45:19.088 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:45:19.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:45:49.213 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:45:49.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:46:19.347 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:46:19.356 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:46:49.477 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:46:49.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:46:54.446 INFO:teuthology.orchestra.run.smithi071.stdout:generic/521 8044s 2024-04-21T02:46:54.467 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/521 2024-04-21T02:46:54.467 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T02:46:54.476 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T02:46:54.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T02:46:54.507 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-04-21T02:46:55.180 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T02:46:55.192 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T02:46:55.193 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T02:47:19.632 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:47:19.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:47:49.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:47:49.789 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:48:19.946 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:48:19.955 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:48:50.079 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:48:50.089 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:48:50.183 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T02:48:50.184+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40233) UID: 0 2024-04-21T02:48:50.184 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T02:48:50.184+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40233) UID: 0 2024-04-21T02:48:50.184 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T02:48:50.184+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40233) UID: 0 2024-04-21T02:48:50.184 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T02:48:50.184+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40233) UID: 0 2024-04-21T02:51:54.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:51:55.000 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:52:25.181 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:52:25.190 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:52:55.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:52:55.330 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:53:25.447 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:53:25.456 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:53:55.576 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:53:55.585 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:54:25.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:54:25.732 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:54:25.843 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-21T02:54:25.843+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40365) UID: 0 2024-04-21T02:54:25.843 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-21T02:54:25.843+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40365) UID: 0 2024-04-21T02:57:23.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:57:23.784 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:57:54.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:57:54.017 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:58:24.137 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:58:24.147 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:58:54.267 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:58:54.276 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:59:24.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:59:24.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:59:55.084 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T02:59:55.096 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:00:25.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:00:25.254 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:00:55.380 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:00:55.388 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:01:25.503 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:01:25.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:01:55.650 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:01:55.658 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:02:25.789 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:02:25.799 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:02:56.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:02:56.138 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:03:26.284 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:03:26.293 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:03:56.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:03:56.420 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:04:26.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:04:26.551 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:04:56.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:04:56.698 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:05:26.835 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:05:26.843 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:05:56.976 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:05:56.985 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:06:27.099 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:06:27.108 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:06:57.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:06:57.262 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:07:27.383 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:07:27.393 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:07:57.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:07:57.522 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:08:27.635 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:08:27.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:08:57.768 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:08:57.776 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:09:27.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:09:27.899 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:09:58.058 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:09:58.068 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:10:28.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:10:28.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:10:58.339 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:10:58.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:11:28.452 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:11:28.461 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:11:58.579 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:11:58.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:12:28.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:12:28.717 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:12:58.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:12:58.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:13:29.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:13:29.058 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:13:59.189 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:13:59.197 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:14:29.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:14:29.309 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:14:59.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:14:59.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:15:29.605 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:15:29.614 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:15:59.755 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:15:59.763 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:16:30.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:16:30.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:17:00.298 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:17:00.310 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:17:30.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:17:30.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:18:00.564 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:18:00.573 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:18:00.672 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T03:18:00.673+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41192) UID: 0 2024-04-21T03:18:00.672 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T03:18:00.673+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41192) UID: 0 2024-04-21T03:18:00.672 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T03:18:00.673+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41192) UID: 0 2024-04-21T03:18:00.673 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T03:18:00.673+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41192) UID: 0 2024-04-21T03:21:05.977 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:21:05.986 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:21:36.107 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:21:36.117 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:22:06.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:22:06.246 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:22:36.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:22:36.377 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:23:06.500 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:23:06.508 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:23:36.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:23:36.649 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:24:06.770 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:24:06.778 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:24:36.907 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:24:36.916 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:25:07.030 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:25:07.039 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:25:37.167 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:25:37.177 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:26:07.287 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:26:07.295 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:26:37.433 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:26:37.442 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:27:07.570 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:27:07.580 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:27:37.699 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:27:37.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:28:07.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:28:07.851 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:28:37.982 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:28:37.993 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:29:08.115 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:29:08.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:29:38.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:29:38.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:30:08.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:30:08.741 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:30:38.895 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:30:38.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:31:09.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:31:09.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:31:39.457 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:31:39.465 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:32:09.578 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:32:09.598 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:32:39.719 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:32:39.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:33:09.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:33:09.868 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:33:40.073 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:33:40.082 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:34:10.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:34:10.496 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:34:40.622 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:34:40.632 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:35:10.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:35:10.752 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:35:40.884 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:35:40.894 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:36:11.005 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:36:11.014 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:36:41.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:36:41.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:37:11.316 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:37:11.324 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:37:41.608 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:37:41.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:38:11.746 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:38:11.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:38:41.875 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:38:41.884 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:39:12.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:39:12.014 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:39:42.134 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:39:42.142 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:40:12.299 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:40:12.309 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:40:42.434 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:40:42.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:41:12.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:41:12.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:41:42.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:41:42.883 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:42:12.999 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:42:13.008 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:42:43.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:42:43.187 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:43:13.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:43:13.323 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:43:43.463 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:43:43.473 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:44:13.792 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:44:13.801 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:44:43.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:44:43.933 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:45:14.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:45:14.068 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:45:44.204 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:45:44.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:46:14.324 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:46:14.334 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:46:44.462 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:46:44.471 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:47:14.591 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:47:14.600 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:47:44.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:47:44.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:48:14.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:48:14.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:48:45.020 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:48:45.029 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:49:15.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:49:15.159 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:49:45.277 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:49:45.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:50:15.409 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:50:15.418 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:50:45.550 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:50:45.559 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:51:15.676 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:51:15.686 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:51:45.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:51:45.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:52:15.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:52:15.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:52:46.101 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:52:46.109 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:53:16.231 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:53:16.240 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:53:46.404 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:53:46.414 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:54:16.533 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:54:16.543 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:54:46.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:54:46.681 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:55:16.802 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:55:16.810 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:55:46.932 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:55:46.941 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:56:17.106 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:56:17.116 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:56:47.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:56:47.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:57:17.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:57:17.376 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:57:47.496 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:57:47.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:58:17.644 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:58:17.652 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:58:47.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:58:47.934 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:59:18.069 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:59:18.078 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:59:48.208 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T03:59:48.217 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:00:18.331 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:00:18.340 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:00:48.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:00:48.470 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:01:18.591 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:01:18.601 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:01:48.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:01:48.732 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:02:18.844 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:02:18.852 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:02:48.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:02:48.992 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:03:19.138 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:03:19.147 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:03:49.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:03:49.276 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:04:19.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:04:19.406 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:04:49.659 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:04:49.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:05:19.779 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:05:19.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:05:49.918 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:05:49.927 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:06:20.039 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:06:20.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:06:50.175 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:06:50.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:07:20.339 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:07:20.348 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:07:50.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:07:50.474 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:08:20.746 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:08:20.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:08:50.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:08:50.890 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:09:21.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:09:21.030 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:09:51.143 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:09:51.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:10:21.271 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:10:21.280 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:10:51.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:10:51.421 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:11:21.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:11:21.551 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:11:52.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:11:52.440 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:12:22.569 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:12:22.577 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:12:52.700 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:12:52.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:13:22.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:13:22.829 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:13:52.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:13:52.963 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:14:23.083 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:14:23.091 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:14:53.213 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:14:53.223 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:15:23.334 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:15:23.344 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:15:53.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:15:53.508 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:16:23.631 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:16:23.639 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:16:53.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:16:53.767 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:17:23.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:17:23.889 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:17:54.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:17:54.017 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:18:24.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:18:24.143 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:18:54.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:18:54.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:19:24.730 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:19:24.738 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:19:54.900 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:19:54.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:20:25.031 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:20:25.039 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:20:55.162 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:20:55.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:21:25.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:21:25.301 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:21:55.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:21:55.431 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:22:25.578 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:22:25.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:22:55.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:22:55.724 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:23:25.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:23:25.852 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:23:55.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:23:55.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:24:26.558 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:24:26.567 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:24:30.916 INFO:teuthology.orchestra.run.smithi071.stdout:generic/522 5855s 2024-04-21T04:24:30.970 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/522 2024-04-21T04:24:30.970 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:30.979 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:31.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:31.013 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-04-21T04:24:31.749 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:31.764 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:31.764 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:32.351 INFO:teuthology.orchestra.run.smithi071.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T04:24:32.366 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/523 2024-04-21T04:24:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/523 2024-04-21T04:24:32.367 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:32.378 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:32.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:32.410 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-04-21T04:24:32.938 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:32.952 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:32.952 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T04:24:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/524 2024-04-21T04:24:33.389 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/524 2024-04-21T04:24:33.390 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:33.400 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:33.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:33.434 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-04-21T04:24:33.961 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:33.975 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:34.390 INFO:teuthology.orchestra.run.smithi071.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T04:24:34.401 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/525 2024-04-21T04:24:34.401 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/525 2024-04-21T04:24:34.401 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:34.409 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:34.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:34.438 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-04-21T04:24:34.976 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:34.990 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:34.990 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:35.495 INFO:teuthology.orchestra.run.smithi071.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T04:24:35.509 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/526 2024-04-21T04:24:35.509 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/526 2024-04-21T04:24:35.510 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:35.522 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:35.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:35.553 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-04-21T04:24:36.088 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:36.103 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:36.584 INFO:teuthology.orchestra.run.smithi071.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T04:24:36.597 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/527 2024-04-21T04:24:36.597 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/527 2024-04-21T04:24:36.597 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:36.608 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:36.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:36.643 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-04-21T04:24:37.184 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:37.196 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:37.196 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:37.741 INFO:teuthology.orchestra.run.smithi071.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2024-04-21T04:24:37.757 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/528 2024-04-21T04:24:37.757 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/528 2024-04-21T04:24:37.758 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:37.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:37.802 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-04-21T04:24:38.370 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:38.383 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:38.908 INFO:teuthology.orchestra.run.smithi071.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-21T04:24:38.919 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/529 2024-04-21T04:24:38.919 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/529 2024-04-21T04:24:38.919 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:38.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:38.959 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-04-21T04:24:39.506 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:39.520 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:39.942 INFO:teuthology.orchestra.run.smithi071.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T04:24:39.953 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/530 2024-04-21T04:24:39.953 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/530 2024-04-21T04:24:39.953 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:39.962 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:39.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:39.990 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-04-21T04:24:40.546 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:40.559 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:40.559 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:40.959 INFO:teuthology.orchestra.run.smithi071.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T04:24:40.969 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/531 2024-04-21T04:24:40.969 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/531 2024-04-21T04:24:40.970 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:40.977 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:41.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:41.006 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-04-21T04:24:41.522 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:41.535 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:41.535 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:42.086 INFO:teuthology.orchestra.run.smithi071.stdout:generic/532 1s 2024-04-21T04:24:42.103 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/532 2024-04-21T04:24:42.103 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:42.112 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:42.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:42.144 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-04-21T04:24:42.677 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:42.690 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:43.739 INFO:teuthology.orchestra.run.smithi071.stdout:generic/533 1s 2024-04-21T04:24:43.755 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/533 2024-04-21T04:24:43.755 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:43.762 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:43.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:43.785 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-04-21T04:24:44.326 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:44.339 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:44.339 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:44.779 INFO:teuthology.orchestra.run.smithi071.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T04:24:44.791 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/534 2024-04-21T04:24:44.791 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/534 2024-04-21T04:24:44.791 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:44.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:44.831 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-04-21T04:24:45.362 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:45.377 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:45.795 INFO:teuthology.orchestra.run.smithi071.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T04:24:45.808 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/535 2024-04-21T04:24:45.809 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/535 2024-04-21T04:24:45.809 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:45.820 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:45.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:45.850 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-04-21T04:24:46.367 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:46.380 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:46.380 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:46.788 INFO:teuthology.orchestra.run.smithi071.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T04:24:46.802 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/536 2024-04-21T04:24:46.802 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/536 2024-04-21T04:24:46.802 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:46.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:46.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:46.846 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-04-21T04:24:47.388 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:47.402 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:47.818 INFO:teuthology.orchestra.run.smithi071.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T04:24:47.831 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/537 2024-04-21T04:24:47.832 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/537 2024-04-21T04:24:47.832 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T04:24:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:47.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T04:24:47.877 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-04-21T04:24:48.396 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T04:24:48.407 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T04:24:48.408 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T04:24:56.679 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:24:56.688 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:25:26.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:25:26.889 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:25:57.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:25:57.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:26:27.289 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:26:27.298 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:26:57.425 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:26:57.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:27:27.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:27:27.583 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:27:57.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:27:57.747 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:28:27.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:28:27.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:28:58.092 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:28:58.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:29:28.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:29:28.247 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:29:58.433 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:29:58.442 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:30:28.564 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:30:28.573 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:30:58.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:30:58.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:31:29.133 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:31:29.142 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:31:59.278 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:31:59.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:32:29.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:32:29.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:32:59.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:32:59.575 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:33:29.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:33:29.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:33:29.859 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T04:33:29.859+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43929) UID: 0 2024-04-21T04:33:29.859 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T04:33:29.859+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43929) UID: 0 2024-04-21T04:33:29.859 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T04:33:29.859+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43929) UID: 0 2024-04-21T04:33:29.860 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T04:33:29.859+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43929) UID: 0 2024-04-21T04:36:45.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:36:45.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:37:15.625 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:37:15.634 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:37:45.762 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:37:45.771 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:38:16.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:38:16.236 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:38:46.370 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:38:46.379 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:39:16.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:39:16.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:39:46.668 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:39:46.676 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:40:16.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:40:16.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:40:47.114 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:40:47.122 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:41:17.239 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:41:17.250 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:41:47.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:41:47.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:42:17.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:42:17.506 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:42:47.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:42:47.667 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:43:17.823 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:43:17.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:43:47.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:43:47.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:44:18.080 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:44:18.089 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:44:48.253 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:44:48.262 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:45:18.384 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:45:18.392 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:45:48.550 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:45:48.559 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:46:18.705 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:46:18.717 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:46:48.826 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:46:48.834 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:47:18.945 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:47:18.957 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:47:49.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:47:49.095 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:48:19.251 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:48:19.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:48:49.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:48:49.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:49:19.569 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:49:19.577 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:49:49.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:49:49.717 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:50:19.830 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:50:19.841 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:50:50.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:50:50.557 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:51:20.741 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:51:20.750 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:51:20.873 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T04:51:20.873+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 425430) UID: 0 2024-04-21T04:51:20.873 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T04:51:20.873+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 425430) UID: 0 2024-04-21T04:51:20.873 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T04:51:20.873+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 425430) UID: 0 2024-04-21T04:51:20.873 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T04:51:20.873+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 425430) UID: 0 2024-04-21T04:54:28.298 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:54:28.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:54:28.407 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T04:54:28.407+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44516) UID: 0 2024-04-21T04:54:28.407 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T04:54:28.407+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44516) UID: 0 2024-04-21T04:54:28.408 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T04:54:28.407+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44516) UID: 0 2024-04-21T04:54:28.408 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T04:54:28.407+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44516) UID: 0 2024-04-21T04:57:22.398 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:57:22.414 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:57:52.607 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:57:52.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:58:22.742 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:58:22.751 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:58:52.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:58:52.879 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:59:23.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:59:23.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:59:53.189 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T04:59:53.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:00:23.310 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:00:23.323 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:00:53.455 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:00:53.466 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:01:23.606 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:01:23.615 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:01:53.754 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:01:53.763 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:02:23.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:02:23.908 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:02:54.030 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:02:54.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:03:24.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:03:24.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:03:54.414 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:03:54.423 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:04:24.813 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:04:24.822 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:04:54.936 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:04:54.945 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:05:25.090 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:05:25.099 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:05:55.244 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:05:55.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:06:25.380 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:06:25.390 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:06:55.615 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:06:55.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:07:25.752 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:07:25.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:07:55.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:07:55.892 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:08:26.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:08:26.021 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:08:56.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:08:56.185 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:09:26.316 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:09:26.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:09:56.446 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:09:56.454 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:09:56.544 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T05:09:56.544+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 427060) UID: 0 2024-04-21T05:09:56.544 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T05:09:56.544+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 427060) UID: 0 2024-04-21T05:09:56.545 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T05:09:56.544+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 427060) UID: 0 2024-04-21T05:09:56.545 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T05:09:56.544+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 427060) UID: 0 2024-04-21T05:12:58.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:12:58.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:12:58.830 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T05:12:58.830+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 427288) UID: 0 2024-04-21T05:12:58.830 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T05:12:58.830+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 427288) UID: 0 2024-04-21T05:12:58.830 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T05:12:58.830+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 427288) UID: 0 2024-04-21T05:12:58.831 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T05:12:58.830+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 427288) UID: 0 2024-04-21T05:16:10.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:16:10.914 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:16:11.013 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T05:16:11.013+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45077) UID: 0 2024-04-21T05:16:11.013 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T05:16:11.013+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45077) UID: 0 2024-04-21T05:16:11.013 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T05:16:11.013+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45077) UID: 0 2024-04-21T05:16:11.013 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T05:16:11.013+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45077) UID: 0 2024-04-21T05:19:12.778 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:19:12.786 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:19:42.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:19:42.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:20:13.143 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:20:13.155 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:20:43.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:20:43.291 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:21:13.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:21:13.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:21:43.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:21:43.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:22:13.705 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:22:13.713 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:22:43.829 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:22:43.838 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:23:13.951 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:23:13.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:23:44.097 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:23:44.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:24:14.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:24:14.309 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:24:44.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:24:44.437 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:25:14.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:25:14.558 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:25:44.670 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:25:44.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:26:15.147 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:26:15.156 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:26:45.278 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:26:45.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:27:15.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:27:15.417 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:27:45.547 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:27:45.556 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:28:15.713 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:28:15.723 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:28:45.859 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:28:45.869 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:29:15.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:29:16.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:29:46.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:29:46.128 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:30:16.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:30:16.259 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:30:46.379 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:30:46.388 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:31:16.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:31:16.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:31:46.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:31:46.667 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:32:16.837 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:32:16.848 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:32:46.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:32:46.967 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:33:17.090 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:33:17.099 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:33:47.417 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:33:47.425 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:34:17.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:34:17.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:34:47.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:34:47.731 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:35:17.851 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:35:17.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:35:47.974 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:35:47.983 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:36:18.099 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:36:18.108 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:36:48.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:36:48.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:37:18.474 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:37:18.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:37:48.597 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:37:48.606 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:38:18.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:38:18.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:38:48.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:38:48.908 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:39:19.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:39:19.113 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:39:49.252 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:39:49.264 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:40:19.424 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:40:19.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:40:49.545 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:40:49.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:41:19.670 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:41:19.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:41:49.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:41:49.841 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:42:19.963 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:42:20.607 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:42:50.736 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:42:50.748 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:43:20.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:43:20.888 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:43:51.027 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:43:51.036 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:44:21.183 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:44:21.194 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:44:51.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:44:51.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:45:21.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:45:21.437 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:45:51.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:45:51.558 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:46:21.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:46:21.903 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:46:52.022 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:46:52.031 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:47:22.172 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:47:22.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:47:52.295 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:47:52.303 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:48:22.451 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:48:22.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:48:52.584 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:48:52.592 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:49:22.700 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:49:22.710 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:49:53.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:49:53.077 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:50:23.205 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:50:23.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:50:53.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:50:53.440 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:51:23.746 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:51:23.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:51:53.887 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:51:53.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:52:24.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:52:24.266 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:52:54.402 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:52:54.412 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:53:24.562 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:53:24.572 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:53:55.058 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:53:55.067 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:54:25.237 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:54:25.245 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:54:55.386 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:54:55.395 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:55:25.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:55:25.583 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:55:55.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:55:55.732 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:56:25.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:56:25.852 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:56:56.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:56:56.017 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:57:26.187 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:57:26.197 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:57:56.334 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:57:56.343 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:58:26.490 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:58:26.498 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:58:56.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:58:56.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:59:26.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:59:26.767 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:59:57.165 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T05:59:57.174 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:00:27.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:00:27.314 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:00:57.510 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:00:57.519 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:01:27.648 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:01:27.656 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:01:57.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:01:57.787 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:02:27.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:02:27.947 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:02:58.066 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:02:58.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:03:28.196 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:03:28.205 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:03:58.339 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:03:58.348 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:04:28.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:04:28.511 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:04:58.633 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:04:58.642 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:05:28.770 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:05:28.780 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:05:58.920 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:05:58.929 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:06:29.083 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:06:29.092 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:06:59.204 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:06:59.212 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:07:29.336 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:07:29.346 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:07:59.473 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:07:59.482 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:08:29.638 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:08:29.646 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:08:59.848 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:08:59.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:09:29.982 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:09:29.988 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:10:00.105 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:10:00.175 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:10:00.275 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T06:10:00.277+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47002) UID: 0 2024-04-21T06:10:00.276 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T06:10:00.277+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47002) UID: 0 2024-04-21T06:10:00.276 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T06:10:00.278+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47002) UID: 0 2024-04-21T06:10:00.276 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T06:10:00.278+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47002) UID: 0 2024-04-21T06:10:01.966 INFO:teuthology.orchestra.run.smithi071.stdout:generic/538 6313s 2024-04-21T06:10:01.985 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/538 2024-04-21T06:10:01.985 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:01.995 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:02.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:02.024 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-04-21T06:10:02.706 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:02.718 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:07.413 INFO:teuthology.orchestra.run.smithi071.stdout:generic/539 5s 2024-04-21T06:10:07.431 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/539 2024-04-21T06:10:07.431 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:07.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:07.474 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-04-21T06:10:08.146 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:08.157 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:08.581 INFO:teuthology.orchestra.run.smithi071.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:08.592 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/540 2024-04-21T06:10:08.592 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/540 2024-04-21T06:10:08.592 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:08.601 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:08.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:08.627 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-04-21T06:10:09.171 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:09.185 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:09.185 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:09.630 INFO:teuthology.orchestra.run.smithi071.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:09.644 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/541 2024-04-21T06:10:09.644 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/541 2024-04-21T06:10:09.644 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:09.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:09.687 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-04-21T06:10:10.254 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:10.267 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:10.267 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:10.698 INFO:teuthology.orchestra.run.smithi071.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:10.710 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/542 2024-04-21T06:10:10.710 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/542 2024-04-21T06:10:10.710 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:10.719 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:10.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:10.750 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-04-21T06:10:11.284 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:11.297 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:11.721 INFO:teuthology.orchestra.run.smithi071.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:11.733 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/543 2024-04-21T06:10:11.733 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/543 2024-04-21T06:10:11.734 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:11.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:11.776 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-04-21T06:10:12.308 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:12.323 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:12.787 INFO:teuthology.orchestra.run.smithi071.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:12.798 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/544 2024-04-21T06:10:12.798 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/544 2024-04-21T06:10:12.798 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:12.807 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:12.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:12.835 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-04-21T06:10:13.382 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:13.395 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:13.395 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:14.018 INFO:teuthology.orchestra.run.smithi071.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-04-21T06:10:14.032 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/545 2024-04-21T06:10:14.032 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/545 2024-04-21T06:10:14.032 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:14.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:14.079 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-04-21T06:10:14.646 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:14.659 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:15.249 INFO:teuthology.orchestra.run.smithi071.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:15.261 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/546 2024-04-21T06:10:15.261 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/546 2024-04-21T06:10:15.261 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:15.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:15.299 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-04-21T06:10:15.818 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:15.830 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:16.313 INFO:teuthology.orchestra.run.smithi071.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:16.326 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/547 2024-04-21T06:10:16.326 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/547 2024-04-21T06:10:16.326 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:16.338 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:16.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:16.368 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-04-21T06:10:16.909 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:16.921 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:16.921 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:17.422 INFO:teuthology.orchestra.run.smithi071.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:17.434 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/548 2024-04-21T06:10:17.434 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/548 2024-04-21T06:10:17.434 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:17.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:17.470 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-04-21T06:10:18.036 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:18.048 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:18.049 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:18.581 INFO:teuthology.orchestra.run.smithi071.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:18.591 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/549 2024-04-21T06:10:18.592 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/549 2024-04-21T06:10:18.592 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:18.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:18.631 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-04-21T06:10:19.186 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:19.200 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:19.759 INFO:teuthology.orchestra.run.smithi071.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:19.771 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/550 2024-04-21T06:10:19.771 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/550 2024-04-21T06:10:19.771 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:19.781 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:19.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:19.811 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-04-21T06:10:20.360 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:20.372 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:20.775 INFO:teuthology.orchestra.run.smithi071.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:20.786 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/551 2024-04-21T06:10:20.786 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/551 2024-04-21T06:10:20.786 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:20.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:20.824 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-04-21T06:10:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:21.387 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:21.388 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:21.839 INFO:teuthology.orchestra.run.smithi071.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:21.850 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/552 2024-04-21T06:10:21.850 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/552 2024-04-21T06:10:21.850 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:21.858 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:21.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:21.887 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-04-21T06:10:22.410 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:22.424 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:22.425 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:23.065 INFO:teuthology.orchestra.run.smithi071.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2024-04-21T06:10:23.079 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/553 2024-04-21T06:10:23.079 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/553 2024-04-21T06:10:23.079 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:23.091 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:23.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:23.124 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-04-21T06:10:23.785 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:23.798 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:23.799 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:24.202 INFO:teuthology.orchestra.run.smithi071.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:24.215 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/554 2024-04-21T06:10:24.216 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/554 2024-04-21T06:10:24.216 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:24.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:24.258 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-04-21T06:10:24.799 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:24.810 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:24.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:25.327 INFO:teuthology.orchestra.run.smithi071.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2024-04-21T06:10:25.338 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/555 2024-04-21T06:10:25.338 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/555 2024-04-21T06:10:25.339 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:25.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:25.376 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-04-21T06:10:26.030 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:26.041 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:26.041 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:26.460 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/556 2024-04-21T06:10:26.461 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/556 2024-04-21T06:10:26.461 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:26.469 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:26.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:26.496 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-04-21T06:10:27.043 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:27.056 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:27.056 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:27.512 INFO:teuthology.orchestra.run.smithi071.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:27.525 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/557 2024-04-21T06:10:27.525 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/557 2024-04-21T06:10:27.525 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:27.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:27.566 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-04-21T06:10:28.142 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:28.157 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:28.608 INFO:teuthology.orchestra.run.smithi071.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:28.620 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/558 2024-04-21T06:10:28.620 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/558 2024-04-21T06:10:28.620 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:28.629 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:28.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:28.659 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-04-21T06:10:29.216 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:29.230 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:29.230 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:29.683 INFO:teuthology.orchestra.run.smithi071.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/559 2024-04-21T06:10:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/559 2024-04-21T06:10:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:29.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:29.731 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-04-21T06:10:30.264 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:30.277 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:30.721 INFO:teuthology.orchestra.run.smithi071.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:30.733 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/560 2024-04-21T06:10:30.733 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/560 2024-04-21T06:10:30.733 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:30.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:30.772 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-04-21T06:10:31.326 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:31.341 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:31.341 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:31.745 INFO:teuthology.orchestra.run.smithi071.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/561 2024-04-21T06:10:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/561 2024-04-21T06:10:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:31.765 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:31.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:31.794 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-04-21T06:10:32.306 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:32.318 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:32.318 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:32.737 INFO:teuthology.orchestra.run.smithi071.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:32.749 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/562 2024-04-21T06:10:32.749 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/562 2024-04-21T06:10:32.749 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:32.757 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:32.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:32.783 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-04-21T06:10:33.251 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:33.773 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/563 2024-04-21T06:10:33.773 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/563 2024-04-21T06:10:33.774 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:33.786 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:33.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:33.829 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-04-21T06:10:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:34.395 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:34.395 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:35.647 INFO:teuthology.orchestra.run.smithi071.stdout:generic/564 1s 2024-04-21T06:10:35.664 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/564 2024-04-21T06:10:35.664 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:35.673 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:35.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:35.703 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-04-21T06:10:36.388 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:36.400 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:36.827 INFO:teuthology.orchestra.run.smithi071.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:36.838 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/565 2024-04-21T06:10:36.838 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/565 2024-04-21T06:10:36.838 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:36.847 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:36.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:36.877 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-04-21T06:10:37.422 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:37.435 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:37.435 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:37.840 INFO:teuthology.orchestra.run.smithi071.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:37.854 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/566 2024-04-21T06:10:37.854 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/566 2024-04-21T06:10:37.854 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:37.865 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:37.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:37.896 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-04-21T06:10:38.448 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:38.461 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:38.461 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:38.890 INFO:teuthology.orchestra.run.smithi071.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:38.902 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/567 2024-04-21T06:10:38.902 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/567 2024-04-21T06:10:38.902 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:38.912 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:38.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:38.941 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-04-21T06:10:39.492 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:39.505 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:40.130 INFO:teuthology.orchestra.run.smithi071.stdout:generic/568 1s 2024-04-21T06:10:40.184 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/568 2024-04-21T06:10:40.184 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:40.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:40.262 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-04-21T06:10:40.836 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:40.849 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:41.403 INFO:teuthology.orchestra.run.smithi071.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:41.419 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/569 2024-04-21T06:10:41.419 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/569 2024-04-21T06:10:41.419 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:41.430 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:41.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:41.466 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-04-21T06:10:41.996 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:42.009 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:42.390 INFO:teuthology.orchestra.run.smithi071.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:42.401 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/570 2024-04-21T06:10:42.401 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/570 2024-04-21T06:10:42.401 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:42.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:42.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:42.440 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-04-21T06:10:42.986 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:43.002 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:43.002 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:49.764 INFO:teuthology.orchestra.run.smithi071.stdout:generic/571 6s 2024-04-21T06:10:49.782 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/571 2024-04-21T06:10:49.782 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:49.790 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:49.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:49.819 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-04-21T06:10:50.455 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:50.465 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:50.465 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:50.874 INFO:teuthology.orchestra.run.smithi071.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:50.886 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/572 2024-04-21T06:10:50.886 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/572 2024-04-21T06:10:50.886 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:50.895 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:50.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:50.927 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-04-21T06:10:51.467 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:51.479 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:51.479 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:51.934 INFO:teuthology.orchestra.run.smithi071.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:51.948 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/573 2024-04-21T06:10:51.949 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/573 2024-04-21T06:10:51.949 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:51.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:51.995 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-04-21T06:10:52.552 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:52.566 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:52.566 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:52.974 INFO:teuthology.orchestra.run.smithi071.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:52.985 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/574 2024-04-21T06:10:52.985 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/574 2024-04-21T06:10:52.985 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:53.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:53.022 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-04-21T06:10:53.559 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:53.571 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:53.995 INFO:teuthology.orchestra.run.smithi071.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:54.005 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/575 2024-04-21T06:10:54.005 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/575 2024-04-21T06:10:54.005 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:54.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:54.044 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-04-21T06:10:54.615 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:54.628 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:54.628 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:55.195 INFO:teuthology.orchestra.run.smithi071.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:55.208 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/576 2024-04-21T06:10:55.208 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/576 2024-04-21T06:10:55.209 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:55.220 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:55.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:55.252 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-04-21T06:10:55.789 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:55.802 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:55.802 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:56.224 INFO:teuthology.orchestra.run.smithi071.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:56.235 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/577 2024-04-21T06:10:56.235 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/577 2024-04-21T06:10:56.235 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:56.244 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:56.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:56.272 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-04-21T06:10:56.803 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:56.816 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:57.314 INFO:teuthology.orchestra.run.smithi071.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-21T06:10:57.327 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/578 2024-04-21T06:10:57.327 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/578 2024-04-21T06:10:57.327 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:57.338 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:57.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:57.370 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-04-21T06:10:57.900 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:57.913 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:57.913 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:58.351 INFO:teuthology.orchestra.run.smithi071.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:58.362 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/579 2024-04-21T06:10:58.362 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/579 2024-04-21T06:10:58.362 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:58.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:58.397 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-04-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:59.452 INFO:teuthology.orchestra.run.smithi071.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:10:59.463 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/580 2024-04-21T06:10:59.464 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/580 2024-04-21T06:10:59.464 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:10:59.473 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:10:59.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:10:59.502 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-04-21T06:11:00.044 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:00.057 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:01.433 INFO:teuthology.orchestra.run.smithi071.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:11:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/581 2024-04-21T06:11:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/581 2024-04-21T06:11:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:01.460 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:01.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:01.495 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-04-21T06:11:02.009 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:02.022 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:02.022 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:02.574 INFO:teuthology.orchestra.run.smithi071.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:11:02.586 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/582 2024-04-21T06:11:02.586 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/582 2024-04-21T06:11:02.587 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:02.596 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:02.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:02.628 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-04-21T06:11:03.170 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:03.186 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:03.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:03.723 INFO:teuthology.orchestra.run.smithi071.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:11:03.737 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/583 2024-04-21T06:11:03.738 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/583 2024-04-21T06:11:03.738 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:03.749 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:03.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:03.780 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-04-21T06:11:04.323 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:04.338 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:04.338 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:04.897 INFO:teuthology.orchestra.run.smithi071.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:11:04.909 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/584 2024-04-21T06:11:04.910 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/584 2024-04-21T06:11:04.910 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:04.922 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:04.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:04.953 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-04-21T06:11:05.500 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:05.513 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:05.991 INFO:teuthology.orchestra.run.smithi071.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:11:06.005 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/585 2024-04-21T06:11:06.005 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/585 2024-04-21T06:11:06.006 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:06.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:06.049 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-04-21T06:11:06.619 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:06.631 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:50.030 INFO:teuthology.orchestra.run.smithi071.stdout:generic/586 44s 2024-04-21T06:11:50.048 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/586 2024-04-21T06:11:50.048 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:50.058 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:50.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:50.088 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-04-21T06:11:50.804 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:50.816 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:50.816 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:51.837 INFO:teuthology.orchestra.run.smithi071.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-21T06:11:51.849 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/587 2024-04-21T06:11:51.850 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/587 2024-04-21T06:11:51.850 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:51.861 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:51.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:51.891 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-04-21T06:11:52.382 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:52.394 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:52.394 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:52.887 INFO:teuthology.orchestra.run.smithi071.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:11:52.902 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/588 2024-04-21T06:11:52.902 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/588 2024-04-21T06:11:52.902 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:52.914 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:52.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:52.947 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-04-21T06:11:53.469 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:53.482 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:53.482 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:53.934 INFO:teuthology.orchestra.run.smithi071.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:11:53.946 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/589 2024-04-21T06:11:53.946 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/589 2024-04-21T06:11:53.946 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:53.958 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:53.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:53.990 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-04-21T06:11:54.527 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:54.540 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:54.540 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:54.971 INFO:teuthology.orchestra.run.smithi071.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:11:54.983 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/590 2024-04-21T06:11:54.983 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/590 2024-04-21T06:11:54.983 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:54.992 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:55.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:55.023 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-04-21T06:11:55.546 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:55.559 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:55.559 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:56.680 INFO:teuthology.orchestra.run.smithi071.stdout:generic/591 1s 2024-04-21T06:11:56.697 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/591 2024-04-21T06:11:56.697 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:56.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:56.737 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-04-21T06:11:57.428 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:57.439 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:57.440 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:57.934 INFO:teuthology.orchestra.run.smithi071.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:11:57.946 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/592 2024-04-21T06:11:57.946 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/592 2024-04-21T06:11:57.947 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:57.956 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:57.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:57.987 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-04-21T06:11:58.517 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/593 2024-04-21T06:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/593 2024-04-21T06:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:11:59.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:11:59.102 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-04-21T06:11:59.647 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:11:59.659 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:11:59.659 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:00.080 INFO:teuthology.orchestra.run.smithi071.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:00.094 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/594 2024-04-21T06:12:00.094 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/594 2024-04-21T06:12:00.094 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:00.103 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:00.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:00.131 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-04-21T06:12:00.671 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:00.686 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:00.686 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:01.302 INFO:teuthology.orchestra.run.smithi071.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:01.314 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/595 2024-04-21T06:12:01.314 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/595 2024-04-21T06:12:01.314 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:01.324 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:01.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:01.360 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-04-21T06:12:01.920 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:01.933 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:02.517 INFO:teuthology.orchestra.run.smithi071.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-04-21T06:12:02.528 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/596 2024-04-21T06:12:02.528 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/596 2024-04-21T06:12:02.528 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:02.537 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:02.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:02.568 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-04-21T06:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:04.908 INFO:teuthology.orchestra.run.smithi071.stdout:generic/597 - output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/597.out.bad) 2024-04-21T06:12:04.914 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/597.out 2024-04-20 21:21:29.696924424 +0000 2024-04-21T06:12:04.914 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/597.out.bad 2024-04-21 06:12:04.906980427 +0000 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -4,11 +4,11 @@ 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: fs.protected_symlinks = 0 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: successfully followed symlink 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: fs.protected_symlinks = 1 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: -Permission denied 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: +successfully followed symlink 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: == Test hardlink create protection when 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: == process != target owner and process cannot read target 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: fs.protected_hardlinks = 0 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: -successfully created hardlink 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: +Permission denied 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: fs.protected_hardlinks = 1 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2024-04-21T06:12:04.915 INFO:teuthology.orchestra.run.smithi071.stdout: +Permission denied 2024-04-21T06:12:04.921 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/597 2024-04-21T06:12:04.921 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/597 2024-04-21T06:12:04.921 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-21T06:12:04.929 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:04.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T06:12:04.958 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-21T06:12:04.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-21T06:12:04.958 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-04-21T06:12:05.630 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:05.641 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:05.641 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:07.498 INFO:teuthology.orchestra.run.smithi071.stdout:generic/598 - output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/598.out.bad) 2024-04-21T06:12:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/598.out 2024-04-20 21:21:29.697924406 +0000 2024-04-21T06:12:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/598.out.bad 2024-04-21 06:12:07.496934926 +0000 2024-04-21T06:12:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -5,13 +5,10 @@ 2024-04-21T06:12:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: = only group writable dir 2024-04-21T06:12:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: fs.protected_regular = 1 2024-04-21T06:12:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: = group & world writable dir 2024-04-21T06:12:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: -Permission denied 2024-04-21T06:12:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: = only group writable dir 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: fs.protected_regular = 2 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: = group & world writable dir 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: -Permission denied 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: = only group writable dir 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: -Permission denied 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: fs.protected_fifos = 0 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -19,10 +16,7 @@ 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: = only group writable dir 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: fs.protected_fifos = 1 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: = group & world writable dir 2024-04-21T06:12:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: -Permission denied 2024-04-21T06:12:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: = only group writable dir 2024-04-21T06:12:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: fs.protected_fifos = 2 2024-04-21T06:12:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: = group & world writable dir 2024-04-21T06:12:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: -Permission denied 2024-04-21T06:12:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: = only group writable dir 2024-04-21T06:12:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: -Permission denied 2024-04-21T06:12:07.512 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/598 2024-04-21T06:12:07.512 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/598 2024-04-21T06:12:07.512 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-21T06:12:07.521 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:07.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T06:12:07.548 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-21T06:12:07.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-21T06:12:07.548 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-04-21T06:12:08.215 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:08.227 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:08.654 INFO:teuthology.orchestra.run.smithi071.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:08.668 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/599 2024-04-21T06:12:08.669 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/599 2024-04-21T06:12:08.669 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:08.680 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:08.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:08.710 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-04-21T06:12:09.265 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:09.280 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:09.280 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:09.732 INFO:teuthology.orchestra.run.smithi071.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:09.745 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/600 2024-04-21T06:12:09.745 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/600 2024-04-21T06:12:09.745 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:09.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:09.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:09.790 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-04-21T06:12:10.333 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:10.347 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:10.347 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:10.757 INFO:teuthology.orchestra.run.smithi071.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:10.770 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/601 2024-04-21T06:12:10.771 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/601 2024-04-21T06:12:10.771 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:10.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:10.813 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-04-21T06:12:11.358 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:11.373 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:11.935 INFO:teuthology.orchestra.run.smithi071.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/602 2024-04-21T06:12:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/602 2024-04-21T06:12:11.948 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:11.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:11.986 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-04-21T06:12:12.522 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:12.537 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:12.987 INFO:teuthology.orchestra.run.smithi071.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:12.998 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/603 2024-04-21T06:12:12.998 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/603 2024-04-21T06:12:12.998 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:13.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:13.043 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-04-21T06:12:13.575 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:13.589 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:13.589 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:14.004 INFO:teuthology.orchestra.run.smithi071.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:14.015 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/604 2024-04-21T06:12:14.015 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/604 2024-04-21T06:12:14.015 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:14.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:14.051 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-04-21T06:12:14.588 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:14.601 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:15.031 INFO:teuthology.orchestra.run.smithi071.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:15.044 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/605 2024-04-21T06:12:15.044 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/605 2024-04-21T06:12:15.044 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:15.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:15.090 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-04-21T06:12:15.624 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:15.636 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:15.637 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:16.074 INFO:teuthology.orchestra.run.smithi071.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:16.085 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/606 2024-04-21T06:12:16.086 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/606 2024-04-21T06:12:16.086 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:16.095 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:16.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:16.125 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-04-21T06:12:16.628 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:16.641 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:16.641 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/607 2024-04-21T06:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/607 2024-04-21T06:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:17.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:17.079 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-04-21T06:12:17.621 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:18.046 INFO:teuthology.orchestra.run.smithi071.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:18.057 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/608 2024-04-21T06:12:18.057 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/608 2024-04-21T06:12:18.057 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:18.066 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:18.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:18.096 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-04-21T06:12:18.646 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:18.660 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:18.661 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:19.701 INFO:teuthology.orchestra.run.smithi071.stdout:generic/609 1s 2024-04-21T06:12:19.717 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/609 2024-04-21T06:12:19.717 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:19.725 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:19.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:19.754 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-04-21T06:12:20.429 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:20.442 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:20.787 INFO:teuthology.orchestra.run.smithi071.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:20.796 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/610 2024-04-21T06:12:20.796 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/610 2024-04-21T06:12:20.796 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:20.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:20.831 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-04-21T06:12:21.337 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:21.350 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:21.757 INFO:teuthology.orchestra.run.smithi071.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:21.773 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/611 2024-04-21T06:12:21.773 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/611 2024-04-21T06:12:21.774 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:21.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:21.818 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-04-21T06:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:22.917 INFO:teuthology.orchestra.run.smithi071.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-21T06:12:22.933 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/612 2024-04-21T06:12:22.933 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/612 2024-04-21T06:12:22.933 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:22.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:22.976 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-04-21T06:12:23.653 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:23.665 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:23.665 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:24.149 INFO:teuthology.orchestra.run.smithi071.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:24.160 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/613 2024-04-21T06:12:24.160 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/613 2024-04-21T06:12:24.161 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:24.170 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:24.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:24.197 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-04-21T06:12:24.716 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:24.729 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:25.114 INFO:teuthology.orchestra.run.smithi071.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:25.127 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/614 2024-04-21T06:12:25.127 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/614 2024-04-21T06:12:25.127 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:25.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:25.172 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-04-21T06:12:25.725 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:25.738 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi071.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:26.179 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/615 2024-04-21T06:12:26.179 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/615 2024-04-21T06:12:26.179 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:26.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:26.225 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-04-21T06:12:26.817 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:26.831 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:26.831 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:27.300 INFO:teuthology.orchestra.run.smithi071.stdout:generic/616 [not run] kernel does not support IO_URING 2024-04-21T06:12:27.313 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/616 2024-04-21T06:12:27.313 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/616 2024-04-21T06:12:27.313 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:27.322 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:27.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:27.353 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-04-21T06:12:27.911 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:27.927 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:28.528 INFO:teuthology.orchestra.run.smithi071.stdout:generic/617 [not run] kernel does not support IO_URING 2024-04-21T06:12:28.544 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/617 2024-04-21T06:12:28.545 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/617 2024-04-21T06:12:28.545 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:28.557 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:28.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:28.590 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-04-21T06:12:29.134 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:29.147 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:29.147 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:29.554 INFO:teuthology.orchestra.run.smithi071.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:29.567 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/618 2024-04-21T06:12:29.568 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/618 2024-04-21T06:12:29.568 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:29.580 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:29.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:29.617 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-04-21T06:12:30.168 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:30.182 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:30.603 INFO:teuthology.orchestra.run.smithi071.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:30.613 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/619 2024-04-21T06:12:30.613 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/619 2024-04-21T06:12:30.613 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:30.622 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:30.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:30.651 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-04-21T06:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:31.733 INFO:teuthology.orchestra.run.smithi071.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:31.748 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/620 2024-04-21T06:12:31.748 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/620 2024-04-21T06:12:31.748 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:31.760 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:31.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:31.794 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-04-21T06:12:32.347 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:32.359 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:32.360 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:32.887 INFO:teuthology.orchestra.run.smithi071.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:32.898 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/621 2024-04-21T06:12:32.898 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/621 2024-04-21T06:12:32.898 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:32.907 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:32.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:32.937 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-04-21T06:12:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:33.498 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:33.932 INFO:teuthology.orchestra.run.smithi071.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:33.945 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/622 2024-04-21T06:12:33.946 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/622 2024-04-21T06:12:33.946 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:33.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:33.989 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-04-21T06:12:34.534 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:34.548 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:34.549 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:34.946 INFO:teuthology.orchestra.run.smithi071.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:34.956 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/623 2024-04-21T06:12:34.956 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/623 2024-04-21T06:12:34.956 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:34.963 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:34.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:34.991 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-04-21T06:12:35.536 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:35.551 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:35.551 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:35.976 INFO:teuthology.orchestra.run.smithi071.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:35.987 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/624 2024-04-21T06:12:35.987 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/624 2024-04-21T06:12:35.987 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:35.996 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:36.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:36.027 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-04-21T06:12:36.571 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:36.585 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:36.585 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:36.994 INFO:teuthology.orchestra.run.smithi071.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:37.009 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/625 2024-04-21T06:12:37.009 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/625 2024-04-21T06:12:37.009 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:37.021 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:37.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:37.056 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-04-21T06:12:37.599 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:37.610 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:37.610 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:38.021 INFO:teuthology.orchestra.run.smithi071.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:38.032 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/626 2024-04-21T06:12:38.032 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/626 2024-04-21T06:12:38.032 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:38.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:38.073 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-04-21T06:12:38.624 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:38.639 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:38.639 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:39.087 INFO:teuthology.orchestra.run.smithi071.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:39.100 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/627 2024-04-21T06:12:39.100 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/627 2024-04-21T06:12:39.100 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:39.111 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:39.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:39.143 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-04-21T06:12:39.690 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:39.702 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:39.702 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/628 2024-04-21T06:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/628 2024-04-21T06:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:40.212 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:40.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:40.242 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-04-21T06:12:40.786 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:40.801 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:41.231 INFO:teuthology.orchestra.run.smithi071.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:41.245 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/629 2024-04-21T06:12:41.245 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/629 2024-04-21T06:12:41.246 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:41.257 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:41.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:41.289 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-04-21T06:12:41.829 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:41.843 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:42.260 INFO:teuthology.orchestra.run.smithi071.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:42.271 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/630 2024-04-21T06:12:42.271 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/630 2024-04-21T06:12:42.271 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:42.280 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:42.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:42.309 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-04-21T06:12:42.833 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:42.847 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:43.277 INFO:teuthology.orchestra.run.smithi071.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:12:43.288 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/631 2024-04-21T06:12:43.288 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/631 2024-04-21T06:12:43.288 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:12:43.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:43.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:12:43.327 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-04-21T06:12:43.873 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:12:43.886 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:12:43.886 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:12:50.666 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:12:50.675 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:13:03.904 INFO:teuthology.orchestra.run.smithi071.stdout:generic/632 20s 2024-04-21T06:13:03.922 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/632 2024-04-21T06:13:03.922 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:03.932 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:03.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:03.964 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-04-21T06:13:04.482 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:04.496 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:05.456 INFO:teuthology.orchestra.run.smithi071.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/633.out.bad) 2024-04-21T06:13:05.483 INFO:teuthology.orchestra.run.smithi071.stdout: --- tests/generic/633.out 2024-04-20 21:21:29.702924319 +0000 2024-04-21T06:13:05.483 INFO:teuthology.orchestra.run.smithi071.stdout: +++ /tmp/tmp.fxhob2prpHxfstests-dev/results//generic/633.out.bad 2024-04-21 06:13:05.452916739 +0000 2024-04-21T06:13:05.483 INFO:teuthology.orchestra.run.smithi071.stdout: @@ -1,2 +1,5 @@ 2024-04-21T06:13:05.483 INFO:teuthology.orchestra.run.smithi071.stdout: QA output created by 633 2024-04-21T06:13:05.483 INFO:teuthology.orchestra.run.smithi071.stdout: Silence is golden 2024-04-21T06:13:05.483 INFO:teuthology.orchestra.run.smithi071.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2024-04-21T06:13:05.483 INFO:teuthology.orchestra.run.smithi071.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2024-04-21T06:13:05.483 INFO:teuthology.orchestra.run.smithi071.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2024-04-21T06:13:05.497 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/633 2024-04-21T06:13:05.506 INFO:teuthology.orchestra.run.smithi071.stdout:Failures: generic/633 2024-04-21T06:13:05.506 INFO:teuthology.orchestra.run.smithi071.stdout:Failed 1 of 1 tests 2024-04-21T06:13:05.520 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:05.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T06:13:05.573 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-21T06:13:05.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-21T06:13:05.573 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-04-21T06:13:06.153 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:06.165 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:06.165 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:06.535 INFO:teuthology.orchestra.run.smithi071.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:13:06.545 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/634 2024-04-21T06:13:06.546 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/634 2024-04-21T06:13:06.546 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:06.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:06.580 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-04-21T06:13:07.110 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:07.124 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:07.124 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:07.536 INFO:teuthology.orchestra.run.smithi071.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:13:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/635 2024-04-21T06:13:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/635 2024-04-21T06:13:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:07.554 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:07.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:07.578 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-04-21T06:13:08.110 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:08.124 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:08.124 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:08.527 INFO:teuthology.orchestra.run.smithi071.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:13:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/636 2024-04-21T06:13:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/636 2024-04-21T06:13:08.539 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:08.550 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:08.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:08.585 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-04-21T06:13:09.119 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:09.132 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:09.133 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:12.883 INFO:teuthology.orchestra.run.smithi071.stdout:generic/637 3s 2024-04-21T06:13:12.900 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/637 2024-04-21T06:13:12.900 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:12.910 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:12.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:12.944 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-04-21T06:13:13.697 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:13.708 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:14.191 INFO:teuthology.orchestra.run.smithi071.stdout:generic/638 1s 2024-04-21T06:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/638 2024-04-21T06:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:14.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:14.250 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-04-21T06:13:14.803 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:14.816 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:14.816 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:17.625 INFO:teuthology.orchestra.run.smithi071.stdout:generic/639 3s 2024-04-21T06:13:17.642 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/639 2024-04-21T06:13:17.642 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:17.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:17.681 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-04-21T06:13:18.231 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:18.246 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:18.246 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:18.698 INFO:teuthology.orchestra.run.smithi071.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:13:18.709 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/640 2024-04-21T06:13:18.709 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/640 2024-04-21T06:13:18.710 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:18.718 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:18.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:18.748 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-04-21T06:13:19.261 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:19.275 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:19.675 INFO:teuthology.orchestra.run.smithi071.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:13:19.687 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/641 2024-04-21T06:13:19.687 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/641 2024-04-21T06:13:19.687 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:19.699 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:19.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:19.732 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-04-21T06:13:20.269 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:20.280 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:20.280 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:20.706 INFO:teuthology.orchestra.run.smithi071.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:13:20.719 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/642 2024-04-21T06:13:20.720 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/642 2024-04-21T06:13:20.720 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:20.730 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:20.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:20.762 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-04-21T06:13:20.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:13:20.887 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:13:21.273 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:21.286 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:21.703 INFO:teuthology.orchestra.run.smithi071.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:13:21.715 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/643 2024-04-21T06:13:21.715 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/643 2024-04-21T06:13:21.715 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:21.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:21.755 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-04-21T06:13:22.313 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:22.327 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:22.741 INFO:teuthology.orchestra.run.smithi071.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2024-04-21T06:13:22.753 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/644 2024-04-21T06:13:22.753 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/644 2024-04-21T06:13:22.753 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:22.762 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:22.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:22.790 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-04-21T06:13:23.330 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:23.343 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:23.765 INFO:teuthology.orchestra.run.smithi071.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2024-04-21T06:13:23.776 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/645 2024-04-21T06:13:23.776 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/645 2024-04-21T06:13:23.776 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:23.785 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:23.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:23.815 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-04-21T06:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:24.369 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:24.786 INFO:teuthology.orchestra.run.smithi071.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:13:24.796 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/646 2024-04-21T06:13:24.797 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/646 2024-04-21T06:13:24.797 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:24.805 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:24.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:24.835 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-04-21T06:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:25.400 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:26.307 INFO:teuthology.orchestra.run.smithi071.stdout:generic/647 1s 2024-04-21T06:13:26.324 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/647 2024-04-21T06:13:26.324 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:26.333 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:26.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:26.361 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-04-21T06:13:27.036 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:27.048 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:27.048 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:27.509 INFO:teuthology.orchestra.run.smithi071.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T06:13:27.521 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/648 2024-04-21T06:13:27.521 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/648 2024-04-21T06:13:27.521 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:27.530 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:27.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:27.560 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-04-21T06:13:28.112 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:28.126 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:28.126 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:28.782 INFO:teuthology.orchestra.run.smithi071.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-21T06:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/649 2024-04-21T06:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/649 2024-04-21T06:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T06:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:28.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T06:13:28.843 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-04-21T06:13:29.516 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T06:13:29.526 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T06:13:29.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T06:13:51.016 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:13:51.027 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:14:21.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:14:21.232 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:14:51.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:14:51.420 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:15:21.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:15:21.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:15:51.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:15:51.862 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:16:23.192 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:16:23.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:16:53.339 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:16:53.348 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:17:23.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:17:23.549 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:17:53.779 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:17:53.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:18:23.975 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:18:23.983 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:18:24.095 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-21T06:18:24.098+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47247) UID: 0 2024-04-21T06:18:24.096 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-21T06:18:24.097+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47247) UID: 0 2024-04-21T06:18:24.138 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T06:18:24.140+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 483470) UID: 0 2024-04-21T06:18:24.138 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T06:18:24.140+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 483470) UID: 0 2024-04-21T06:18:24.141 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T06:18:24.143+0000 7fa473a00640 -1 Fail to open '/proc/483470/cmdline' error = (2) No such file or directory 2024-04-21T06:18:24.142 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T06:18:24.143+0000 7fa473a00640 -1 received signal: Hangup from (PID: 483470) UID: 0 2024-04-21T06:18:24.142 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T06:18:24.143+0000 7f7090000640 -1 Fail to open '/proc/483470/cmdline' error = (2) No such file or directory 2024-04-21T06:18:24.142 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T06:18:24.143+0000 7f7090000640 -1 received signal: Hangup from (PID: 483470) UID: 0 2024-04-21T06:23:25.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:23:25.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:23:55.221 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:23:55.236 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:24:25.674 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:24:25.687 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:24:55.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:24:55.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:25:26.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:25:26.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:25:56.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:25:56.880 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:26:27.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:26:27.031 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:26:58.211 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:26:58.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:27:29.627 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:27:29.720 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:27:59.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:27:59.875 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:28:30.141 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:28:30.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:29:00.370 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:29:00.380 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:29:30.547 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:29:30.556 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:30:00.663 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:30:00.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:30:30.896 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:30:30.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:31:01.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:31:01.442 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:31:31.862 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:31:31.875 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:31:31.959 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T06:31:31.961+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47584) UID: 0 2024-04-21T06:31:31.959 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T06:31:31.961+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47584) UID: 0 2024-04-21T06:31:31.960 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T06:31:31.961+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47584) UID: 0 2024-04-21T06:31:31.960 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T06:31:31.961+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47584) UID: 0 2024-04-21T06:35:43.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:35:43.204 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:36:13.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:36:13.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:36:13.684 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T06:36:13.686+0000 7fab05800640 -1 Fail to open '/proc/47634/cmdline' error = (2) No such file or directory 2024-04-21T06:36:13.684 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T06:36:13.686+0000 7fab05800640 -1 received signal: Hangup from (PID: 47634) UID: 0 2024-04-21T06:36:13.685 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T06:36:13.687+0000 7f8489000640 -1 Fail to open '/proc/47634/cmdline' error = (2) No such file or directory 2024-04-21T06:36:13.685 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T06:36:13.687+0000 7f8489000640 -1 received signal: Hangup from (PID: 47634) UID: 0 2024-04-21T06:36:13.689 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T06:36:13.687+0000 7f787e400640 -1 Fail to open '/proc/47634/cmdline' error = (2) No such file or directory 2024-04-21T06:36:13.690 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T06:36:13.687+0000 7f787e400640 -1 received signal: Hangup from (PID: 47634) UID: 0 2024-04-21T06:36:13.717 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T06:36:13.683+0000 7f3db2c00640 -1 Fail to open '/proc/47634/cmdline' error = (2) No such file or directory 2024-04-21T06:36:13.717 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T06:36:13.714+0000 7f3db2c00640 -1 received signal: Hangup from (PID: 47634) UID: 0 2024-04-21T06:40:10.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:40:10.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:40:10.983 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T06:40:10.985+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488115) UID: 0 2024-04-21T06:40:10.983 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T06:40:10.985+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488115) UID: 0 2024-04-21T06:40:10.983 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T06:40:10.985+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488115) UID: 0 2024-04-21T06:40:10.984 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T06:40:10.987+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488115) UID: 0 2024-04-21T06:45:18.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:45:18.109 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:45:18.200 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-21T06:45:18.202+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47692) UID: 0 2024-04-21T06:45:18.200 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-21T06:45:18.202+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47692) UID: 0 2024-04-21T06:49:26.002 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T06:49:26.004+0000 7fab05800640 -1 Fail to open '/proc/47704/cmdline' error = (2) No such file or directory 2024-04-21T06:49:26.002 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T06:49:26.004+0000 7fab05800640 -1 received signal: Hangup from (PID: 47704) UID: 0 2024-04-21T06:49:26.003 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T06:49:26.004+0000 7f8489000640 -1 Fail to open '/proc/47704/cmdline' error = (2) No such file or directory 2024-04-21T06:49:26.003 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T06:49:26.004+0000 7f8489000640 -1 received signal: Hangup from (PID: 47704) UID: 0 2024-04-21T06:49:26.008 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T06:49:26.002+0000 7f787e400640 -1 received signal: Hangup from (PID: 47704) UID: 0 2024-04-21T06:49:26.009 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T06:49:26.005+0000 7f3db2c00640 -1 Fail to open '/proc/47704/cmdline' error = (2) No such file or directory 2024-04-21T06:49:26.010 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T06:49:26.005+0000 7f3db2c00640 -1 received signal: Hangup from (PID: 47704) UID: 0 2024-04-21T06:54:01.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:54:01.142 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T06:54:01.286 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T06:54:01.289+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 490924) UID: 0 2024-04-21T06:54:01.289 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T06:54:01.291+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 490924) UID: 0 2024-04-21T06:54:01.297 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T06:54:01.299+0000 7f6fa6400640 -1 Fail to open '/proc/490924/cmdline' error = (2) No such file or directory 2024-04-21T06:54:01.297 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T06:54:01.299+0000 7f6fa6400640 -1 received signal: Hangup from (PID: 490924) UID: 0 2024-04-21T06:54:01.312 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T06:54:01.289+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 490924) UID: 0 2024-04-21T07:05:42.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:05:42.495 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:05:42.670 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T07:05:42.671+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47790) UID: 0 2024-04-21T07:05:42.670 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T07:05:42.671+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47790) UID: 0 2024-04-21T07:05:42.670 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T07:05:42.671+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47790) UID: 0 2024-04-21T07:05:42.671 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T07:05:42.671+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47790) UID: 0 2024-04-21T07:09:34.680 INFO:teuthology.orchestra.run.smithi071.stdout:generic/650 3365s 2024-04-21T07:09:34.734 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/650 2024-04-21T07:09:34.734 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:34.742 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:34.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:34.771 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-04-21T07:09:35.432 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:35.445 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:35.445 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:35.854 INFO:teuthology.orchestra.run.smithi071.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:35.866 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/651 2024-04-21T07:09:35.866 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/651 2024-04-21T07:09:35.866 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:35.876 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:35.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:35.912 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-04-21T07:09:36.468 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:36.481 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:36.481 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:36.850 INFO:teuthology.orchestra.run.smithi071.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:36.859 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/652 2024-04-21T07:09:36.859 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/652 2024-04-21T07:09:36.860 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:36.867 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:36.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:36.898 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-04-21T07:09:37.419 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:37.435 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:37.435 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:37.808 INFO:teuthology.orchestra.run.smithi071.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:37.820 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/653 2024-04-21T07:09:37.820 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/653 2024-04-21T07:09:37.820 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:37.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:37.861 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-04-21T07:09:38.402 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:38.417 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:38.782 INFO:teuthology.orchestra.run.smithi071.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:38.794 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/654 2024-04-21T07:09:38.794 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/654 2024-04-21T07:09:38.794 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:38.803 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:38.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:38.830 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-04-21T07:09:39.362 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:39.378 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:39.378 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:39.727 INFO:teuthology.orchestra.run.smithi071.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:39.736 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/655 2024-04-21T07:09:39.736 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/655 2024-04-21T07:09:39.736 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:39.743 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:39.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:39.775 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-04-21T07:09:40.299 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:40.316 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:40.316 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:40.725 INFO:teuthology.orchestra.run.smithi071.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2024-04-21T07:09:40.736 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/656 2024-04-21T07:09:40.736 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/656 2024-04-21T07:09:40.736 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:40.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:40.773 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-04-21T07:09:41.308 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:41.323 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:41.323 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:41.674 INFO:teuthology.orchestra.run.smithi071.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:41.686 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/657 2024-04-21T07:09:41.686 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/657 2024-04-21T07:09:41.686 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:41.694 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:41.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:41.721 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-04-21T07:09:42.244 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:42.262 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:42.262 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:42.623 INFO:teuthology.orchestra.run.smithi071.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:42.632 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/658 2024-04-21T07:09:42.633 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/658 2024-04-21T07:09:42.633 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:42.639 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:42.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:42.669 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-04-21T07:09:43.216 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:43.229 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:43.601 INFO:teuthology.orchestra.run.smithi071.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:43.612 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/659 2024-04-21T07:09:43.612 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/659 2024-04-21T07:09:43.612 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:43.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:43.657 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-04-21T07:09:44.178 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:44.194 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:44.562 INFO:teuthology.orchestra.run.smithi071.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:44.573 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/660 2024-04-21T07:09:44.573 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/660 2024-04-21T07:09:44.573 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:44.585 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:44.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:44.612 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-04-21T07:09:45.131 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:45.145 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:45.501 INFO:teuthology.orchestra.run.smithi071.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:45.511 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/661 2024-04-21T07:09:45.511 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/661 2024-04-21T07:09:45.511 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:45.518 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:45.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:45.550 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-04-21T07:09:46.069 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:46.082 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:46.083 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:46.446 INFO:teuthology.orchestra.run.smithi071.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:46.456 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/662 2024-04-21T07:09:46.456 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/662 2024-04-21T07:09:46.456 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:46.466 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:46.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:46.500 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-04-21T07:09:47.032 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:47.046 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:47.046 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:47.444 INFO:teuthology.orchestra.run.smithi071.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:47.457 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/663 2024-04-21T07:09:47.457 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/663 2024-04-21T07:09:47.457 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:47.465 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:47.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:47.497 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-04-21T07:09:48.012 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:48.026 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:48.405 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/664 2024-04-21T07:09:48.405 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/664 2024-04-21T07:09:48.405 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:48.413 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:48.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:48.441 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-04-21T07:09:48.979 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:48.990 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:48.990 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:49.358 INFO:teuthology.orchestra.run.smithi071.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:49.369 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/665 2024-04-21T07:09:49.369 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/665 2024-04-21T07:09:49.370 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:49.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:49.406 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-04-21T07:09:49.919 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:49.934 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:50.298 INFO:teuthology.orchestra.run.smithi071.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:50.309 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/666 2024-04-21T07:09:50.310 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/666 2024-04-21T07:09:50.310 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:50.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:50.349 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-04-21T07:09:50.887 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:50.902 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:50.902 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:51.320 INFO:teuthology.orchestra.run.smithi071.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:51.330 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/667 2024-04-21T07:09:51.330 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/667 2024-04-21T07:09:51.330 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:51.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:51.367 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-04-21T07:09:51.916 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:51.927 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:52.280 INFO:teuthology.orchestra.run.smithi071.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:52.292 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/668 2024-04-21T07:09:52.292 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/668 2024-04-21T07:09:52.292 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:52.300 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:52.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:52.325 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-04-21T07:09:52.856 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:52.868 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:52.868 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:53.252 INFO:teuthology.orchestra.run.smithi071.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:53.266 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/669 2024-04-21T07:09:53.266 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/669 2024-04-21T07:09:53.266 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:53.276 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:53.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:53.304 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-04-21T07:09:53.852 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:53.864 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:53.864 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:54.226 INFO:teuthology.orchestra.run.smithi071.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:54.235 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/670 2024-04-21T07:09:54.235 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/670 2024-04-21T07:09:54.235 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:54.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:54.275 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-04-21T07:09:54.813 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:54.825 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:55.220 INFO:teuthology.orchestra.run.smithi071.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:55.232 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/671 2024-04-21T07:09:55.232 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/671 2024-04-21T07:09:55.232 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:55.241 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:55.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:55.267 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-04-21T07:09:55.804 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:55.820 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:55.820 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:56.188 INFO:teuthology.orchestra.run.smithi071.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:56.196 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/672 2024-04-21T07:09:56.196 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/672 2024-04-21T07:09:56.196 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:56.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:56.235 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-04-21T07:09:56.743 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:56.754 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:57.726 INFO:teuthology.orchestra.run.smithi071.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:57.735 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/673 2024-04-21T07:09:57.736 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/673 2024-04-21T07:09:57.736 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:57.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:57.771 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-04-21T07:09:58.336 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:58.350 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:58.799 INFO:teuthology.orchestra.run.smithi071.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:09:58.811 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/674 2024-04-21T07:09:58.811 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/674 2024-04-21T07:09:58.811 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:09:58.818 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:09:58.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:09:58.852 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-04-21T07:09:59.398 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:09:59.409 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:09:59.409 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:10:00.259 INFO:teuthology.orchestra.run.smithi071.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:10:00.270 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/675 2024-04-21T07:10:00.270 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/675 2024-04-21T07:10:00.270 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:10:00.279 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:10:00.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:10:00.308 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-04-21T07:10:00.884 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:10:00.896 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:10:00.896 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:10:37.056 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:10:37.066 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:10:37.177 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T07:10:37.178+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 504214) UID: 0 2024-04-21T07:10:37.178 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T07:10:37.179+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 504214) UID: 0 2024-04-21T07:10:37.178 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T07:10:37.178+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 504214) UID: 0 2024-04-21T07:10:37.178 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T07:10:37.179+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 504214) UID: 0 2024-04-21T07:10:37.297 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-21T07:10:37.298+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47814) UID: 0 2024-04-21T07:10:37.297 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-21T07:10:37.298+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47814) UID: 0 2024-04-21T07:16:50.435 INFO:teuthology.orchestra.run.smithi137.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.b.log.1: 2024-04-21T07:16:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: stdin: file size changed while zipping 2024-04-21T07:16:54.409 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T07:16:54.409+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47821) UID: 0 2024-04-21T07:16:54.409 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T07:16:54.410+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47821) UID: 0 2024-04-21T07:16:54.410 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T07:16:54.410+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47821) UID: 0 2024-04-21T07:16:54.410 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T07:16:54.410+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47821) UID: 0 2024-04-21T07:27:24.096 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:27:24.103 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:27:24.376 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T07:27:24.376+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 504262) UID: 0 2024-04-21T07:27:24.377 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T07:27:24.376+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 504262) UID: 0 2024-04-21T07:27:24.377 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T07:27:24.376+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 504262) UID: 0 2024-04-21T07:27:24.378 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T07:27:24.378+0000 7f7782c00640 -1 Fail to open '/proc/504262/cmdline' error = (2) No such file or directory 2024-04-21T07:27:24.378 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T07:27:24.378+0000 7f7782c00640 -1 received signal: Hangup from (PID: 504262) UID: 0 2024-04-21T07:27:29.711 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-21T07:27:29.711+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47852) UID: 0 2024-04-21T07:27:29.712 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-21T07:27:29.711+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47852) UID: 0 2024-04-21T07:36:56.782 INFO:teuthology.orchestra.run.smithi071.stdout:generic/676 1616s 2024-04-21T07:36:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/676 2024-04-21T07:36:56.836 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:36:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:36:56.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:36:56.877 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-04-21T07:36:57.856 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:36:57.871 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:36:57.871 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:36:58.357 INFO:teuthology.orchestra.run.smithi071.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:36:58.369 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/677 2024-04-21T07:36:58.369 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/677 2024-04-21T07:36:58.369 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:36:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:36:58.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:36:58.412 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-04-21T07:36:58.959 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:36:58.972 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:36:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:36:59.465 INFO:teuthology.orchestra.run.smithi071.stdout:generic/678 [not run] kernel does not support IO_URING 2024-04-21T07:36:59.477 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/678 2024-04-21T07:36:59.477 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/678 2024-04-21T07:36:59.477 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:36:59.487 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:36:59.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:36:59.518 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-04-21T07:37:00.062 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:00.079 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:00.450 INFO:teuthology.orchestra.run.smithi071.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/679 2024-04-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/679 2024-04-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:00.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:00.500 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-04-21T07:37:01.029 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:01.043 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:02.917 INFO:teuthology.orchestra.run.smithi071.stdout:generic/680 1s 2024-04-21T07:37:02.935 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/680 2024-04-21T07:37:02.935 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:02.944 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:02.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:02.974 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-04-21T07:37:03.692 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:03.705 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:03.705 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:04.071 INFO:teuthology.orchestra.run.smithi071.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-21T07:37:04.082 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/681 2024-04-21T07:37:04.082 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/681 2024-04-21T07:37:04.082 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:04.091 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:04.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:04.121 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-04-21T07:37:04.653 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:04.666 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:05.440 INFO:teuthology.orchestra.run.smithi071.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-21T07:37:05.450 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/682 2024-04-21T07:37:05.450 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/682 2024-04-21T07:37:05.450 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:05.459 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:05.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:05.491 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-04-21T07:37:06.044 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:06.057 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:08.746 INFO:teuthology.orchestra.run.smithi071.stdout:generic/683 [not run] /tmp/tmp.8yh8DCdvNntest: file alloc unit 4194304 larger than op length 65536 2024-04-21T07:37:08.758 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/683 2024-04-21T07:37:08.758 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/683 2024-04-21T07:37:08.758 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:08.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:08.793 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-04-21T07:37:09.344 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:09.360 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:09.360 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:11.831 INFO:teuthology.orchestra.run.smithi071.stdout:generic/684 [not run] /tmp/tmp.8yh8DCdvNntest: file alloc unit 4194304 larger than op length 65536 2024-04-21T07:37:11.843 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/684 2024-04-21T07:37:11.843 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/684 2024-04-21T07:37:11.843 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:11.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:11.883 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-04-21T07:37:12.433 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:12.450 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:12.451 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:15.237 INFO:teuthology.orchestra.run.smithi071.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-21T07:37:15.247 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/685 2024-04-21T07:37:15.247 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/685 2024-04-21T07:37:15.247 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:15.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:15.291 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-04-21T07:37:15.852 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:18.319 INFO:teuthology.orchestra.run.smithi071.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-21T07:37:18.331 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/686 2024-04-21T07:37:18.331 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/686 2024-04-21T07:37:18.331 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:18.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:18.371 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-04-21T07:37:18.911 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:18.925 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:21.388 INFO:teuthology.orchestra.run.smithi071.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-04-21T07:37:21.398 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/687 2024-04-21T07:37:21.398 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/687 2024-04-21T07:37:21.398 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:21.406 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:21.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:21.440 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-04-21T07:37:21.969 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:21.982 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:22.546 INFO:teuthology.orchestra.run.smithi071.stdout:generic/688 [not run] /tmp/tmp.8yh8DCdvNntest: file alloc unit 4194304 larger than op length 65536 2024-04-21T07:37:22.559 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/688 2024-04-21T07:37:22.559 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/688 2024-04-21T07:37:22.559 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:22.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:22.594 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-04-21T07:37:23.132 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:23.147 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:23.147 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:23.576 INFO:teuthology.orchestra.run.smithi071.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2024-04-21T07:37:23.588 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/689 2024-04-21T07:37:23.588 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/689 2024-04-21T07:37:23.588 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:23.597 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:23.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:23.628 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-04-21T07:37:24.156 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:24.169 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:24.169 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:24.606 INFO:teuthology.orchestra.run.smithi071.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:24.617 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/690 2024-04-21T07:37:24.619 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/690 2024-04-21T07:37:24.619 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:24.626 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:24.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:24.654 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-04-21T07:37:25.196 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:25.212 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:25.582 INFO:teuthology.orchestra.run.smithi071.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:25.593 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/691 2024-04-21T07:37:25.593 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/691 2024-04-21T07:37:25.593 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:25.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:25.631 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-04-21T07:37:26.141 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:26.154 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:26.154 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:26.959 INFO:teuthology.orchestra.run.smithi071.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:26.970 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/692 2024-04-21T07:37:26.970 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/692 2024-04-21T07:37:26.971 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:27.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:27.011 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-04-21T07:37:27.555 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:27.570 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:28.067 INFO:teuthology.orchestra.run.smithi071.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:28.078 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/693 2024-04-21T07:37:28.078 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/693 2024-04-21T07:37:28.078 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:28.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:28.116 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-04-21T07:37:28.698 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:28.713 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:28.713 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:29.803 INFO:teuthology.orchestra.run.smithi071.stdout:generic/694 1s 2024-04-21T07:37:29.827 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/694 2024-04-21T07:37:29.828 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:29.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:29.866 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-04-21T07:37:30.451 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:30.464 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:30.464 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:30.965 INFO:teuthology.orchestra.run.smithi071.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:30.977 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/695 2024-04-21T07:37:30.977 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/695 2024-04-21T07:37:30.977 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:30.986 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:31.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:31.020 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-04-21T07:37:31.596 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:31.607 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:31.997 INFO:teuthology.orchestra.run.smithi071.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/696 2024-04-21T07:37:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/696 2024-04-21T07:37:32.009 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:32.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:32.048 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-04-21T07:37:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:32.609 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:32.609 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-21T07:37:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/697 2024-04-21T07:37:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/697 2024-04-21T07:37:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:33.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:33.310 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-04-21T07:37:33.850 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:33.864 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:33.864 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:34.233 INFO:teuthology.orchestra.run.smithi071.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:34.245 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/698 2024-04-21T07:37:34.245 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/698 2024-04-21T07:37:34.245 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:34.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:34.283 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-04-21T07:37:34.808 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:34.821 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:35.396 INFO:teuthology.orchestra.run.smithi071.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:35.407 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/699 2024-04-21T07:37:35.407 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/699 2024-04-21T07:37:35.407 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:35.414 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:35.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:35.442 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-04-21T07:37:35.991 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:36.005 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:36.005 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:36.377 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/700 2024-04-21T07:37:36.377 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/700 2024-04-21T07:37:36.378 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:36.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:36.413 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-04-21T07:37:36.954 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:36.967 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:36.967 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:37.721 INFO:teuthology.orchestra.run.smithi071.stdout:generic/701 1s 2024-04-21T07:37:37.740 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/701 2024-04-21T07:37:37.740 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:37.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:37.777 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-04-21T07:37:38.524 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:38.541 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:38.541 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:38.915 INFO:teuthology.orchestra.run.smithi071.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:38.930 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/702 2024-04-21T07:37:38.930 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/702 2024-04-21T07:37:38.930 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:38.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:38.969 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-04-21T07:37:39.536 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:39.548 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:40.021 INFO:teuthology.orchestra.run.smithi071.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:40.033 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/703 2024-04-21T07:37:40.033 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/703 2024-04-21T07:37:40.034 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:40.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:40.076 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-04-21T07:37:40.593 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:40.607 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:40.607 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:41.070 INFO:teuthology.orchestra.run.smithi071.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2024-04-21T07:37:41.080 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/704 2024-04-21T07:37:41.080 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/704 2024-04-21T07:37:41.080 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:41.089 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:41.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:41.116 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-04-21T07:37:41.656 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:41.670 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:41.670 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:42.053 INFO:teuthology.orchestra.run.smithi071.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:42.064 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/705 2024-04-21T07:37:42.064 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/705 2024-04-21T07:37:42.064 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:42.072 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:42.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:42.107 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-04-21T07:37:42.669 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:42.681 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:44.946 INFO:teuthology.orchestra.run.smithi071.stdout:generic/706 2s 2024-04-21T07:37:45.014 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/706 2024-04-21T07:37:45.014 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:45.022 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:45.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:45.055 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-04-21T07:37:45.802 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:45.817 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:45.817 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:46.197 INFO:teuthology.orchestra.run.smithi071.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:37:46.209 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/707 2024-04-21T07:37:46.209 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/707 2024-04-21T07:37:46.209 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:46.216 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:46.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:46.247 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-04-21T07:37:46.814 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:46.827 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:46.828 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:47.913 INFO:teuthology.orchestra.run.smithi071.stdout:generic/708 1s 2024-04-21T07:37:47.931 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/708 2024-04-21T07:37:47.931 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:47.941 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:47.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:47.966 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-04-21T07:37:48.774 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:48.795 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:48.795 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:49.295 INFO:teuthology.orchestra.run.smithi071.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-21T07:37:49.308 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/709 2024-04-21T07:37:49.308 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/709 2024-04-21T07:37:49.308 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:49.317 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:49.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:49.347 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-04-21T07:37:50.115 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:50.127 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:50.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:50.600 INFO:teuthology.orchestra.run.smithi071.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-21T07:37:50.613 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/710 2024-04-21T07:37:50.613 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/710 2024-04-21T07:37:50.613 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:50.624 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:50.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:50.659 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-04-21T07:37:51.397 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:51.411 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:51.956 INFO:teuthology.orchestra.run.smithi071.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-21T07:37:51.968 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/711 2024-04-21T07:37:51.968 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/711 2024-04-21T07:37:51.968 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:51.976 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:52.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:52.005 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-04-21T07:37:52.746 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:52.761 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:52.761 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:53.279 INFO:teuthology.orchestra.run.smithi071.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-21T07:37:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/712 2024-04-21T07:37:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/712 2024-04-21T07:37:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:53.298 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:53.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:53.347 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-04-21T07:37:54.098 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:54.113 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:54.113 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:54.614 INFO:teuthology.orchestra.run.smithi071.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-04-21T07:37:54.624 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/713 2024-04-21T07:37:54.624 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/713 2024-04-21T07:37:54.624 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:54.631 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:54.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:54.667 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-04-21T07:37:55.384 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:55.395 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:55.395 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:55.868 INFO:teuthology.orchestra.run.smithi071.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-21T07:37:55.881 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/714 2024-04-21T07:37:55.882 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/714 2024-04-21T07:37:55.882 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:55.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:55.930 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-04-21T07:37:56.690 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:56.703 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:57.179 INFO:teuthology.orchestra.run.smithi071.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-04-21T07:37:57.190 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/715 2024-04-21T07:37:57.190 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/715 2024-04-21T07:37:57.190 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:57.202 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:57.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:57.235 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-04-21T07:37:58.057 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:58.080 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:58.678 INFO:teuthology.orchestra.run.smithi071.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-21T07:37:58.692 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/716 2024-04-21T07:37:58.692 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/716 2024-04-21T07:37:58.693 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:37:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:37:58.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:37:58.732 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-04-21T07:37:59.554 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:37:59.573 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:37:59.573 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:00.147 INFO:teuthology.orchestra.run.smithi071.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-21T07:38:00.159 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/717 2024-04-21T07:38:00.159 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/717 2024-04-21T07:38:00.159 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:00.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:00.218 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-04-21T07:38:01.027 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:01.041 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:01.594 INFO:teuthology.orchestra.run.smithi071.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-21T07:38:01.606 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/718 2024-04-21T07:38:01.606 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/718 2024-04-21T07:38:01.606 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:01.616 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:01.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:01.643 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-04-21T07:38:02.382 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:02.398 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:02.868 INFO:teuthology.orchestra.run.smithi071.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-21T07:38:02.880 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/719 2024-04-21T07:38:02.880 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/719 2024-04-21T07:38:02.880 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:02.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:02.927 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-04-21T07:38:03.682 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:03.694 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:03.694 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:04.206 INFO:teuthology.orchestra.run.smithi071.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-21T07:38:04.215 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/720 2024-04-21T07:38:04.216 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/720 2024-04-21T07:38:04.216 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:04.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:04.251 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-04-21T07:38:05.005 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:05.021 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:05.500 INFO:teuthology.orchestra.run.smithi071.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-04-21T07:38:05.513 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/721 2024-04-21T07:38:05.513 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/721 2024-04-21T07:38:05.514 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:05.523 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:05.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:05.554 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-04-21T07:38:06.089 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:06.104 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:06.104 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:06.586 INFO:teuthology.orchestra.run.smithi071.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-21T07:38:06.599 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/722 2024-04-21T07:38:06.599 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/722 2024-04-21T07:38:06.600 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:06.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:06.649 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-04-21T07:38:07.428 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:07.443 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:07.927 INFO:teuthology.orchestra.run.smithi071.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-21T07:38:07.938 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/723 2024-04-21T07:38:07.938 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/723 2024-04-21T07:38:07.938 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:07.946 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:07.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:07.977 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-04-21T07:38:08.275 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:38:08.284 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:38:08.505 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-21T07:38:08.505+0000 7f4e38c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47905) UID: 0 2024-04-21T07:38:08.505 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-04-21T07:38:08.505+0000 7f01bba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47905) UID: 0 2024-04-21T07:38:08.740 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:08.754 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:09.282 INFO:teuthology.orchestra.run.smithi071.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-21T07:38:09.292 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/724 2024-04-21T07:38:09.292 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/724 2024-04-21T07:38:09.292 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:09.301 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:09.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:09.348 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-04-21T07:38:10.056 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:10.070 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:10.070 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:10.554 INFO:teuthology.orchestra.run.smithi071.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-21T07:38:10.565 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/725 2024-04-21T07:38:10.565 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/725 2024-04-21T07:38:10.565 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:10.577 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:10.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:10.603 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-04-21T07:38:11.317 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:11.335 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:12.410 INFO:teuthology.orchestra.run.smithi071.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-21T07:38:12.422 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/726 2024-04-21T07:38:12.422 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/726 2024-04-21T07:38:12.423 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:12.431 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:12.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:12.461 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-04-21T07:38:13.189 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:13.202 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:13.754 INFO:teuthology.orchestra.run.smithi071.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-21T07:38:13.766 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/727 2024-04-21T07:38:13.766 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/727 2024-04-21T07:38:13.766 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:13.777 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:13.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:13.807 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-04-21T07:38:14.526 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:14.541 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:19.244 INFO:teuthology.orchestra.run.smithi071.stdout:generic/728 5s 2024-04-21T07:38:19.263 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/728 2024-04-21T07:38:19.263 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:19.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:19.311 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-04-21T07:38:19.888 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:19.902 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:19.902 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:20.946 INFO:teuthology.orchestra.run.smithi071.stdout:generic/729 1s 2024-04-21T07:38:20.964 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/729 2024-04-21T07:38:20.965 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:21.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:21.005 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-04-21T07:38:21.714 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:21.729 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:22.238 INFO:teuthology.orchestra.run.smithi071.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2024-04-21T07:38:22.249 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/730 2024-04-21T07:38:22.249 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/730 2024-04-21T07:38:22.249 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:22.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:22.287 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-04-21T07:38:22.827 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:22.841 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:22.841 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:23.251 INFO:teuthology.orchestra.run.smithi071.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2024-04-21T07:38:23.262 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/731 2024-04-21T07:38:23.262 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/731 2024-04-21T07:38:23.262 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:23.271 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:23.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:23.296 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-04-21T07:38:23.868 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:23.882 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:24.275 INFO:teuthology.orchestra.run.smithi071.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:38:24.287 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/732 2024-04-21T07:38:24.287 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/732 2024-04-21T07:38:24.287 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:24.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:24.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:24.326 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-04-21T07:38:24.888 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:24.904 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:25.296 INFO:teuthology.orchestra.run.smithi071.stdout:generic/733 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:38:25.307 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/733 2024-04-21T07:38:25.308 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/733 2024-04-21T07:38:25.308 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:25.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:25.342 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-04-21T07:38:25.869 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:25.882 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:25.882 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:26.386 INFO:teuthology.orchestra.run.smithi071.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-21T07:38:26.398 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/734 2024-04-21T07:38:26.399 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/734 2024-04-21T07:38:26.400 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:26.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:26.445 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-04-21T07:38:27.330 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:27.343 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:27.343 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:30.174 INFO:teuthology.orchestra.run.smithi071.stdout:generic/735 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-21T07:38:30.185 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/735 2024-04-21T07:38:30.185 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/735 2024-04-21T07:38:30.185 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:38:30.194 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:38:30.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:38:30.223 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-04-21T07:38:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:38:31.015 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:38:31.015 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:42:09.493 INFO:teuthology.orchestra.run.smithi071.stdout:generic/736 218s 2024-04-21T07:42:09.513 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/736 2024-04-21T07:42:09.513 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:42:09.520 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:42:09.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:42:09.547 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-04-21T07:42:10.386 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:42:10.398 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:42:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:42:10.811 INFO:teuthology.orchestra.run.smithi071.stdout:generic/737 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:42:10.824 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/737 2024-04-21T07:42:10.824 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/737 2024-04-21T07:42:10.824 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:42:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:42:10.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:42:10.857 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-04-21T07:42:11.450 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:42:11.462 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:42:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:42:13.487 INFO:teuthology.orchestra.run.smithi071.stdout:generic/738 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:42:13.682 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/738 2024-04-21T07:42:13.682 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/738 2024-04-21T07:42:13.682 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:42:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:42:13.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:42:13.726 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-04-21T07:42:14.285 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:42:14.297 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:42:14.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:42:14.835 INFO:teuthology.orchestra.run.smithi071.stdout:generic/739 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:42:14.845 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/739 2024-04-21T07:42:14.845 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/739 2024-04-21T07:42:14.845 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:42:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:42:14.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:42:14.885 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/741) 2024-04-21T07:42:15.459 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:42:15.474 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:42:15.474 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:42:15.979 INFO:teuthology.orchestra.run.smithi071.stdout:generic/741 [not run] this test requires a valid $SCRATCH_DEV 2024-04-21T07:42:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:Ran: generic/741 2024-04-21T07:42:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:Not run: generic/741 2024-04-21T07:42:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:Passed all 1 tests 2024-04-21T07:42:15.999 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:42:16.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-21T07:42:16.025 DEBUG:teuthology.orchestra.run.smithi071:> (cd /tmp/tmp.fxhob2prpHxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/742) 2024-04-21T07:42:16.557 INFO:teuthology.orchestra.run.smithi071.stdout:FSTYP -- ceph-fuse 2024-04-21T07:42:16.577 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM -- Linux/x86_64 smithi071 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-04-21T07:42:16.577 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-21T07:43:18.964 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T07:43:18.963+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47994) UID: 0 2024-04-21T07:43:18.964 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T07:43:18.963+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47994) UID: 0 2024-04-21T07:43:18.965 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T07:43:18.963+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47994) UID: 0 2024-04-21T07:43:18.965 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T07:43:18.963+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47994) UID: 0 2024-04-21T07:47:38.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:47:38.343 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:47:38.464 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T07:47:38.464+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533461) UID: 0 2024-04-21T07:47:38.464 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T07:47:38.464+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533461) UID: 0 2024-04-21T07:47:38.465 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T07:47:38.464+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533461) UID: 0 2024-04-21T07:47:38.465 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T07:47:38.464+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533461) UID: 0 2024-04-21T07:52:56.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:52:56.110 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T07:52:56.209 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T07:52:56.209+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48239) UID: 0 2024-04-21T07:52:56.209 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T07:52:56.209+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48239) UID: 0 2024-04-21T07:52:56.210 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T07:52:56.210+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48239) UID: 0 2024-04-21T07:52:56.210 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T07:52:56.210+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48239) UID: 0 2024-04-21T07:52:56.217 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T07:52:56.218+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533529) UID: 0 2024-04-21T07:52:56.217 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T07:52:56.218+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533529) UID: 0 2024-04-21T07:52:56.217 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T07:52:56.218+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533529) UID: 0 2024-04-21T07:52:56.219 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T07:52:56.220+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533529) UID: 0 2024-04-21T08:00:19.558 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:00:19.567 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:00:19.674 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T08:00:19.674+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533635) UID: 0 2024-04-21T08:00:19.675 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T08:00:19.675+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533635) UID: 0 2024-04-21T08:00:19.675 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T08:00:19.675+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533635) UID: 0 2024-04-21T08:00:19.676 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T08:00:19.675+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533635) UID: 0 2024-04-21T08:00:19.690 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T08:00:19.690+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48289) UID: 0 2024-04-21T08:00:19.690 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T08:00:19.690+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48289) UID: 0 2024-04-21T08:00:19.691 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T08:00:19.690+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48289) UID: 0 2024-04-21T08:00:19.691 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T08:00:19.690+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48289) UID: 0 2024-04-21T08:05:14.074 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:05:14.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:05:14.380 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-21T08:05:14.380+0000 7f7782c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533713) UID: 0 2024-04-21T08:05:14.381 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-21T08:05:14.380+0000 7f6fa6400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533713) UID: 0 2024-04-21T08:05:14.381 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-21T08:05:14.380+0000 7f7090000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533713) UID: 0 2024-04-21T08:05:14.381 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-21T08:05:14.380+0000 7fa473a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 533713) UID: 0 2024-04-21T08:09:58.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:09:58.896 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:10:29.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:10:29.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:10:59.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:10:59.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:11:29.934 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:11:29.942 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:12:00.968 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:12:00.974 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:12:31.096 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:12:31.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:13:01.216 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:13:01.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:13:31.926 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:13:31.933 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:14:02.056 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:14:02.065 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:14:32.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:14:32.885 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:15:03.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:15:03.017 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:15:33.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:15:33.335 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:16:03.465 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:16:03.471 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:16:33.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:16:33.652 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:17:03.782 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:17:03.789 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:17:33.946 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:17:33.953 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:18:04.320 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:18:04.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:18:34.445 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:18:34.452 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:19:05.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:19:05.433 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:19:35.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:19:35.566 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:20:05.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:20:05.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:20:35.835 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:20:35.841 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:21:05.980 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:21:05.985 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:21:36.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:21:36.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:22:07.090 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:22:07.096 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:22:38.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:22:38.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:23:08.257 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:23:08.262 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:23:38.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:23:38.434 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:23:38.534 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-21T08:23:38.534+0000 7f787e400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48989) UID: 0 2024-04-21T08:23:38.534 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-21T08:23:38.534+0000 7f8489000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48989) UID: 0 2024-04-21T08:23:38.535 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-21T08:23:38.534+0000 7fab05800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48989) UID: 0 2024-04-21T08:23:38.535 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-21T08:23:38.535+0000 7f3db2c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48989) UID: 0 2024-04-21T08:26:35.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:26:35.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:27:06.153 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:27:06.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:27:36.298 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:27:36.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:28:06.446 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:28:06.455 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:28:36.576 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:28:36.585 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:29:06.741 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:29:06.752 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:29:36.905 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:29:36.913 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:30:07.060 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:30:07.069 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:30:37.973 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:30:37.983 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:31:08.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:31:08.113 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:31:38.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:31:38.311 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:32:08.525 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:32:08.535 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:32:38.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:32:38.683 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:33:08.802 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:33:08.812 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:33:38.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:33:38.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:34:09.123 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:34:09.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:34:39.253 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:34:39.265 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:35:09.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:35:09.492 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:35:39.696 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:35:39.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:36:09.852 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:36:09.861 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:36:39.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:36:39.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:37:10.147 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:37:10.156 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:37:40.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:37:40.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:38:10.508 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:38:10.518 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:38:40.730 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:38:40.738 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:39:10.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:39:10.878 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:39:41.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:39:41.034 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:40:11.205 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:40:11.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:40:42.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:40:42.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:41:12.291 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:41:12.301 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:41:42.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:41:42.498 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:42:12.670 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:42:12.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:42:42.892 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:42:42.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:43:13.090 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:43:13.099 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:43:43.256 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:43:43.266 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:44:13.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:44:13.492 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:44:43.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:44:43.630 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:45:13.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:45:13.754 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:45:43.950 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:45:43.959 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:46:14.092 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:46:14.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:46:44.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:46:44.303 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:47:14.432 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:47:14.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:47:44.615 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:47:44.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:48:14.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:48:14.753 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:48:44.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:48:44.877 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:49:15.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:49:15.010 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:49:45.154 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:49:45.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:50:15.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:50:15.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:50:46.163 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:50:46.172 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:51:16.295 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:51:16.303 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:51:46.416 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:51:46.424 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:52:16.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:52:16.552 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:52:46.679 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:52:46.688 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:53:16.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:53:16.819 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:53:46.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:53:46.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:54:17.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:54:17.113 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:54:47.244 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:54:47.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:55:17.374 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:55:17.384 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:55:47.507 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:55:47.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:56:17.636 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:56:17.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:56:47.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:56:47.784 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:57:17.914 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:57:17.922 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:57:48.053 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:57:48.062 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:58:18.182 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:58:18.192 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:58:48.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:58:48.342 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:59:18.461 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:59:18.471 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:59:48.582 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:59:48.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:00:18.731 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:00:18.740 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:00:50.048 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:00:50.058 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:01:20.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:01:20.185 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:01:24.264 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-04-21T09:01:24.265 DEBUG:teuthology.task.console_log:Killing console logger for smithi071 2024-04-21T09:01:24.265 DEBUG:teuthology.task.console_log:Killing console logger for smithi137 2024-04-21T09:01:24.266 DEBUG:teuthology.exit:Finished running handlers